[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:06:16.200009 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:38919
I20260709 13:06:16.201642 25507 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:06:16.202767 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:16.220271 25514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:16.220328 25513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:16.220328 25516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:16.222318 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:17.425632 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:17.425894 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:17.426050 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602377426033 us; error 0 us; skew 500 ppm
I20260709 13:06:17.426826 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:17.433521 25507 webserver.cc:533] Webserver started at http://127.24.232.254:41009/ using document root <none> and password file <none>
I20260709 13:06:17.434358 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:17.434552 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:17.434971 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:17.440971 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "e366ecf182ba44d9bbb63b9c2070e403"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:17.448915 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:06:17.453953 25522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:17.455166 25507 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:17.455477 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "e366ecf182ba44d9bbb63b9c2070e403"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:17.455825 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:17.522333 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:17.523882 25507 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:06:17.524309 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:17.597184 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:38919
I20260709 13:06:17.597286 25573 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:38919 every 8 connection(s)
I20260709 13:06:17.605727 25574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:17.627656 25574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: Bootstrap starting.
I20260709 13:06:17.633639 25574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:17.635433 25574 log.cc:826] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: Log is configured to *not* fsync() on all Append() calls
I20260709 13:06:17.640221 25574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: No bootstrap required, opened a new log
I20260709 13:06:17.660938 25574 raft_consensus.cc:359] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER }
I20260709 13:06:17.661499 25574 raft_consensus.cc:385] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:17.661723 25574 raft_consensus.cc:740] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e366ecf182ba44d9bbb63b9c2070e403, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.662703 25574 consensus_queue.cc:260] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER }
I20260709 13:06:17.663190 25574 raft_consensus.cc:399] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:17.663432 25574 raft_consensus.cc:493] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:17.663789 25574 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:17.667913 25574 raft_consensus.cc:515] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER }
I20260709 13:06:17.668610 25574 leader_election.cc:304] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e366ecf182ba44d9bbb63b9c2070e403; no voters: 
I20260709 13:06:17.670280 25574 leader_election.cc:290] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:17.670636 25577 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:17.673002 25577 raft_consensus.cc:697] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 1 LEADER]: Becoming Leader. State: Replica: e366ecf182ba44d9bbb63b9c2070e403, State: Running, Role: LEADER
I20260709 13:06:17.674037 25577 consensus_queue.cc:237] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER }
I20260709 13:06:17.675081 25574 sys_catalog.cc:565] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:17.687537 25578 sys_catalog.cc:455] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e366ecf182ba44d9bbb63b9c2070e403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER } }
I20260709 13:06:17.688369 25578 sys_catalog.cc:458] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:17.688035 25579 sys_catalog.cc:455] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e366ecf182ba44d9bbb63b9c2070e403. Latest consensus state: current_term: 1 leader_uuid: "e366ecf182ba44d9bbb63b9c2070e403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e366ecf182ba44d9bbb63b9c2070e403" member_type: VOTER } }
I20260709 13:06:17.689056 25579 sys_catalog.cc:458] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:17.692718 25586 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:17.704942 25586 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:17.707587 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:17.723148 25586 catalog_manager.cc:1383] Generated new cluster ID: efeebb290b9f4d91bb736331067674f6
I20260709 13:06:17.723469 25586 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:17.746743 25586 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:17.748414 25586 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:17.766553 25586 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: Generated new TSK 0
I20260709 13:06:17.767647 25586 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:17.774395 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:17.783644 25596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:17.784575 25597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:17.789235 25507 server_base.cc:1061] running on GCE node
W20260709 13:06:17.789589 25599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:17.790503 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:17.790791 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:17.790978 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602377790960 us; error 0 us; skew 500 ppm
I20260709 13:06:17.791744 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:17.796092 25507 webserver.cc:533] Webserver started at http://127.24.232.193:34805/ using document root <none> and password file <none>
I20260709 13:06:17.796674 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:17.796885 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:17.797195 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:17.798349 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:17.804425 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:17.808748 25604 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:17.809623 25507 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:17.809966 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:17.810303 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:17.838737 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:17.840216 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:17.843046 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:17.847167 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:17.847442 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:17.847780 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:17.847970 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:17.954046 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:41967
I20260709 13:06:17.954084 25666 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:41967 every 8 connection(s)
I20260709 13:06:17.962018 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:17.971429 25671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:17.973039 25672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:17.980109 25507 server_base.cc:1061] running on GCE node
W20260709 13:06:17.980830 25674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:17.982009 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:17.982283 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:17.982493 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602377982473 us; error 0 us; skew 500 ppm
I20260709 13:06:17.983304 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:17.987664 25507 webserver.cc:533] Webserver started at http://127.24.232.194:37077/ using document root <none> and password file <none>
I20260709 13:06:17.988205 25667 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38919
I20260709 13:06:17.988348 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:17.988641 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:17.988701 25667 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:17.989003 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:17.989888 25667 heartbeater.cc:507] Master 127.24.232.254:38919 requested a full tablet report, sending...
I20260709 13:06:17.990177 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "6353b5fb3dba4392ad5404f2b45d954a"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:17.993669 25539 ts_manager.cc:194] Registered new tserver with Master: 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967)
I20260709 13:06:17.996953 25539 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47244
I20260709 13:06:17.997362 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:06:18.002113 25679 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.002942 25507 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:18.003257 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "6353b5fb3dba4392ad5404f2b45d954a"
format_stamp: "Formatted at 2026-07-09 13:06:17 on dist-test-slave-sdg5"
I20260709 13:06:18.003554 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:18.045423 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:18.046810 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:18.049476 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:18.053020 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:18.053208 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.053510 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:18.053658 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.146566 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:46689
I20260709 13:06:18.146636 25741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:46689 every 8 connection(s)
I20260709 13:06:18.153960 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:18.162765 25745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:18.169266 25742 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38919
I20260709 13:06:18.169742 25742 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:18.170886 25742 heartbeater.cc:507] Master 127.24.232.254:38919 requested a full tablet report, sending...
W20260709 13:06:18.172521 25746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:18.173477 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:18.173642 25539 ts_manager.cc:194] Registered new tserver with Master: 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
W20260709 13:06:18.174342 25748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:18.175416 25539 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47260
I20260709 13:06:18.175488 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:18.175844 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:18.176059 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602378176035 us; error 0 us; skew 500 ppm
I20260709 13:06:18.176894 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:18.179832 25507 webserver.cc:533] Webserver started at http://127.24.232.195:35697/ using document root <none> and password file <none>
I20260709 13:06:18.180445 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:18.180683 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:18.181010 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:18.182495 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "3ba764badbfd4f31819ee6bd90e24b91"
format_stamp: "Formatted at 2026-07-09 13:06:18 on dist-test-slave-sdg5"
I20260709 13:06:18.188365 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:06:18.192562 25753 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.193473 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:18.193823 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "3ba764badbfd4f31819ee6bd90e24b91"
format_stamp: "Formatted at 2026-07-09 13:06:18 on dist-test-slave-sdg5"
I20260709 13:06:18.194180 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:18.221334 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:18.222944 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:18.224634 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:18.228616 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:18.228904 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.229224 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:18.229440 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:18.318231 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:38379
I20260709 13:06:18.318392 25815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:38379 every 8 connection(s)
I20260709 13:06:18.335068 25816 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38919
I20260709 13:06:18.335456 25816 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:18.336241 25816 heartbeater.cc:507] Master 127.24.232.254:38919 requested a full tablet report, sending...
I20260709 13:06:18.338238 25539 ts_manager.cc:194] Registered new tserver with Master: 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:18.338768 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016095837s
I20260709 13:06:18.339744 25539 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47274
I20260709 13:06:18.392787 25539 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47276:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:18.396911 25539 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:18.507472 25781 tablet_service.cc:1511] Processing CreateTablet for tablet 4ada77cee5f741958182e8cada706441 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:18.510080 25781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ada77cee5f741958182e8cada706441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.509915 25779 tablet_service.cc:1511] Processing CreateTablet for tablet 857ef47d3cd647e0a4dcc51b48496eae (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:18.511256 25779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ef47d3cd647e0a4dcc51b48496eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.509614 25780 tablet_service.cc:1511] Processing CreateTablet for tablet cfc37b8cccfe4446a2f4c7c137b845a2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:18.515636 25632 tablet_service.cc:1511] Processing CreateTablet for tablet 4ada77cee5f741958182e8cada706441 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:18.518813 25629 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ff682ccf54cd19ec9aa495bff47a0 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:18.521694 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ada77cee5f741958182e8cada706441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.522707 25780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc37b8cccfe4446a2f4c7c137b845a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.519274 25631 tablet_service.cc:1511] Processing CreateTablet for tablet cfc37b8cccfe4446a2f4c7c137b845a2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:18.525852 25630 tablet_service.cc:1511] Processing CreateTablet for tablet 857ef47d3cd647e0a4dcc51b48496eae (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:18.537642 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ef47d3cd647e0a4dcc51b48496eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.539541 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ff682ccf54cd19ec9aa495bff47a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.543196 25628 tablet_service.cc:1511] Processing CreateTablet for tablet 7c427a4041e945eb976be89db6218f7f (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:18.539518 25778 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ff682ccf54cd19ec9aa495bff47a0 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:18.547379 25778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ff682ccf54cd19ec9aa495bff47a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.550695 25631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc37b8cccfe4446a2f4c7c137b845a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.552239 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c427a4041e945eb976be89db6218f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.570261 25777 tablet_service.cc:1511] Processing CreateTablet for tablet 7c427a4041e945eb976be89db6218f7f (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:18.573052 25777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c427a4041e945eb976be89db6218f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.578574 25627 tablet_service.cc:1511] Processing CreateTablet for tablet 2e54a7e43d734f639d47a7f3d688eee2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:18.580878 25627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e54a7e43d734f639d47a7f3d688eee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.590757 25776 tablet_service.cc:1511] Processing CreateTablet for tablet 2e54a7e43d734f639d47a7f3d688eee2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:18.593709 25776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e54a7e43d734f639d47a7f3d688eee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.609995 25626 tablet_service.cc:1511] Processing CreateTablet for tablet 5061b3551c55424f8a8a78d1ef981371 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:18.611447 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5061b3551c55424f8a8a78d1ef981371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.625658 25775 tablet_service.cc:1511] Processing CreateTablet for tablet 5061b3551c55424f8a8a78d1ef981371 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:18.627177 25775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5061b3551c55424f8a8a78d1ef981371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.636168 25625 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3c9331cac4d72aaefd9dd421212e6 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:18.637606 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3c9331cac4d72aaefd9dd421212e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.649884 25774 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3c9331cac4d72aaefd9dd421212e6 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:18.655743 25774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3c9331cac4d72aaefd9dd421212e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.661006 25834 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:18.677841 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 04ddb50afc0d4df1ac68ff27bee3c422 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:18.689757 25704 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ff682ccf54cd19ec9aa495bff47a0 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:18.689953 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ddb50afc0d4df1ac68ff27bee3c422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.695155 25707 tablet_service.cc:1511] Processing CreateTablet for tablet 4ada77cee5f741958182e8cada706441 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:18.687690 25706 tablet_service.cc:1511] Processing CreateTablet for tablet cfc37b8cccfe4446a2f4c7c137b845a2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:18.693279 25705 tablet_service.cc:1511] Processing CreateTablet for tablet 857ef47d3cd647e0a4dcc51b48496eae (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:18.700868 25703 tablet_service.cc:1511] Processing CreateTablet for tablet 7c427a4041e945eb976be89db6218f7f (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 13:06:18.701704 25587 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:18.708402 25701 tablet_service.cc:1511] Processing CreateTablet for tablet 5061b3551c55424f8a8a78d1ef981371 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:18.711761 25704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ff682ccf54cd19ec9aa495bff47a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.713769 25702 tablet_service.cc:1511] Processing CreateTablet for tablet 2e54a7e43d734f639d47a7f3d688eee2 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:18.722937 25699 tablet_service.cc:1511] Processing CreateTablet for tablet 04ddb50afc0d4df1ac68ff27bee3c422 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:18.723824 25835 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:18.723834 25700 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3c9331cac4d72aaefd9dd421212e6 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:18.732420 25778 tablet_service.cc:1511] Processing CreateTablet for tablet 04ddb50afc0d4df1ac68ff27bee3c422 (DEFAULT_TABLE table=test-workload [id=2a46a00e3155442997316e7ca9693c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:18.739547 25834 tablet_bootstrap.cc:654] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.744215 25706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc37b8cccfe4446a2f4c7c137b845a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.748792 25702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e54a7e43d734f639d47a7f3d688eee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.750741 25700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3c9331cac4d72aaefd9dd421212e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.755029 25701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5061b3551c55424f8a8a78d1ef981371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.760226 25778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ddb50afc0d4df1ac68ff27bee3c422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.761910 25705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ef47d3cd647e0a4dcc51b48496eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.768478 25699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ddb50afc0d4df1ac68ff27bee3c422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.771931 25707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ada77cee5f741958182e8cada706441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.776996 25703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c427a4041e945eb976be89db6218f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.791608 25834 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:18.792176 25834 ts_tablet_manager.cc:1403] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.008s
I20260709 13:06:18.810868 25835 tablet_bootstrap.cc:654] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.815400 25834 raft_consensus.cc:359] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.816581 25834 raft_consensus.cc:385] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.816895 25834 raft_consensus.cc:740] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.817929 25834 consensus_queue.cc:260] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.838193 25816 heartbeater.cc:499] Master 127.24.232.254:38919 was elected leader, sending a full tablet report...
I20260709 13:06:18.840963 25834 ts_tablet_manager.cc:1434] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.017s
I20260709 13:06:18.868628 25837 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:18.869294 25834 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:18.870056 25835 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:18.870527 25835 ts_tablet_manager.cc:1403] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.151s	user 0.004s	sys 0.027s
I20260709 13:06:18.877956 25837 tablet_bootstrap.cc:654] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.884428 25834 tablet_bootstrap.cc:654] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.891786 25835 raft_consensus.cc:359] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.892539 25835 raft_consensus.cc:385] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.892851 25835 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.893584 25835 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.895296 25837 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:18.895756 25837 ts_tablet_manager.cc:1403] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.005s
I20260709 13:06:18.898124 25837 raft_consensus.cc:359] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.898636 25837 raft_consensus.cc:385] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.898891 25837 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.899369 25834 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:18.899538 25837 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.900075 25834 ts_tablet_manager.cc:1403] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.007s
I20260709 13:06:18.902664 25742 heartbeater.cc:499] Master 127.24.232.254:38919 was elected leader, sending a full tablet report...
I20260709 13:06:18.904639 25837 ts_tablet_manager.cc:1434] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:18.906054 25837 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:18.912802 25837 tablet_bootstrap.cc:654] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.912014 25834 raft_consensus.cc:359] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:18.914147 25834 raft_consensus.cc:385] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.914481 25834 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.914856 25835 ts_tablet_manager.cc:1434] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.018s
I20260709 13:06:18.916024 25667 heartbeater.cc:499] Master 127.24.232.254:38919 was elected leader, sending a full tablet report...
I20260709 13:06:18.916455 25835 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:18.915225 25834 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:18.924685 25834 ts_tablet_manager.cc:1434] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:06:18.925807 25834 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:18.929395 25835 tablet_bootstrap.cc:654] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.929996 25837 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:18.930507 25837 ts_tablet_manager.cc:1403] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.008s
I20260709 13:06:18.933441 25837 raft_consensus.cc:359] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.934196 25837 raft_consensus.cc:385] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.934508 25837 raft_consensus.cc:740] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.935266 25837 consensus_queue.cc:260] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.936336 25834 tablet_bootstrap.cc:654] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.943888 25835 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:18.944618 25835 ts_tablet_manager.cc:1403] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:06:18.948140 25835 raft_consensus.cc:359] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.948868 25835 raft_consensus.cc:385] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.949144 25834 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:18.949162 25835 raft_consensus.cc:740] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.950296 25834 ts_tablet_manager.cc:1403] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 13:06:18.950603 25835 consensus_queue.cc:260] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.953192 25835 ts_tablet_manager.cc:1434] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:18.953688 25837 ts_tablet_manager.cc:1434] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:06:18.954062 25835 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:18.954843 25837 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:18.959250 25834 raft_consensus.cc:359] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.960126 25834 raft_consensus.cc:385] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.960500 25834 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.961241 25835 tablet_bootstrap.cc:654] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:18.962394 25668 tablet.cc:2406] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:18.961282 25834 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.966174 25834 ts_tablet_manager.cc:1434] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:18.967383 25834 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:18.972836 25837 tablet_bootstrap.cc:654] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.973925 25834 tablet_bootstrap.cc:654] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:18.983851 25835 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:18.984350 25835 ts_tablet_manager.cc:1403] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.007s
I20260709 13:06:18.984681 25834 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:18.985173 25834 ts_tablet_manager.cc:1403] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:06:18.985805 25837 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:18.986301 25837 ts_tablet_manager.cc:1403] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:06:18.987326 25835 raft_consensus.cc:359] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.988083 25835 raft_consensus.cc:385] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.988409 25835 raft_consensus.cc:740] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.988174 25834 raft_consensus.cc:359] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.988941 25834 raft_consensus.cc:385] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.989454 25834 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.989202 25837 raft_consensus.cc:359] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.989223 25835 consensus_queue.cc:260] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.990161 25837 raft_consensus.cc:385] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:18.991851 25837 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:18.992053 25835 ts_tablet_manager.cc:1434] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:18.993057 25835 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:18.992762 25837 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.995043 25837 ts_tablet_manager.cc:1434] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:06:18.990234 25834 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:18.997838 25834 ts_tablet_manager.cc:1434] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:18.998347 25837 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.002015 25835 tablet_bootstrap.cc:654] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.004765 25837 tablet_bootstrap.cc:654] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.006234 25834 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:19.013526 25834 tablet_bootstrap.cc:654] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.013957 25835 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.014326 25838 raft_consensus.cc:493] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.014488 25835 ts_tablet_manager.cc:1403] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:06:19.014873 25838 raft_consensus.cc:515] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.017608 25835 raft_consensus.cc:359] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.019093 25838 leader_election.cc:290] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.018342 25835 raft_consensus.cc:385] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.025660 25835 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.026623 25835 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.031792 25835 ts_tablet_manager.cc:1434] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:06:19.033015 25835 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:19.037043 25834 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:19.042085 25837 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.045115 25837 ts_tablet_manager.cc:1403] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.011s
I20260709 13:06:19.045233 25834 ts_tablet_manager.cc:1403] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.002s
I20260709 13:06:19.045297 25835 tablet_bootstrap.cc:654] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.047470 25837 raft_consensus.cc:359] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.050631 25837 raft_consensus.cc:385] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.051000 25837 raft_consensus.cc:740] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.052065 25834 raft_consensus.cc:359] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.052140 25837 consensus_queue.cc:260] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.052915 25834 raft_consensus.cc:385] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.053283 25834 raft_consensus.cc:740] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.054708 25837 ts_tablet_manager.cc:1434] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:19.055708 25837 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.055430 25834 consensus_queue.cc:260] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.056255 25838 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.056702 25838 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.058816 25838 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.062505 25835 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.063009 25835 ts_tablet_manager.cc:1403] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:06:19.066097 25835 raft_consensus.cc:359] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.066852 25835 raft_consensus.cc:385] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.067168 25835 raft_consensus.cc:740] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.068598 25843 raft_consensus.cc:493] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.068059 25835 consensus_queue.cc:260] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.069274 25843 raft_consensus.cc:515] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.070838 25835 ts_tablet_manager.cc:1434] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:06:19.071851 25835 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:19.072670 25843 leader_election.cc:290] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.124291 25837 tablet_bootstrap.cc:654] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.143724 25835 tablet_bootstrap.cc:654] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.144840 25834 ts_tablet_manager.cc:1434] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.099s	user 0.025s	sys 0.018s
I20260709 13:06:19.146059 25834 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:19.151737 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.154011 25641 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 0.
I20260709 13:06:19.159546 25857 raft_consensus.cc:493] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.142202 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.159449 25842 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.160451 25857 raft_consensus.cc:515] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.170011 25757 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.171413 25716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.161586 25842 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.172920 25857 leader_election.cc:290] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.176178 25857 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.177090 25857 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.178100 25857 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.178309 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.168186 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.180024 25642 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 0.
W20260709 13:06:19.180912 25757 leader_election.cc:343] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.180101 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.185559 25842 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.186928 25757 leader_election.cc:304] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
W20260709 13:06:19.187547 25754 leader_election.cc:343] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:19.191460 25754 leader_election.cc:343] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.193425 25838 raft_consensus.cc:2804] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.196590 25838 raft_consensus.cc:493] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.197113 25838 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.193611 25754 leader_election.cc:304] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91; no voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.215165 25838 raft_consensus.cc:515] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.217381 25838 leader_election.cc:290] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.217947 25838 raft_consensus.cc:2749] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.218209 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.218873 25642 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.221308 25857 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.225273 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.226051 25641 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.226542 25834 tablet_bootstrap.cc:654] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.223459 25857 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.240243 25642 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 1.
I20260709 13:06:19.240732 25837 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.241294 25837 ts_tablet_manager.cc:1403] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.017s
I20260709 13:06:19.241539 25757 leader_election.cc:304] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.245050 25857 raft_consensus.cc:2804] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.247689 25857 raft_consensus.cc:697] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:19.248039 25835 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.248521 25641 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 1.
I20260709 13:06:19.248524 25835 ts_tablet_manager.cc:1403] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.028s
W20260709 13:06:19.244978 25754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46689, user_credentials={real_user=slave}} blocked reactor thread for 53531.7us
I20260709 13:06:19.248695 25857 consensus_queue.cc:237] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.250326 25757 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
W20260709 13:06:19.250422 25754 leader_election.cc:343] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.251220 25838 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.251709 25838 raft_consensus.cc:697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:19.252693 25838 consensus_queue.cc:237] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.258742 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.258900 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.259451 25717 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 0.
I20260709 13:06:19.261157 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.260509 25835 raft_consensus.cc:359] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.263527 25605 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.264889 25842 raft_consensus.cc:493] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.263044 25837 raft_consensus.cc:359] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.266040 25837 raft_consensus.cc:385] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.265395 25842 raft_consensus.cc:515] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.266450 25837 raft_consensus.cc:740] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.264523 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.267236 25837 consensus_queue.cc:260] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.270474 25837 ts_tablet_manager.cc:1434] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:06:19.271732 25837 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.265776 25835 raft_consensus.cc:385] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.276875 25835 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.277980 25835 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.284070 25837 tablet_bootstrap.cc:654] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.288316 25865 raft_consensus.cc:493] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.289029 25865 raft_consensus.cc:515] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.298012 25865 leader_election.cc:290] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967)
I20260709 13:06:19.300233 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.301131 25642 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 0.
I20260709 13:06:19.302771 25757 leader_election.cc:304] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.304105 25865 raft_consensus.cc:2804] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.304570 25865 raft_consensus.cc:493] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.304975 25865 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.267935 25641 raft_consensus.cc:2468] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 0.
I20260709 13:06:19.311926 25842 leader_election.cc:290] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
W20260709 13:06:19.317045 25754 leader_election.cc:343] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.320170 25842 raft_consensus.cc:2804] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:19.322645 25754 leader_election.cc:343] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.323387 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.321354 25842 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.340480 25843 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.341636 25842 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.344846 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
W20260709 13:06:19.349804 25605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46689, user_credentials={real_user=slave}} blocked reactor thread for 86903.7us
I20260709 13:06:19.351683 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.352407 25715 raft_consensus.cc:2468] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 0.
I20260709 13:06:19.354023 25605 leader_election.cc:304] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.354707 25790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.354975 25867 raft_consensus.cc:2804] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.355401 25867 raft_consensus.cc:493] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.355789 25867 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:19.356549 25606 leader_election.cc:343] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.356464 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.347903 25843 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.347611 25683 leader_election.cc:304] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
W20260709 13:06:19.363036 25754 leader_election.cc:343] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:19.363538 25606 leader_election.cc:343] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:19.368496 25681 leader_election.cc:343] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.374665 25837 tablet_bootstrap.cc:492] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.375380 25837 ts_tablet_manager.cc:1403] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.014s
I20260709 13:06:19.372610 25843 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.377120 25843 raft_consensus.cc:2804] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.377472 25843 raft_consensus.cc:493] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.377800 25843 raft_consensus.cc:3060] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.367152 25865 raft_consensus.cc:515] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.396795 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.425203 25641 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.386854 25537 catalog_manager.cc:5697] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.425801 25834 tablet_bootstrap.cc:492] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:19.426335 25834 ts_tablet_manager.cc:1403] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.281s	user 0.017s	sys 0.012s
I20260709 13:06:19.396353 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.388716 25865 leader_election.cc:290] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967)
I20260709 13:06:19.428568 25791 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 0.
I20260709 13:06:19.429574 25837 raft_consensus.cc:359] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.430348 25837 raft_consensus.cc:385] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.430649 25837 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.428625 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.399418 25842 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.406006 25835 ts_tablet_manager.cc:1434] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.156s	user 0.015s	sys 0.018s
I20260709 13:06:19.430567 25681 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:19.429144 25843 raft_consensus.cc:515] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.433907 25873 raft_consensus.cc:2804] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.434391 25873 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.434780 25873 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.438442 25843 leader_election.cc:290] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
W20260709 13:06:19.439373 25754 leader_election.cc:343] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.439299 25837 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.444136 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
W20260709 13:06:19.445753 25681 leader_election.cc:343] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.446240 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.446885 25641 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 1.
I20260709 13:06:19.447021 25717 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.450205 25842 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.453457 25867 raft_consensus.cc:515] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
W20260709 13:06:19.442395 25683 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41967, user_credentials={real_user=slave}} blocked reactor thread for 98256.3us
I20260709 13:06:19.454972 25757 leader_election.cc:304] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:19.454043 25835 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:19.452579 25834 raft_consensus.cc:359] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.457369 25834 raft_consensus.cc:385] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.457517 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:19.457705 25834 raft_consensus.cc:740] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.456836 25865 raft_consensus.cc:2804] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.458468 25834 consensus_queue.cc:260] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
W20260709 13:06:19.458900 25606 leader_election.cc:343] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.459167 25865 raft_consensus.cc:697] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:19.460054 25865 consensus_queue.cc:237] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.461295 25867 leader_election.cc:290] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.461972 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.466289 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.466542 25717 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 1.
I20260709 13:06:19.466864 25642 raft_consensus.cc:3060] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.467434 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:19.468005 25791 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.470779 25837 ts_tablet_manager.cc:1434] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.007s
I20260709 13:06:19.471999 25834 ts_tablet_manager.cc:1434] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:06:19.472891 25837 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.471585 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
W20260709 13:06:19.474745 25683 leader_election.cc:343] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.464188 25715 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.472950 25834 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:19.475915 25605 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:19.477483 25642 raft_consensus.cc:2468] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 1.
I20260709 13:06:19.483413 25867 raft_consensus.cc:2804] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.486263 25867 raft_consensus.cc:697] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:19.487556 25835 tablet_bootstrap.cc:654] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.487721 25867 consensus_queue.cc:237] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.485249 25791 raft_consensus.cc:2468] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 1.
I20260709 13:06:19.489158 25683 leader_election.cc:304] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:19.496029 25875 raft_consensus.cc:2804] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.497223 25875 raft_consensus.cc:697] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:19.499966 25843 raft_consensus.cc:493] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.500187 25875 consensus_queue.cc:237] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.501144 25606 leader_election.cc:304] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.502592 25842 raft_consensus.cc:2804] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.503104 25842 raft_consensus.cc:697] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:19.500456 25843 raft_consensus.cc:515] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.503924 25842 consensus_queue.cc:237] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.506042 25843 leader_election.cc:290] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.495119 25873 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.508209 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.509737 25715 raft_consensus.cc:2468] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 1.
I20260709 13:06:19.509948 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
W20260709 13:06:19.510299 25681 leader_election.cc:343] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:19.533205 25683 leader_election.cc:343] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.533696 25683 leader_election.cc:304] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a; no voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.534494 25875 raft_consensus.cc:2749] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.540609 25539 catalog_manager.cc:5697] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 1 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.543227 25835 tablet_bootstrap.cc:492] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.543740 25835 ts_tablet_manager.cc:1403] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.006s
I20260709 13:06:19.539513 25834 tablet_bootstrap.cc:654] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.550109 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.547504 25536 catalog_manager.cc:5697] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 1 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.552536 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:19.553836 25791 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.552037 25873 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.559551 25837 tablet_bootstrap.cc:654] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:19.562649 25683 leader_election.cc:343] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:19.564631 25835 raft_consensus.cc:359] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.565330 25835 raft_consensus.cc:385] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.565613 25835 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.568244 25835 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.570683 25835 ts_tablet_manager.cc:1434] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.005s
I20260709 13:06:19.570675 25791 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 1.
I20260709 13:06:19.571853 25835 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:19.572443 25681 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.573485 25873 raft_consensus.cc:2804] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.573943 25873 raft_consensus.cc:697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:19.574698 25873 consensus_queue.cc:237] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.591431 25835 tablet_bootstrap.cc:654] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.597174 25837 tablet_bootstrap.cc:492] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.597705 25837 ts_tablet_manager.cc:1403] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.002s
I20260709 13:06:19.598510 25537 catalog_manager.cc:5697] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.600612 25837 raft_consensus.cc:359] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.601370 25837 raft_consensus.cc:385] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.601675 25837 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.602429 25837 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:19.600903 25537 catalog_manager.cc:5697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.605031 25837 ts_tablet_manager.cc:1434] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:19.605547 25834 tablet_bootstrap.cc:492] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:19.606098 25834 ts_tablet_manager.cc:1403] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.003s
I20260709 13:06:19.607399 25837 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.610260 25835 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.610694 25835 ts_tablet_manager.cc:1403] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.011s
I20260709 13:06:19.613384 25835 raft_consensus.cc:359] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.614028 25835 raft_consensus.cc:385] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.614270 25835 raft_consensus.cc:740] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.614710 25837 tablet_bootstrap.cc:654] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.614964 25835 consensus_queue.cc:260] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.617071 25835 ts_tablet_manager.cc:1434] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:19.617906 25835 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: Bootstrap starting.
I20260709 13:06:19.617201 25834 raft_consensus.cc:359] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.622185 25834 raft_consensus.cc:385] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.622553 25834 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.623631 25835 tablet_bootstrap.cc:654] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.625047 25539 catalog_manager.cc:5697] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 1 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.623399 25834 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.640616 25835 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: No bootstrap required, opened a new log
I20260709 13:06:19.641055 25835 ts_tablet_manager.cc:1403] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:06:19.641196 25865 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.641681 25865 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.642161 25536 catalog_manager.cc:5697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 1 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.643549 25835 raft_consensus.cc:359] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.644196 25835 raft_consensus.cc:385] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.644440 25835 raft_consensus.cc:740] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.637591 25837 tablet_bootstrap.cc:492] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.644981 25837 ts_tablet_manager.cc:1403] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.012s
I20260709 13:06:19.645057 25835 consensus_queue.cc:260] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.647781 25835 ts_tablet_manager.cc:1434] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:06:19.647898 25837 raft_consensus.cc:359] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.648532 25837 raft_consensus.cc:385] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.648783 25837 raft_consensus.cc:740] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.649413 25837 consensus_queue.cc:260] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.649739 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.650077 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.650884 25715 raft_consensus.cc:2393] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ba764badbfd4f31819ee6bd90e24b91 in current term 1: Already voted for candidate 8890d974d7db4bcea2bd8316d5f7a99c in this term.
I20260709 13:06:19.651391 25837 ts_tablet_manager.cc:1434] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:19.652217 25837 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: Bootstrap starting.
I20260709 13:06:19.652251 25834 ts_tablet_manager.cc:1434] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:06:19.652709 25754 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91; no voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.653208 25834 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:19.653510 25838 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.658003 25837 tablet_bootstrap.cc:654] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.660422 25834 tablet_bootstrap.cc:654] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.667621 25873 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.668123 25873 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.669253 25834 tablet_bootstrap.cc:492] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:19.669674 25834 ts_tablet_manager.cc:1403] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:06:19.670051 25873 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.671605 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.672345 25642 raft_consensus.cc:2393] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6353b5fb3dba4392ad5404f2b45d954a in current term 1: Already voted for candidate 3ba764badbfd4f31819ee6bd90e24b91 in this term.
I20260709 13:06:19.672386 25834 raft_consensus.cc:359] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.673178 25834 raft_consensus.cc:385] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.673444 25834 raft_consensus.cc:740] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.674140 25834 consensus_queue.cc:260] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.674466 25865 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.675321 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.675781 25842 raft_consensus.cc:493] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.676236 25842 raft_consensus.cc:515] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.676911 25681 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a; no voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.677295 25837 tablet_bootstrap.cc:492] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: No bootstrap required, opened a new log
I20260709 13:06:19.677721 25837 ts_tablet_manager.cc:1403] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:06:19.678185 25842 leader_election.cc:290] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.678376 25873 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.680434 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.680343 25837 raft_consensus.cc:359] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.681032 25837 raft_consensus.cc:385] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.681299 25837 raft_consensus.cc:740] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.682171 25837 consensus_queue.cc:260] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.682781 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.683342 25791 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 0.
I20260709 13:06:19.683629 25834 ts_tablet_manager.cc:1434] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:06:19.684129 25715 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 0.
I20260709 13:06:19.684530 25834 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: Bootstrap starting.
I20260709 13:06:19.684170 25857 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:19.686048 25605 leader_election.cc:304] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.687783 25842 raft_consensus.cc:2804] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.688181 25842 raft_consensus.cc:493] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.688580 25842 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.691042 25834 tablet_bootstrap.cc:654] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.694386 25837 ts_tablet_manager.cc:1434] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:06:19.663514 25838 raft_consensus.cc:2749] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:19.705888 25587 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:19.710191 25834 tablet_bootstrap.cc:492] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: No bootstrap required, opened a new log
I20260709 13:06:19.710696 25834 ts_tablet_manager.cc:1403] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 13:06:19.713346 25834 raft_consensus.cc:359] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.714056 25834 raft_consensus.cc:385] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.714329 25834 raft_consensus.cc:740] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.715010 25834 consensus_queue.cc:260] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.716969 25834 ts_tablet_manager.cc:1434] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:19.725405 25717 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.748247 25873 raft_consensus.cc:2749] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.751767 25838 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.755880 25838 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.766744 25842 raft_consensus.cc:515] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.775545 25865 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:19.800297 25842 leader_election.cc:290] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.803197 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:19.803836 25717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.804997 25717 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.804155 25791 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.803339 25867 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.807400 25867 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.809487 25867 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:19.810871 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91" is_pre_election: true
I20260709 13:06:19.811496 25789 raft_consensus.cc:2393] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8890d974d7db4bcea2bd8316d5f7a99c in current term 1: Already voted for candidate 6353b5fb3dba4392ad5404f2b45d954a in this term.
I20260709 13:06:19.814575 25717 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 1.
I20260709 13:06:19.816320 25605 leader_election.cc:304] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.817678 25867 raft_consensus.cc:2804] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.818145 25867 raft_consensus.cc:697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:19.820147 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.820216 25867 consensus_queue.cc:237] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.820719 25791 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 1.
I20260709 13:06:19.822562 25605 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:19.824556 25869 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.840215 25869 raft_consensus.cc:2749] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.843356 25538 catalog_manager.cc:5697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 1 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.850173 25901 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:19.863061 25715 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.871438 25901 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.890028 25869 consensus_queue.cc:1048] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.902220 25867 consensus_queue.cc:1048] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.939563 25867 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.944860 25901 raft_consensus.cc:493] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.945425 25901 raft_consensus.cc:515] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.947516 25901 leader_election.cc:290] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.950498 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.951167 25715 raft_consensus.cc:2468] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 0.
I20260709 13:06:19.951761 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.952379 25642 raft_consensus.cc:2468] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 0.
I20260709 13:06:19.953047 25901 raft_consensus.cc:493] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.953491 25901 raft_consensus.cc:515] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.952561 25754 leader_election.cc:304] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:19.956061 25867 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:19.957089 25865 raft_consensus.cc:2804] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:19.957461 25865 raft_consensus.cc:493] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.957800 25865 raft_consensus.cc:3060] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.959725 25901 leader_election.cc:290] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.962007 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a" is_pre_election: true
I20260709 13:06:19.962311 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5061b3551c55424f8a8a78d1ef981371" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" is_pre_election: true
I20260709 13:06:19.963130 25642 raft_consensus.cc:2393] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ba764badbfd4f31819ee6bd90e24b91 in current term 1: Already voted for candidate 6353b5fb3dba4392ad5404f2b45d954a in this term.
I20260709 13:06:19.964530 25757 leader_election.cc:304] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91; no voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:19.965612 25901 raft_consensus.cc:3060] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.968633 25865 raft_consensus.cc:515] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.972050 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:19.972925 25865 leader_election.cc:290] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:19.973165 25716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ddb50afc0d4df1ac68ff27bee3c422" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:19.973894 25716 raft_consensus.cc:3060] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.974483 25642 raft_consensus.cc:3060] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.980993 25642 raft_consensus.cc:2468] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 1.
I20260709 13:06:19.982227 25757 leader_election.cc:304] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:19.982769 25716 raft_consensus.cc:2468] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 1.
I20260709 13:06:19.983196 25865 raft_consensus.cc:2804] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.983706 25865 raft_consensus.cc:697] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:19.983867 25901 raft_consensus.cc:2749] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:19.984537 25865 consensus_queue.cc:237] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:19.994903 25538 catalog_manager.cc:5697] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.006860 25873 consensus_queue.cc:1048] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.022229 25875 consensus_queue.cc:1048] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.049502 25791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:06:20.050232 25791 raft_consensus.cc:606] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:20.059412 25791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:06:20.059931 25791 raft_consensus.cc:606] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:20.069418 25873 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.076869 25873 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.077831 25716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:35022
I20260709 13:06:20.078387 25716 raft_consensus.cc:606] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:20.084707 25789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:06:20.085352 25789 raft_consensus.cc:606] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:20.107383 25873 raft_consensus.cc:993] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.108395 25875 raft_consensus.cc:1081] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.110350 25642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:45756
I20260709 13:06:20.110982 25642 raft_consensus.cc:606] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:20.111030 25640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45746
I20260709 13:06:20.116336 25640 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.116755 25640 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.121423 25640 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.128019 25716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:20.127331 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.128592 25640 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:20.128937 25791 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.128610 25716 raft_consensus.cc:3055] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.132718 25716 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:20.133586 25716 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.134932 25716 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.138025 25791 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.129614 25641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:45756
I20260709 13:06:20.138809 25641 raft_consensus.cc:606] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:20.139242 25606 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:20.140084 25867 raft_consensus.cc:2804] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.140537 25867 raft_consensus.cc:697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:20.141645 25716 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.141327 25867 consensus_queue.cc:237] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.149883 25538 catalog_manager.cc:5697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 1 to 2, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 2 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.272233 25838 raft_consensus.cc:993] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.272675 25865 raft_consensus.cc:1081] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.274288 25641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45732
I20260709 13:06:20.274886 25641 raft_consensus.cc:493] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.275247 25641 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.281849 25641 raft_consensus.cc:515] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:20.284826 25641 leader_election.cc:290] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Requested vote from peers 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:20.285545 25716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:20.284915 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.286142 25716 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.286552 25791 raft_consensus.cc:3055] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.286931 25791 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:20.287849 25791 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:20.288944 25791 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.292435 25716 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.293742 25605 leader_election.cc:304] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:20.297127 25791 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.298877 25865 raft_consensus.cc:993] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.299280 25865 raft_consensus.cc:1081] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:20.299933 25867 raft_consensus.cc:2804] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.300657 25867 raft_consensus.cc:697] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:20.301533 25867 consensus_queue.cc:237] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:20.303683 25640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45732
I20260709 13:06:20.304243 25640 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.304591 25640 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.310051 25640 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.312222 25640 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:20.313650 25716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:20.310937 25538 catalog_manager.cc:5697] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 1 to 2, leader changed from 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 2 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.314235 25716 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.319099 25869 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.320462 25869 raft_consensus.cc:993] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.320863 25869 raft_consensus.cc:1081] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.321266 25716 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.322889 25605 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:20.323218 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.323791 25867 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.323873 25791 raft_consensus.cc:3055] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.324290 25791 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:20.324968 25716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35016
I20260709 13:06:20.325232 25791 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.325798 25716 raft_consensus.cc:493] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.326298 25716 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.324498 25867 raft_consensus.cc:697] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:20.326534 25791 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.327203 25867 consensus_queue.cc:237] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.332926 25791 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 2.
I20260709 13:06:20.332968 25716 raft_consensus.cc:515] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.336756 25716 leader_election.cc:290] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:20.337462 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:20.338063 25640 raft_consensus.cc:3055] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.338367 25640 raft_consensus.cc:740] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:20.340240 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e54a7e43d734f639d47a7f3d688eee2" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.340890 25789 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.339165 25640 consensus_queue.cc:260] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.342267 25640 raft_consensus.cc:3060] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.344512 25539 catalog_manager.cc:5697] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 1 to 2, leader changed from 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 2 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.354626 25789 raft_consensus.cc:2468] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.355120 25640 raft_consensus.cc:2468] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.357034 25867 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.358618 25681 leader_election.cc:304] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:20.359544 25918 raft_consensus.cc:2804] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.360037 25918 raft_consensus.cc:697] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:20.360857 25918 consensus_queue.cc:237] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.366596 25838 consensus_queue.cc:1048] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.367024 25865 raft_consensus.cc:993] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.367440 25865 raft_consensus.cc:1081] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.372066 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35006
I20260709 13:06:20.372627 25715 raft_consensus.cc:493] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.372989 25715 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.381517 25539 catalog_manager.cc:5697] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 1 to 2, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 2 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.383808 25715 raft_consensus.cc:515] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.387415 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:20.388012 25640 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.388391 25715 leader_election.cc:290] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:20.397997 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.398645 25789 raft_consensus.cc:3055] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.398969 25789 raft_consensus.cc:740] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:20.399784 25789 consensus_queue.cc:260] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.400838 25789 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.403738 25640 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.405433 25683 leader_election.cc:304] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:20.406273 25918 raft_consensus.cc:2804] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.406729 25918 raft_consensus.cc:697] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:20.407495 25918 consensus_queue.cc:237] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.411221 25789 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.411607 25838 consensus_queue.cc:1048] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.418695 25539 catalog_manager.cc:5697] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 1 to 2, leader changed from 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 2 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.448908 25867 raft_consensus.cc:993] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.449419 25842 raft_consensus.cc:1081] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:20.451069 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35016
I20260709 13:06:20.451630 25715 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.452016 25715 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.456938 25715 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.458549 25715 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:20.459427 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:20.459609 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:20.460083 25641 raft_consensus.cc:3055] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.460197 25789 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.460459 25641 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:20.461272 25641 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.462404 25641 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.464952 25789 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.466045 25681 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:20.466717 25918 raft_consensus.cc:2804] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.467165 25918 raft_consensus.cc:697] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:20.467974 25918 consensus_queue.cc:237] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:20.469332 25641 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:20.474373 25539 catalog_manager.cc:5697] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 1 to 2, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 2 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.668320 25715 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.669646 25842 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.677438 25789 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.678897 25867 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.759588 25789 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.761159 25867 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.762887 25789 raft_consensus.cc:1275] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.764425 25918 consensus_queue.cc:1048] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.771409 25715 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.776773 25641 raft_consensus.cc:1275] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.778873 25873 consensus_queue.cc:1048] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.779990 25923 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.825487 25789 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.826766 25869 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.831976 25715 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.833316 25923 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.875021 25641 raft_consensus.cc:1275] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.876452 25918 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.885546 25789 raft_consensus.cc:1275] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.887215 25873 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:20.926617 25791 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.928148 25873 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:20.937951 25641 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.939343 25918 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.173544 25507 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:06:23.174343 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.195612 25641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:45764
I20260709 13:06:23.196282 25641 raft_consensus.cc:606] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Received request to transfer leadership to TS 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:23.207082 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:23.207609 25715 raft_consensus.cc:606] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Received request to transfer leadership to TS 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:23.208848 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:23.209306 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:23.316512 25924 raft_consensus.cc:993] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:23.316939 25933 raft_consensus.cc:1081] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Signalling peer 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:23.318377 25791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:06:23.318857 25791 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.319185 25791 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.323534 25791 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.325279 25791 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:23.326064 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:23.326304 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:23.326679 25641 raft_consensus.cc:3055] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.326812 25715 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.327037 25641 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:23.327864 25641 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.329030 25641 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.333442 25715 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:23.334648 25754 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:23.335157 25641 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:23.335327 25929 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.336573 25929 raft_consensus.cc:697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:23.337416 25929 consensus_queue.cc:237] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.346110 25538 catalog_manager.cc:5697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 2 to 3, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.355341 25940 raft_consensus.cc:993] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:23.355818 25918 raft_consensus.cc:1081] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Signalling peer 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:23.357376 25791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:06:23.357877 25791 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.358263 25791 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.364060 25791 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.365629 25791 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:23.366293 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:23.366580 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:23.366885 25641 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.367098 25715 raft_consensus.cc:3055] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.367419 25715 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:23.368242 25715 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.369392 25715 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.373785 25641 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:23.374984 25757 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:23.375775 25929 raft_consensus.cc:2804] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.376168 25929 raft_consensus.cc:697] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:23.376202 25715 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:23.376951 25929 consensus_queue.cc:237] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:23.383837 25538 catalog_manager.cc:5697] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 2 to 3, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.728888 25715 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.730031 25929 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.738601 25641 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.740008 25934 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:23.875643 25641 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.876850 25944 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.890621 25715 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.892099 25929 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.210100 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.219967 25641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:45756
I20260709 13:06:24.220494 25641 raft_consensus.cc:606] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:24.224797 25641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:45756
I20260709 13:06:24.225270 25641 raft_consensus.cc:606] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:24.229583 25791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:06:24.230036 25791 raft_consensus.cc:606] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:24.234421 25641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:45756
I20260709 13:06:24.234912 25641 raft_consensus.cc:606] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:24.247236 25791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
mode: GRACEFUL
new_leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:06:24.247745 25791 raft_consensus.cc:606] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Received request to transfer leadership to TS 6353b5fb3dba4392ad5404f2b45d954a
I20260709 13:06:24.289902 25934 raft_consensus.cc:993] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.290324 25949 raft_consensus.cc:1081] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.291898 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35006
I20260709 13:06:24.292390 25715 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.292704 25715 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.297325 25715 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.298787 25715 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 4 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:24.299593 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:24.299827 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:24.300199 25641 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.300295 25791 raft_consensus.cc:3055] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.300624 25791 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:24.301330 25791 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.302402 25791 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.306838 25641 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 4.
I20260709 13:06:24.308072 25683 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:24.308580 25791 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 4.
I20260709 13:06:24.308917 25918 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:24.309911 25918 raft_consensus.cc:697] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:24.310740 25918 consensus_queue.cc:237] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.317773 25538 catalog_manager.cc:5697] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 3 to 4, leader changed from 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 4 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.344439 25951 raft_consensus.cc:993] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.344878 25933 raft_consensus.cc:1081] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.346204 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35016
I20260709 13:06:24.346581 25715 raft_consensus.cc:493] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.346814 25715 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.350454 25715 raft_consensus.cc:515] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.351761 25715 leader_election.cc:290] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:24.352631 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:24.352973 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:24.353210 25791 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.353494 25641 raft_consensus.cc:3055] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.353803 25641 raft_consensus.cc:740] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:24.354542 25641 consensus_queue.cc:260] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.355649 25641 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.359158 25791 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:24.360231 25681 leader_election.cc:304] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:24.360962 25918 raft_consensus.cc:2804] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.361377 25918 raft_consensus.cc:697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:24.361827 25641 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 2.
I20260709 13:06:24.362066 25918 consensus_queue.cc:237] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.368273 25538 catalog_manager.cc:5697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 1 to 2, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 2 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.392256 25951 raft_consensus.cc:993] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.392654 25933 raft_consensus.cc:1081] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.393919 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35016
I20260709 13:06:24.394302 25715 raft_consensus.cc:493] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.394516 25715 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.398748 25715 raft_consensus.cc:515] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:24.400261 25715 leader_election.cc:290] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 3 election: Requested vote from peers 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379), 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967)
I20260709 13:06:24.400969 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:24.401263 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:24.401453 25791 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.401770 25641 raft_consensus.cc:3055] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.402029 25641 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:24.402549 25641 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:24.403314 25641 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.406195 25791 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 3.
I20260709 13:06:24.407212 25681 leader_election.cc:304] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:24.407886 25918 raft_consensus.cc:2804] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.408192 25641 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 3.
I20260709 13:06:24.408339 25918 raft_consensus.cc:697] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:24.409245 25918 consensus_queue.cc:237] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:24.415777 25538 catalog_manager.cc:5697] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 2 to 3, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 3 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.498713 25934 raft_consensus.cc:993] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.499182 25949 raft_consensus.cc:1081] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.500572 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35006
I20260709 13:06:24.501081 25715 raft_consensus.cc:493] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.501420 25715 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.505496 25715 raft_consensus.cc:515] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.506879 25715 leader_election.cc:290] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 4 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:24.507720 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:24.507920 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a3c9331cac4d72aaefd9dd421212e6" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:24.508260 25641 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.508364 25791 raft_consensus.cc:3055] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.508680 25791 raft_consensus.cc:740] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:24.509375 25791 consensus_queue.cc:260] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.510419 25791 raft_consensus.cc:3060] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.514181 25641 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 4.
I20260709 13:06:24.515182 25683 leader_election.cc:304] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6353b5fb3dba4392ad5404f2b45d954a, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:24.515870 25918 raft_consensus.cc:2804] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:24.515870 25791 raft_consensus.cc:2468] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 4.
I20260709 13:06:24.516553 25918 raft_consensus.cc:697] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:24.517380 25918 consensus_queue.cc:237] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.523403 25538 catalog_manager.cc:5697] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 3 to 4, leader changed from 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 4 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.592028 25951 raft_consensus.cc:993] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: : Instructing follower 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.592492 25933 raft_consensus.cc:1081] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Signalling peer 6353b5fb3dba4392ad5404f2b45d954a to start an election
I20260709 13:06:24.593845 25715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
 from {username='slave'} at 127.0.0.1:35016
I20260709 13:06:24.594283 25715 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.594543 25715 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.598613 25715 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.600010 25715 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 3 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:24.600742 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:24.601020 25791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "6353b5fb3dba4392ad5404f2b45d954a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:24.601202 25641 raft_consensus.cc:3055] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.601511 25641 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:24.601531 25791 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.602144 25641 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.602933 25641 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.605768 25791 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 3.
I20260709 13:06:24.606702 25681 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 6353b5fb3dba4392ad5404f2b45d954a; no voters: 
I20260709 13:06:24.606837 25641 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6353b5fb3dba4392ad5404f2b45d954a in term 3.
I20260709 13:06:24.607372 25918 raft_consensus.cc:2804] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.607877 25918 raft_consensus.cc:697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Becoming Leader. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:24.608574 25918 consensus_queue.cc:237] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:24.614809 25538 catalog_manager.cc:5697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a reported cstate change: term changed from 2 to 3, leader changed from 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193) to 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194). New cstate: current_term: 3 leader_uuid: "6353b5fb3dba4392ad5404f2b45d954a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.842243 25641 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:24.843415 25918 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.852133 25791 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:24.854270 25918 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.879324 25641 raft_consensus.cc:1275] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.880419 25918 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.888235 25791 raft_consensus.cc:1275] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.889669 25952 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.912786 25791 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:24.913925 25952 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.917128 25641 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:24.918490 25952 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.952751 25791 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:24.953918 25968 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.963430 25641 raft_consensus.cc:1275] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:24.964643 25918 consensus_queue.cc:1048] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.134644 25791 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.135939 25961 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.143987 25641 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Refusing update from remote peer 6353b5fb3dba4392ad5404f2b45d954a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.145352 25961 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.252547 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.260356 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:27.261029 25715 raft_consensus.cc:606] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:27.263497 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:27.263970 25715 raft_consensus.cc:606] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Received request to transfer leadership to TS 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:27.266129 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:27.266538 25715 raft_consensus.cc:606] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Received request to transfer leadership to TS 3ba764badbfd4f31819ee6bd90e24b91
I20260709 13:06:27.268601 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:27.269004 25715 raft_consensus.cc:606] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:27.270982 25715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
mode: GRACEFUL
new_leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:35034
I20260709 13:06:27.271385 25715 raft_consensus.cc:606] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Received request to transfer leadership to TS 8890d974d7db4bcea2bd8316d5f7a99c
I20260709 13:06:27.272392 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:27.272933 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.310797 25975 raft_consensus.cc:993] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.311336 25976 raft_consensus.cc:1081] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.313076 25641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45746
I20260709 13:06:27.313537 25641 raft_consensus.cc:493] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.313884 25641 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.318783 25641 raft_consensus.cc:515] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.320495 25641 leader_election.cc:290] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 4 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:27.321544 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:27.321641 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8ff682ccf54cd19ec9aa495bff47a0" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:27.322129 25715 raft_consensus.cc:3055] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.322222 25789 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.322397 25715 raft_consensus.cc:740] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:27.323150 25715 consensus_queue.cc:260] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.324048 25715 raft_consensus.cc:3060] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.328926 25789 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 4.
I20260709 13:06:27.330013 25715 raft_consensus.cc:2468] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 4.
I20260709 13:06:27.330224 25975 raft_consensus.cc:993] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.330518 25606 leader_election.cc:304] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:27.330797 25976 raft_consensus.cc:1081] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.332427 25977 raft_consensus.cc:2804] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:27.332944 25641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45746
I20260709 13:06:27.333434 25977 raft_consensus.cc:697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:27.333439 25641 raft_consensus.cc:493] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.334389 25641 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.334739 25977 consensus_queue.cc:237] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.340068 25641 raft_consensus.cc:515] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.341922 25641 leader_election.cc:290] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 3 election: Requested vote from peers 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689), 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379)
I20260709 13:06:27.342597 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:27.342270 25537 catalog_manager.cc:5697] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 3 to 4, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 4 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.343147 25715 raft_consensus.cc:3055] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.342964 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc37b8cccfe4446a2f4c7c137b845a2" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:27.343537 25715 raft_consensus.cc:740] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:27.343977 25789 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.344412 25715 consensus_queue.cc:260] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.345664 25715 raft_consensus.cc:3060] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.351616 25789 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 3.
I20260709 13:06:27.352015 25715 raft_consensus.cc:2468] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 3.
I20260709 13:06:27.352952 25606 leader_election.cc:304] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:27.353885 25977 raft_consensus.cc:2804] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.354409 25977 raft_consensus.cc:697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:27.355151 25977 consensus_queue.cc:237] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.362864 25975 raft_consensus.cc:993] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:27.363319 25976 raft_consensus.cc:1081] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Signalling peer 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:27.364198 25537 catalog_manager.cc:5697] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 2 to 3, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 3 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.364729 25789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:06:27.365270 25789 raft_consensus.cc:493] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.365617 25789 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.371928 25789 raft_consensus.cc:515] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.373724 25789 leader_election.cc:290] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:27.374245 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:27.374728 25641 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.374758 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c427a4041e945eb976be89db6218f7f" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:27.375290 25715 raft_consensus.cc:3055] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.375581 25715 raft_consensus.cc:740] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:27.376291 25715 consensus_queue.cc:260] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.377336 25715 raft_consensus.cc:3060] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.380852 25641 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:27.382086 25757 leader_election.cc:304] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:27.382800 25715 raft_consensus.cc:2468] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 3.
I20260709 13:06:27.382856 25949 raft_consensus.cc:2804] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.384352 25949 raft_consensus.cc:697] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:27.385161 25949 consensus_queue.cc:237] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.392108 25537 catalog_manager.cc:5697] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 2 to 3, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.519104 25975 raft_consensus.cc:993] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:27.519541 25976 raft_consensus.cc:1081] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Signalling peer 3ba764badbfd4f31819ee6bd90e24b91 to start an election
I20260709 13:06:27.520947 25789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae"
dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:06:27.521504 25789 raft_consensus.cc:493] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.521803 25789 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.526280 25789 raft_consensus.cc:515] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.527859 25789 leader_election.cc:290] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 5 election: Requested vote from peers 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:27.528647 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
I20260709 13:06:27.528892 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ef47d3cd647e0a4dcc51b48496eae" candidate_uuid: "3ba764badbfd4f31819ee6bd90e24b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:27.529202 25641 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.529387 25715 raft_consensus.cc:3055] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.529732 25715 raft_consensus.cc:740] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:27.530405 25715 consensus_queue.cc:260] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.531220 25715 raft_consensus.cc:3060] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.533416 25641 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 5.
I20260709 13:06:27.534303 25757 leader_election.cc:304] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:27.534967 25949 raft_consensus.cc:2804] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:27.535355 25949 raft_consensus.cc:697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 5 LEADER]: Becoming Leader. State: Replica: 3ba764badbfd4f31819ee6bd90e24b91, State: Running, Role: LEADER
I20260709 13:06:27.535575 25715 raft_consensus.cc:2468] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba764badbfd4f31819ee6bd90e24b91 in term 5.
I20260709 13:06:27.536180 25949 consensus_queue.cc:237] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } }
I20260709 13:06:27.542470 25537 catalog_manager.cc:5697] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 reported cstate change: term changed from 4 to 5, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195). New cstate: current_term: 5 leader_uuid: "3ba764badbfd4f31819ee6bd90e24b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.563876 25975 raft_consensus.cc:993] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: : Instructing follower 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.564284 25976 raft_consensus.cc:1081] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Signalling peer 8890d974d7db4bcea2bd8316d5f7a99c to start an election
I20260709 13:06:27.565522 25641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ada77cee5f741958182e8cada706441"
dest_uuid: "8890d974d7db4bcea2bd8316d5f7a99c"
 from {username='slave'} at 127.0.0.1:45746
I20260709 13:06:27.565888 25641 raft_consensus.cc:493] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.566116 25641 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.569831 25641 raft_consensus.cc:515] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:27.571262 25641 leader_election.cc:290] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 4 election: Requested vote from peers 3ba764badbfd4f31819ee6bd90e24b91 (127.24.232.195:38379), 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689)
I20260709 13:06:27.572034 25789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ba764badbfd4f31819ee6bd90e24b91"
I20260709 13:06:27.572324 25715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ada77cee5f741958182e8cada706441" candidate_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6353b5fb3dba4392ad5404f2b45d954a"
I20260709 13:06:27.572589 25789 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.572814 25715 raft_consensus.cc:3055] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.573117 25715 raft_consensus.cc:740] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6353b5fb3dba4392ad5404f2b45d954a, State: Running, Role: LEADER
I20260709 13:06:27.573676 25715 consensus_queue.cc:260] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:27.574443 25715 raft_consensus.cc:3060] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.577769 25789 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 4.
I20260709 13:06:27.578358 25715 raft_consensus.cc:2468] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8890d974d7db4bcea2bd8316d5f7a99c in term 4.
I20260709 13:06:27.578784 25606 leader_election.cc:304] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba764badbfd4f31819ee6bd90e24b91, 8890d974d7db4bcea2bd8316d5f7a99c; no voters: 
I20260709 13:06:27.579550 25977 raft_consensus.cc:2804] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:27.580014 25977 raft_consensus.cc:697] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 LEADER]: Becoming Leader. State: Replica: 8890d974d7db4bcea2bd8316d5f7a99c, State: Running, Role: LEADER
I20260709 13:06:27.580770 25977 consensus_queue.cc:237] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } }
I20260709 13:06:27.587378 25537 catalog_manager.cc:5697] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c reported cstate change: term changed from 3 to 4, leader changed from 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194) to 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193). New cstate: current_term: 4 leader_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.794734 25641 raft_consensus.cc:1275] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.796110 25949 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.809581 25715 raft_consensus.cc:1275] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.822863 25993 consensus_queue.cc:1048] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.833886 25789 raft_consensus.cc:1275] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.835210 25977 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.844796 25715 raft_consensus.cc:1275] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.846060 25977 consensus_queue.cc:1048] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.876106 25789 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:27.877516 25998 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.887800 25715 raft_consensus.cc:1275] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:27.889036 25977 consensus_queue.cc:1048] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.978912 25641 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 5 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:27.980165 25993 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8890d974d7db4bcea2bd8316d5f7a99c" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:27.988541 25715 raft_consensus.cc:1275] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 5 FOLLOWER]: Refusing update from remote peer 3ba764badbfd4f31819ee6bd90e24b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:27.989910 25949 consensus_queue.cc:1048] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:28.068043 25715 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.069410 25977 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6353b5fb3dba4392ad5404f2b45d954a" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.078172 25789 raft_consensus.cc:1275] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Refusing update from remote peer 8890d974d7db4bcea2bd8316d5f7a99c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.079950 25977 consensus_queue.cc:1048] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba764badbfd4f31819ee6bd90e24b91" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.273815 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.279074 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:06:28.304478 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:28.305315 25507 tablet_replica.cc:333] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.306164 25507 raft_consensus.cc:2243] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.306715 25507 raft_consensus.cc:2272] T 04ddb50afc0d4df1ac68ff27bee3c422 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.308980 25507 tablet_replica.cc:333] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.309499 25507 raft_consensus.cc:2243] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.310228 25507 raft_consensus.cc:2272] T ec8ff682ccf54cd19ec9aa495bff47a0 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.312500 25507 tablet_replica.cc:333] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.313019 25507 raft_consensus.cc:2243] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.313432 25507 raft_consensus.cc:2272] T 5061b3551c55424f8a8a78d1ef981371 P 8890d974d7db4bcea2bd8316d5f7a99c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.315093 25507 tablet_replica.cc:333] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.315578 25507 raft_consensus.cc:2243] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.316072 25507 raft_consensus.cc:2272] T e9a3c9331cac4d72aaefd9dd421212e6 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.317773 25507 tablet_replica.cc:333] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.318234 25507 raft_consensus.cc:2243] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.318658 25507 raft_consensus.cc:2272] T 857ef47d3cd647e0a4dcc51b48496eae P 8890d974d7db4bcea2bd8316d5f7a99c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.320924 25507 tablet_replica.cc:333] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.321439 25507 raft_consensus.cc:2243] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.321859 25507 raft_consensus.cc:2272] T 7c427a4041e945eb976be89db6218f7f P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.323837 25507 tablet_replica.cc:333] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.324312 25507 raft_consensus.cc:2243] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.325047 25507 raft_consensus.cc:2272] T cfc37b8cccfe4446a2f4c7c137b845a2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.326776 25507 tablet_replica.cc:333] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.327240 25507 raft_consensus.cc:2243] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.328015 25507 raft_consensus.cc:2272] T 4ada77cee5f741958182e8cada706441 P 8890d974d7db4bcea2bd8316d5f7a99c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.330528 25507 tablet_replica.cc:333] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c: stopping tablet replica
I20260709 13:06:28.331228 25507 raft_consensus.cc:2243] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.331815 25507 raft_consensus.cc:2272] T 2e54a7e43d734f639d47a7f3d688eee2 P 8890d974d7db4bcea2bd8316d5f7a99c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:28.424170 25757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41967: connect: Connection refused (error 111)
I20260709 13:06:28.426118 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
W20260709 13:06:28.428185 25757 consensus_peers.cc:597] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 -> Peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Couldn't send request to peer 8890d974d7db4bcea2bd8316d5f7a99c. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.445106 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
W20260709 13:06:28.461097 25754 consensus_peers.cc:597] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 -> Peer 6353b5fb3dba4392ad5404f2b45d954a (127.24.232.194:46689): Couldn't send request to peer 6353b5fb3dba4392ad5404f2b45d954a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.475299 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:28.476054 25507 tablet_replica.cc:333] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.477042 25507 raft_consensus.cc:2243] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.477644 25507 raft_consensus.cc:2272] T cfc37b8cccfe4446a2f4c7c137b845a2 P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:28.479533 25757 consensus_peers.cc:597] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 -> Peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Couldn't send request to peer 8890d974d7db4bcea2bd8316d5f7a99c. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.480189 25507 tablet_replica.cc:333] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.480746 25507 raft_consensus.cc:2243] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.481148 25507 raft_consensus.cc:2272] T 4ada77cee5f741958182e8cada706441 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.482997 25507 tablet_replica.cc:333] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.483515 25507 raft_consensus.cc:2243] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.484294 25507 raft_consensus.cc:2272] T 2e54a7e43d734f639d47a7f3d688eee2 P 6353b5fb3dba4392ad5404f2b45d954a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.485821 25507 tablet_replica.cc:333] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.486290 25507 raft_consensus.cc:2243] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.486662 25507 raft_consensus.cc:2272] T 04ddb50afc0d4df1ac68ff27bee3c422 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.488529 25507 tablet_replica.cc:333] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.488991 25507 raft_consensus.cc:2243] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.489365 25507 raft_consensus.cc:2272] T 7c427a4041e945eb976be89db6218f7f P 6353b5fb3dba4392ad5404f2b45d954a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.491307 25507 tablet_replica.cc:333] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.491917 25507 raft_consensus.cc:2243] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.492300 25507 raft_consensus.cc:2272] T 857ef47d3cd647e0a4dcc51b48496eae P 6353b5fb3dba4392ad5404f2b45d954a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.494030 25507 tablet_replica.cc:333] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.494489 25507 raft_consensus.cc:2243] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.495255 25507 raft_consensus.cc:2272] T e9a3c9331cac4d72aaefd9dd421212e6 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.497017 25507 tablet_replica.cc:333] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.497459 25507 raft_consensus.cc:2243] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.498143 25507 raft_consensus.cc:2272] T 5061b3551c55424f8a8a78d1ef981371 P 6353b5fb3dba4392ad5404f2b45d954a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.499799 25507 tablet_replica.cc:333] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a: stopping tablet replica
I20260709 13:06:28.500226 25507 raft_consensus.cc:2243] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.500593 25507 raft_consensus.cc:2272] T ec8ff682ccf54cd19ec9aa495bff47a0 P 6353b5fb3dba4392ad5404f2b45d954a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.527653 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
W20260709 13:06:28.542727 25757 consensus_peers.cc:597] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 -> Peer 8890d974d7db4bcea2bd8316d5f7a99c (127.24.232.193:41967): Couldn't send request to peer 8890d974d7db4bcea2bd8316d5f7a99c. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:28.545962 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
I20260709 13:06:28.568502 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:28.569090 25507 tablet_replica.cc:333] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.569701 25507 raft_consensus.cc:2243] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.570443 25507 raft_consensus.cc:2272] T 04ddb50afc0d4df1ac68ff27bee3c422 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.572113 25507 tablet_replica.cc:333] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.572588 25507 raft_consensus.cc:2243] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.573015 25507 raft_consensus.cc:2272] T 5061b3551c55424f8a8a78d1ef981371 P 3ba764badbfd4f31819ee6bd90e24b91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.574544 25507 tablet_replica.cc:333] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.575017 25507 raft_consensus.cc:2243] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.575413 25507 raft_consensus.cc:2272] T ec8ff682ccf54cd19ec9aa495bff47a0 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.577476 25507 tablet_replica.cc:333] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.577958 25507 raft_consensus.cc:2243] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.578343 25507 raft_consensus.cc:2272] T e9a3c9331cac4d72aaefd9dd421212e6 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.579888 25507 tablet_replica.cc:333] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.580348 25507 raft_consensus.cc:2243] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.581044 25507 raft_consensus.cc:2272] T 857ef47d3cd647e0a4dcc51b48496eae P 3ba764badbfd4f31819ee6bd90e24b91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.582755 25507 tablet_replica.cc:333] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.583233 25507 raft_consensus.cc:2243] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.583942 25507 raft_consensus.cc:2272] T 7c427a4041e945eb976be89db6218f7f P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.585659 25507 tablet_replica.cc:333] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.586140 25507 raft_consensus.cc:2243] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.586532 25507 raft_consensus.cc:2272] T 2e54a7e43d734f639d47a7f3d688eee2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.588137 25507 tablet_replica.cc:333] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.588572 25507 raft_consensus.cc:2243] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.588987 25507 raft_consensus.cc:2272] T 4ada77cee5f741958182e8cada706441 P 3ba764badbfd4f31819ee6bd90e24b91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.591859 25507 tablet_replica.cc:333] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91: stopping tablet replica
I20260709 13:06:28.592355 25507 raft_consensus.cc:2243] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.592761 25507 raft_consensus.cc:2272] T cfc37b8cccfe4446a2f4c7c137b845a2 P 3ba764badbfd4f31819ee6bd90e24b91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.628343 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:06:28.649807 25507 master.cc:562] Master@127.24.232.254:38919 shutting down...
I20260709 13:06:28.710314 25594 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:06:28.783727 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.784248 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.784523 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P e366ecf182ba44d9bbb63b9c2070e403: stopping tablet replica
I20260709 13:06:28.803299 25507 master.cc:584] Master@127.24.232.254:38919 shutdown complete.
3ba764badbfd4f31819ee6bd90e24b91  1
6353b5fb3dba4392ad5404f2b45d954a  4
8890d974d7db4bcea2bd8316d5f7a99c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12646 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:06:28.843719 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:43511
I20260709 13:06:28.844857 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:28.850116 26008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:28.850404 26009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:28.851742 26011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:28.852022 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:28.852947 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:28.853155 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:28.853320 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602388853287 us; error 0 us; skew 500 ppm
I20260709 13:06:28.853845 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:28.856357 25507 webserver.cc:533] Webserver started at http://127.24.232.254:42997/ using document root <none> and password file <none>
I20260709 13:06:28.856850 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:28.857043 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:28.857321 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:28.858429 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "7dd318ff2f8b4536ac402e64f7d00367"
format_stamp: "Formatted at 2026-07-09 13:06:28 on dist-test-slave-sdg5"
I20260709 13:06:28.862701 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:06:28.865952 26016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:28.866694 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:28.866984 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "7dd318ff2f8b4536ac402e64f7d00367"
format_stamp: "Formatted at 2026-07-09 13:06:28 on dist-test-slave-sdg5"
I20260709 13:06:28.867305 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:28.889355 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:28.890579 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:28.927610 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:43511
I20260709 13:06:28.927794 26067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:43511 every 8 connection(s)
I20260709 13:06:28.931358 26068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.940436 26068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367: Bootstrap starting.
I20260709 13:06:28.944875 26068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.948897 26068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367: No bootstrap required, opened a new log
I20260709 13:06:28.950911 26068 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER }
I20260709 13:06:28.951299 26068 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.951532 26068 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd318ff2f8b4536ac402e64f7d00367, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.952111 26068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER }
I20260709 13:06:28.952561 26068 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:28.952781 26068 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:28.953044 26068 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.956981 26068 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER }
I20260709 13:06:28.957495 26068 leader_election.cc:304] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dd318ff2f8b4536ac402e64f7d00367; no voters: 
I20260709 13:06:28.958607 26068 leader_election.cc:290] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:28.958935 26071 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:28.960214 26071 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd318ff2f8b4536ac402e64f7d00367, State: Running, Role: LEADER
I20260709 13:06:28.960882 26071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER }
I20260709 13:06:28.961551 26068 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:28.965353 26073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dd318ff2f8b4536ac402e64f7d00367. Latest consensus state: current_term: 1 leader_uuid: "7dd318ff2f8b4536ac402e64f7d00367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER } }
I20260709 13:06:28.966097 26073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:28.967133 26072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dd318ff2f8b4536ac402e64f7d00367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd318ff2f8b4536ac402e64f7d00367" member_type: VOTER } }
I20260709 13:06:28.967697 26072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:28.967873 26078 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:28.973408 26078 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:28.977260 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:28.982132 26078 catalog_manager.cc:1383] Generated new cluster ID: 1f90c07a487d417aae2319f740d0a64c
I20260709 13:06:28.982443 26078 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:28.996690 26078 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:28.997896 26078 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:29.008524 26078 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367: Generated new TSK 0
I20260709 13:06:29.009219 26078 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:29.043424 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.049137 26089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.050150 26090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.051993 26092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.052151 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:29.053040 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.053252 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.053454 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602389053418 us; error 0 us; skew 500 ppm
I20260709 13:06:29.054001 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.056278 25507 webserver.cc:533] Webserver started at http://127.24.232.193:38489/ using document root <none> and password file <none>
I20260709 13:06:29.056770 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.056957 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.057248 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.058316 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.062850 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:06:29.066233 26097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.066939 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:29.067236 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.067516 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.103456 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.104727 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.106182 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.108453 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.108620 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.108909 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.109079 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.147779 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:43569
I20260709 13:06:29.147974 26159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:43569 every 8 connection(s)
I20260709 13:06:29.152619 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.158856 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.159814 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.162690 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.162889 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:29.164197 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.164486 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.164700 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602389164680 us; error 0 us; skew 500 ppm
I20260709 13:06:29.165253 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.165959 26160 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43511
I20260709 13:06:29.166383 26160 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.167148 26160 heartbeater.cc:507] Master 127.24.232.254:43511 requested a full tablet report, sending...
I20260709 13:06:29.167759 25507 webserver.cc:533] Webserver started at http://127.24.232.194:39351/ using document root <none> and password file <none>
I20260709 13:06:29.168272 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.168476 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.168864 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.169350 26033 ts_manager.cc:194] Registered new tserver with Master: 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569)
I20260709 13:06:29.170157 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "b71b02f329c742caab3b93f43a471ac7"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.171093 26033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58974
I20260709 13:06:29.175240 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:29.178571 26172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.179394 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:29.179632 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "b71b02f329c742caab3b93f43a471ac7"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.179948 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.193589 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.194698 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.196130 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.198230 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.198429 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.198693 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.198850 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.237088 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:40993
I20260709 13:06:29.237193 26234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:40993 every 8 connection(s)
I20260709 13:06:29.241784 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.248224 26238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.250761 26239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.252589 26241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.253021 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:29.254006 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.254276 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.254470 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602389254446 us; error 0 us; skew 500 ppm
I20260709 13:06:29.255121 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.255426 26235 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43511
I20260709 13:06:29.255892 26235 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.256700 26235 heartbeater.cc:507] Master 127.24.232.254:43511 requested a full tablet report, sending...
I20260709 13:06:29.257951 25507 webserver.cc:533] Webserver started at http://127.24.232.195:36429/ using document root <none> and password file <none>
I20260709 13:06:29.258546 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.258782 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.258932 26033 ts_manager.cc:194] Registered new tserver with Master: b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:29.259097 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.260599 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "1116545907f34dbfb26da42f901358ba"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.260716 26033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58982
I20260709 13:06:29.265722 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:06:29.269058 26246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.269876 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:06:29.270118 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "1116545907f34dbfb26da42f901358ba"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-sdg5"
I20260709 13:06:29.270437 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.287744 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.288959 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.290359 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.292464 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.292698 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.292940 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.293112 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.333375 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:32909
I20260709 13:06:29.333506 26308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:32909 every 8 connection(s)
I20260709 13:06:29.347110 26309 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43511
I20260709 13:06:29.347433 26309 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.348187 26309 heartbeater.cc:507] Master 127.24.232.254:43511 requested a full tablet report, sending...
I20260709 13:06:29.349972 26033 ts_manager.cc:194] Registered new tserver with Master: 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.350175 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013204387s
I20260709 13:06:29.351769 26033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58992
I20260709 13:06:29.374738 26033 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58998:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:29.377528 26033 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:29.452980 26199 tablet_service.cc:1511] Processing CreateTablet for tablet dac2742c36e243eb8c16e90f7e0ca9d5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:29.455317 26200 tablet_service.cc:1511] Processing CreateTablet for tablet 1212d0111cb04d22aba4a6817eb4dd3e (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:29.455379 26197 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5a71f89dbc4e949be5ab1a8b540940 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:29.457494 26200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212d0111cb04d22aba4a6817eb4dd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.458355 26198 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1d02eff14043d1917e29ea6599ea22 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:29.458456 26196 tablet_service.cc:1511] Processing CreateTablet for tablet 684742d4d03d4626bb35c065bd212ee0 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:29.459789 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1d02eff14043d1917e29ea6599ea22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.460449 26196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684742d4d03d4626bb35c065bd212ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.461054 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5a71f89dbc4e949be5ab1a8b540940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.462751 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac2742c36e243eb8c16e90f7e0ca9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.480382 26324 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:29.481416 26125 tablet_service.cc:1511] Processing CreateTablet for tablet 1212d0111cb04d22aba4a6817eb4dd3e (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:29.482157 26272 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1d02eff14043d1917e29ea6599ea22 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:29.482760 26125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212d0111cb04d22aba4a6817eb4dd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.482683 26274 tablet_service.cc:1511] Processing CreateTablet for tablet 1212d0111cb04d22aba4a6817eb4dd3e (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:29.484297 26274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212d0111cb04d22aba4a6817eb4dd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.483939 26273 tablet_service.cc:1511] Processing CreateTablet for tablet dac2742c36e243eb8c16e90f7e0ca9d5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:29.485360 26272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1d02eff14043d1917e29ea6599ea22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.486016 26273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac2742c36e243eb8c16e90f7e0ca9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.487196 26324 tablet_bootstrap.cc:654] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.487480 26271 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5a71f89dbc4e949be5ab1a8b540940 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:29.488773 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5a71f89dbc4e949be5ab1a8b540940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.496961 26270 tablet_service.cc:1511] Processing CreateTablet for tablet 684742d4d03d4626bb35c065bd212ee0 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:29.498438 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684742d4d03d4626bb35c065bd212ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.502336 26124 tablet_service.cc:1511] Processing CreateTablet for tablet dac2742c36e243eb8c16e90f7e0ca9d5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:29.503369 26196 tablet_service.cc:1511] Processing CreateTablet for tablet cda78663cfdd44688f9e6d1fea88a4a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:29.504695 26196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda78663cfdd44688f9e6d1fea88a4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.504750 26123 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1d02eff14043d1917e29ea6599ea22 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:29.506975 26122 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5a71f89dbc4e949be5ab1a8b540940 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:29.508800 26121 tablet_service.cc:1511] Processing CreateTablet for tablet 684742d4d03d4626bb35c065bd212ee0 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:29.511795 26120 tablet_service.cc:1511] Processing CreateTablet for tablet cda78663cfdd44688f9e6d1fea88a4a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:29.513454 26124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac2742c36e243eb8c16e90f7e0ca9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.515990 26123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1d02eff14043d1917e29ea6599ea22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.520761 26269 tablet_service.cc:1511] Processing CreateTablet for tablet cda78663cfdd44688f9e6d1fea88a4a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:29.522110 26269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda78663cfdd44688f9e6d1fea88a4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.524015 26121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684742d4d03d4626bb35c065bd212ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.527995 26120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda78663cfdd44688f9e6d1fea88a4a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.531927 26122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5a71f89dbc4e949be5ab1a8b540940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.536428 26119 tablet_service.cc:1511] Processing CreateTablet for tablet 267b624339b5438d86168a4dd2746274 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:29.537783 26119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267b624339b5438d86168a4dd2746274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.550009 26273 tablet_service.cc:1511] Processing CreateTablet for tablet 267b624339b5438d86168a4dd2746274 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:29.551339 26273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267b624339b5438d86168a4dd2746274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.567894 26324 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:29.568508 26324 ts_tablet_manager.cc:1403] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.027s
I20260709 13:06:29.584455 26326 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.589843 26122 tablet_service.cc:1511] Processing CreateTablet for tablet b2071fb521fb4c4c9206f36d134f6524 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:29.591238 26122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2071fb521fb4c4c9206f36d134f6524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.592393 26197 tablet_service.cc:1511] Processing CreateTablet for tablet 267b624339b5438d86168a4dd2746274 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:29.593660 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267b624339b5438d86168a4dd2746274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.597961 26199 tablet_service.cc:1511] Processing CreateTablet for tablet b2071fb521fb4c4c9206f36d134f6524 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:29.599776 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2071fb521fb4c4c9206f36d134f6524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.599820 26271 tablet_service.cc:1511] Processing CreateTablet for tablet b2071fb521fb4c4c9206f36d134f6524 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:29.601101 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2071fb521fb4c4c9206f36d134f6524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.571695 26324 raft_consensus.cc:359] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.608172 26324 raft_consensus.cc:385] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.608582 26324 raft_consensus.cc:740] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.609313 26327 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.609311 26324 consensus_queue.cc:260] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.611213 26326 tablet_bootstrap.cc:654] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.616631 26327 tablet_bootstrap.cc:654] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.620220 26121 tablet_service.cc:1511] Processing CreateTablet for tablet 1f42e9eb034841698b6489dcefb6e5a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:29.621572 26121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f42e9eb034841698b6489dcefb6e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.633734 26122 tablet_service.cc:1511] Processing CreateTablet for tablet edf602c7e8014523ad7747588ab4ca7b (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:29.622967 26270 tablet_service.cc:1511] Processing CreateTablet for tablet 1f42e9eb034841698b6489dcefb6e5a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:29.635097 26122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf602c7e8014523ad7747588ab4ca7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.635524 26197 tablet_service.cc:1511] Processing CreateTablet for tablet edf602c7e8014523ad7747588ab4ca7b (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:29.635803 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f42e9eb034841698b6489dcefb6e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.636718 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf602c7e8014523ad7747588ab4ca7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.641053 26235 heartbeater.cc:499] Master 127.24.232.254:43511 was elected leader, sending a full tablet report...
I20260709 13:06:29.642675 26324 ts_tablet_manager.cc:1434] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.009s
I20260709 13:06:29.645648 26271 tablet_service.cc:1511] Processing CreateTablet for tablet edf602c7e8014523ad7747588ab4ca7b (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:29.646907 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf602c7e8014523ad7747588ab4ca7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.647236 26329 raft_consensus.cc:493] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.651932 26329 raft_consensus.cc:515] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.655237 26324 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:29.664758 26329 leader_election.cc:290] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.677752 26326 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:29.684226 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:29.685235 26324 tablet_bootstrap.cc:654] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:29.685896 26174 leader_election.cc:343] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.687925 26326 ts_tablet_manager.cc:1403] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.024s
I20260709 13:06:29.621857 26199 tablet_service.cc:1511] Processing CreateTablet for tablet 1f42e9eb034841698b6489dcefb6e5a5 (DEFAULT_TABLE table=test-workload [id=2a5e00d303294843bf638a70141c9dc0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:29.696993 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f42e9eb034841698b6489dcefb6e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.701519 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:29.702178 26327 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.702628 26327 ts_tablet_manager.cc:1403] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.094s	user 0.037s	sys 0.015s
W20260709 13:06:29.703182 26173 leader_election.cc:343] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.703636 26173 leader_election.cc:304] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b02f329c742caab3b93f43a471ac7; no voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:29.704399 26329 raft_consensus.cc:2749] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:29.705516 26327 raft_consensus.cc:359] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.706070 26327 raft_consensus.cc:385] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.706326 26327 raft_consensus.cc:740] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.706983 26327 consensus_queue.cc:260] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.707898 26326 raft_consensus.cc:359] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.711812 26326 raft_consensus.cc:385] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.712143 26326 raft_consensus.cc:740] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.713284 26326 consensus_queue.cc:260] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.719446 26160 heartbeater.cc:499] Master 127.24.232.254:43511 was elected leader, sending a full tablet report...
I20260709 13:06:29.719834 26324 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:29.719980 26327 ts_tablet_manager.cc:1434] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.009s
I20260709 13:06:29.720274 26324 ts_tablet_manager.cc:1403] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.006s
I20260709 13:06:29.720839 26327 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.723073 26324 raft_consensus.cc:359] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.723821 26324 raft_consensus.cc:385] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.724097 26324 raft_consensus.cc:740] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.724752 26324 consensus_queue.cc:260] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.726209 26327 tablet_bootstrap.cc:654] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.726374 26324 ts_tablet_manager.cc:1434] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 13:06:29.727210 26324 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:29.733371 26324 tablet_bootstrap.cc:654] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.733934 26327 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.734495 26327 ts_tablet_manager.cc:1403] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:06:29.735859 26326 ts_tablet_manager.cc:1434] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.008s
I20260709 13:06:29.736512 26309 heartbeater.cc:499] Master 127.24.232.254:43511 was elected leader, sending a full tablet report...
I20260709 13:06:29.738009 26327 raft_consensus.cc:359] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.739033 26327 raft_consensus.cc:385] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.739463 26327 raft_consensus.cc:740] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.740651 26326 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.740491 26327 consensus_queue.cc:260] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.745010 26327 ts_tablet_manager.cc:1434] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:06:29.746346 26327 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.747924 26326 tablet_bootstrap.cc:654] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.749429 26333 raft_consensus.cc:493] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.749903 26333 raft_consensus.cc:515] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.755455 26327 tablet_bootstrap.cc:654] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.758057 26333 leader_election.cc:290] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.775815 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
W20260709 13:06:29.777472 26100 leader_election.cc:343] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.778605 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
W20260709 13:06:29.780449 26098 leader_election.cc:343] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.781282 26327 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.781010 26098 leader_election.cc:304] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:29.782029 26327 ts_tablet_manager.cc:1403] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.016s
I20260709 13:06:29.782625 26333 raft_consensus.cc:2749] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:29.787691 26327 raft_consensus.cc:359] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.788643 26327 raft_consensus.cc:385] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.789009 26327 raft_consensus.cc:740] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.789783 26327 consensus_queue.cc:260] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.792591 26327 ts_tablet_manager.cc:1434] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:29.793835 26327 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.802506 26327 tablet_bootstrap.cc:654] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.806408 26333 raft_consensus.cc:493] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.806984 26333 raft_consensus.cc:515] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.809175 26333 leader_election.cc:290] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.810061 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:29.810801 26324 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:29.810623 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
W20260709 13:06:29.811780 26100 leader_election.cc:343] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.812085 26324 ts_tablet_manager.cc:1403] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.042s
W20260709 13:06:29.812366 26098 leader_election.cc:343] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.812808 26098 leader_election.cc:304] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:29.813824 26326 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:29.813823 26333 raft_consensus.cc:2749] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:29.814514 26326 ts_tablet_manager.cc:1403] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.028s
I20260709 13:06:29.815485 26324 raft_consensus.cc:359] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.816238 26324 raft_consensus.cc:385] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.816524 26324 raft_consensus.cc:740] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.817157 26327 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.817245 26326 raft_consensus.cc:359] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.817680 26327 ts_tablet_manager.cc:1403] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:06:29.817265 26324 consensus_queue.cc:260] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.818027 26326 raft_consensus.cc:385] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.818367 26326 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.819625 26324 ts_tablet_manager.cc:1434] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:06:29.819221 26326 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.820598 26324 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:29.820642 26327 raft_consensus.cc:359] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.821439 26327 raft_consensus.cc:385] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.821548 26326 ts_tablet_manager.cc:1434] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:29.821741 26327 raft_consensus.cc:740] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.822453 26326 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.822434 26327 consensus_queue.cc:260] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.825023 26327 ts_tablet_manager.cc:1434] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:29.825976 26327 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.827361 26324 tablet_bootstrap.cc:654] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.829205 26326 tablet_bootstrap.cc:654] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.832469 26327 tablet_bootstrap.cc:654] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.841936 26326 tablet_bootstrap.cc:492] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:29.842113 26327 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.842427 26326 ts_tablet_manager.cc:1403] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:06:29.842520 26327 ts_tablet_manager.cc:1403] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:06:29.845391 26326 raft_consensus.cc:359] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.845530 26327 raft_consensus.cc:359] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.846027 26329 raft_consensus.cc:493] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.846403 26326 raft_consensus.cc:385] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.846515 26327 raft_consensus.cc:385] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.846870 26327 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.846792 26326 raft_consensus.cc:740] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.846735 26329 raft_consensus.cc:515] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.847779 26327 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.847779 26326 consensus_queue.cc:260] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.850152 26326 ts_tablet_manager.cc:1434] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:29.850529 26327 ts_tablet_manager.cc:1434] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:29.850759 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:29.851161 26326 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.851399 26327 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.853806 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:29.854601 26284 raft_consensus.cc:2468] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:29.856222 26173 leader_election.cc:304] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:29.857671 26326 tablet_bootstrap.cc:654] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.857671 26327 tablet_bootstrap.cc:654] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:29.857936 26174 leader_election.cc:343] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.858058 26345 raft_consensus.cc:2804] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.858794 26345 raft_consensus.cc:493] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.858855 26329 leader_election.cc:290] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.859218 26345 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.873571 26345 raft_consensus.cc:515] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.878343 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
W20260709 13:06:29.879637 26174 leader_election.cc:343] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.880641 26345 leader_election.cc:290] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.887241 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:29.889681 26284 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.910367 26284 raft_consensus.cc:2468] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:29.910750 26327 tablet_bootstrap.cc:492] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.911068 26324 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:29.911253 26327 ts_tablet_manager.cc:1403] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.043s
I20260709 13:06:29.911497 26324 ts_tablet_manager.cc:1403] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.050s
I20260709 13:06:29.911710 26173 leader_election.cc:304] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:29.912015 26326 tablet_bootstrap.cc:492] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:29.912556 26326 ts_tablet_manager.cc:1403] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.037s
I20260709 13:06:29.912865 26345 raft_consensus.cc:2804] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:29.913367 26345 raft_consensus.cc:697] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:29.914150 26324 raft_consensus.cc:359] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.914211 26345 consensus_queue.cc:237] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.915000 26324 raft_consensus.cc:385] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.914956 26327 raft_consensus.cc:359] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.915421 26324 raft_consensus.cc:740] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.915845 26327 raft_consensus.cc:385] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.915624 26326 raft_consensus.cc:359] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.916227 26327 raft_consensus.cc:740] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.916610 26326 raft_consensus.cc:385] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.916538 26324 consensus_queue.cc:260] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.917079 26326 raft_consensus.cc:740] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.917141 26327 consensus_queue.cc:260] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.918073 26326 consensus_queue.cc:260] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.919869 26327 ts_tablet_manager.cc:1434] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:06:29.921423 26326 ts_tablet_manager.cc:1434] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:29.922720 26329 raft_consensus.cc:493] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.923243 26326 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.923213 26329 raft_consensus.cc:515] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.925308 26327 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.925369 26329 leader_election.cc:290] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.925997 26334 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.926579 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:29.926491 26334 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.927227 26135 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:29.929116 26174 leader_election.cc:304] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:29.929973 26329 raft_consensus.cc:2804] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.930317 26329 raft_consensus.cc:493] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.930646 26329 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.931154 26326 tablet_bootstrap.cc:654] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.932457 26327 tablet_bootstrap.cc:654] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.940153 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:29.940989 26284 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:29.943842 26327 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:29.939169 26329 raft_consensus.cc:515] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.944339 26327 ts_tablet_manager.cc:1403] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:06:29.947077 26334 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:29.947367 26327 raft_consensus.cc:359] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.948230 26327 raft_consensus.cc:385] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.947304 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:29.951251 26135 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.948544 26327 raft_consensus.cc:740] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.955751 26327 consensus_queue.cc:260] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.959295 26324 ts_tablet_manager.cc:1434] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:06:29.960306 26324 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:29.960881 26135 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:29.962435 26174 leader_election.cc:304] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:29.962757 26327 ts_tablet_manager.cc:1434] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:29.970494 26353 raft_consensus.cc:2804] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:29.972573 26081 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:29.974632 26327 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:29.976052 26329 leader_election.cc:290] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:29.978052 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:29.979265 26284 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.986632 26284 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:29.987382 26326 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:29.987886 26326 ts_tablet_manager.cc:1403] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.028s
I20260709 13:06:29.989179 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:29.989842 26327 tablet_bootstrap.cc:654] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.990212 26353 raft_consensus.cc:697] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:29.990813 26326 raft_consensus.cc:359] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.991550 26326 raft_consensus.cc:385] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.991062 26353 consensus_queue.cc:237] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.991885 26326 raft_consensus.cc:740] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.992782 26326 consensus_queue.cc:260] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:29.994037 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:29.994632 26135 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:29.995216 26326 ts_tablet_manager.cc:1434] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:29.995862 26248 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:29.996517 26326 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:29.996758 26334 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.997165 26334 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.997510 26334 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.976990 26324 tablet_bootstrap.cc:654] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.005688 26334 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.005621 26030 catalog_manager.cc:5697] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.007658 26334 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.007895 26327 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:30.008230 26334 raft_consensus.cc:493] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.008440 26327 ts_tablet_manager.cc:1403] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 13:06:30.008713 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.008658 26334 raft_consensus.cc:515] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.009450 26135 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.010901 26334 leader_election.cc:290] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.011942 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.012629 26134 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:30.013630 26248 leader_election.cc:304] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.014225 26327 raft_consensus.cc:359] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.014535 26334 raft_consensus.cc:2804] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.014879 26327 raft_consensus.cc:385] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.015010 26334 raft_consensus.cc:493] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.015211 26327 raft_consensus.cc:740] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.015482 26334 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.016191 26326 tablet_bootstrap.cc:654] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:30.003981 26249 leader_election.cc:343] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:30.015956 26327 consensus_queue.cc:260] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.023002 26135 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.025941 26327 ts_tablet_manager.cc:1434] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:30.025954 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.026858 26209 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:30.027036 26327 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:30.027930 26248 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.028913 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.032071 26334 raft_consensus.cc:515] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
W20260709 13:06:30.030357 26249 leader_election.cc:343] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:30.033550 26327 tablet_bootstrap.cc:654] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.036474 26356 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.037202 26324 tablet_bootstrap.cc:492] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.037832 26324 ts_tablet_manager.cc:1403] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.006s
I20260709 13:06:30.036377 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.040037 26135 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.048817 26324 raft_consensus.cc:359] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.049820 26324 raft_consensus.cc:385] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.050201 26324 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.052620 26135 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.053704 26334 leader_election.cc:290] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.054234 26248 leader_election.cc:304] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.055153 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.055482 26334 raft_consensus.cc:2804] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.055747 26210 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.051177 26324 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.055994 26334 raft_consensus.cc:697] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.056855 26334 consensus_queue.cc:237] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.058151 26324 ts_tablet_manager.cc:1434] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:06:30.062479 26356 raft_consensus.cc:697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.066730 26324 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:30.068995 26356 consensus_queue.cc:237] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.069893 26210 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.081144 26326 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:30.081786 26326 ts_tablet_manager.cc:1403] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.027s
I20260709 13:06:30.082546 26327 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:30.082962 26327 ts_tablet_manager.cc:1403] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.007s
I20260709 13:06:30.085527 26327 raft_consensus.cc:359] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.086210 26327 raft_consensus.cc:385] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.085645 26326 raft_consensus.cc:359] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.086469 26327 raft_consensus.cc:740] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.086628 26326 raft_consensus.cc:385] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.087064 26326 raft_consensus.cc:740] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.087170 26327 consensus_queue.cc:260] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.089736 26326 consensus_queue.cc:260] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.088559 26030 catalog_manager.cc:5697] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.092442 26324 tablet_bootstrap.cc:654] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.093319 26326 ts_tablet_manager.cc:1434] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:06:30.094579 26326 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:30.098959 26327 ts_tablet_manager.cc:1434] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:06:30.099866 26327 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Bootstrap starting.
I20260709 13:06:30.102901 26326 tablet_bootstrap.cc:654] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.108929 26327 tablet_bootstrap.cc:654] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.114965 26324 tablet_bootstrap.cc:492] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.115456 26324 ts_tablet_manager.cc:1403] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 13:06:30.118103 26326 tablet_bootstrap.cc:492] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:30.118593 26326 ts_tablet_manager.cc:1403] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.018s
I20260709 13:06:30.118855 26324 raft_consensus.cc:359] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.120000 26324 raft_consensus.cc:385] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.119457 26030 catalog_manager.cc:5697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 1 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.120432 26324 raft_consensus.cc:740] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.121393 26326 raft_consensus.cc:359] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.121527 26324 consensus_queue.cc:260] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.122112 26326 raft_consensus.cc:385] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.122418 26326 raft_consensus.cc:740] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.123121 26326 consensus_queue.cc:260] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.124100 26324 ts_tablet_manager.cc:1434] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:06:30.125507 26326 ts_tablet_manager.cc:1434] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:30.126365 26326 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:30.127117 26327 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: No bootstrap required, opened a new log
I20260709 13:06:30.127518 26327 ts_tablet_manager.cc:1403] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:06:30.129859 26327 raft_consensus.cc:359] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.130481 26327 raft_consensus.cc:385] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.130736 26327 raft_consensus.cc:740] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.131464 26327 consensus_queue.cc:260] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.132682 26326 tablet_bootstrap.cc:654] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.132712 26324 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:30.139720 26324 tablet_bootstrap.cc:654] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.140831 26326 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:30.141251 26326 ts_tablet_manager.cc:1403] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:06:30.141717 26327 ts_tablet_manager.cc:1434] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:06:30.142270 26031 catalog_manager.cc:5697] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 1 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.143235 26326 raft_consensus.cc:359] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.143810 26326 raft_consensus.cc:385] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.144121 26326 raft_consensus.cc:740] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.144868 26326 consensus_queue.cc:260] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.146163 26324 tablet_bootstrap.cc:492] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.146437 26326 ts_tablet_manager.cc:1434] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:06:30.146775 26324 ts_tablet_manager.cc:1403] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:06:30.147177 26326 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:30.149518 26324 raft_consensus.cc:359] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.150213 26324 raft_consensus.cc:385] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.150496 26324 raft_consensus.cc:740] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.151185 26324 consensus_queue.cc:260] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.152858 26326 tablet_bootstrap.cc:654] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.154524 26324 ts_tablet_manager.cc:1434] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:30.155484 26324 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:30.162384 26324 tablet_bootstrap.cc:654] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.167481 26324 tablet_bootstrap.cc:492] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.167920 26326 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:30.167951 26324 ts_tablet_manager.cc:1403] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 13:06:30.168396 26326 ts_tablet_manager.cc:1403] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:06:30.170408 26324 raft_consensus.cc:359] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.170543 26326 raft_consensus.cc:359] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.170889 26324 raft_consensus.cc:385] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.171136 26326 raft_consensus.cc:385] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.171195 26324 raft_consensus.cc:740] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.171468 26326 raft_consensus.cc:740] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.171979 26324 consensus_queue.cc:260] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.172248 26326 consensus_queue.cc:260] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.173852 26324 ts_tablet_manager.cc:1434] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:06:30.174345 26326 ts_tablet_manager.cc:1434] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:30.174746 26324 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:30.175202 26326 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: Bootstrap starting.
I20260709 13:06:30.175485 26353 raft_consensus.cc:493] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.175922 26353 raft_consensus.cc:515] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.178011 26353 leader_election.cc:290] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.180859 26324 tablet_bootstrap.cc:654] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.180833 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.181207 26326 tablet_bootstrap.cc:654] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.181622 26135 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:30.181751 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.182407 26284 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:30.183622 26173 leader_election.cc:304] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.185316 26353 raft_consensus.cc:2804] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.185858 26353 raft_consensus.cc:493] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.186393 26353 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.194283 26354 raft_consensus.cc:493] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.194985 26354 raft_consensus.cc:515] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.198040 26354 leader_election.cc:290] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.198359 26326 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: No bootstrap required, opened a new log
I20260709 13:06:30.198721 26326 ts_tablet_manager.cc:1403] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 13:06:30.200131 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.200826 26135 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:30.201133 26326 raft_consensus.cc:359] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.201763 26326 raft_consensus.cc:385] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.202014 26326 raft_consensus.cc:740] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.202270 26174 leader_election.cc:304] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.202649 26326 consensus_queue.cc:260] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.204288 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.204816 26326 ts_tablet_manager.cc:1434] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:30.205090 26284 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 0.
I20260709 13:06:30.209457 26353 raft_consensus.cc:515] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.210093 26324 tablet_bootstrap.cc:492] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.210529 26324 ts_tablet_manager.cc:1403] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 13:06:30.210734 26354 raft_consensus.cc:2804] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.211187 26354 raft_consensus.cc:493] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.211552 26354 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.212289 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.212886 26135 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.213232 26324 raft_consensus.cc:359] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.213884 26324 raft_consensus.cc:385] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.214156 26324 raft_consensus.cc:740] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.214944 26324 consensus_queue.cc:260] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.216918 26324 ts_tablet_manager.cc:1434] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:30.217815 26324 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: Bootstrap starting.
I20260709 13:06:30.218158 26135 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:30.219506 26356 raft_consensus.cc:493] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.220271 26353 leader_election.cc:290] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.220055 26356 raft_consensus.cc:515] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.220484 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.220986 26284 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.222285 26356 leader_election.cc:290] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.219434 26174 leader_election.cc:304] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.223495 26324 tablet_bootstrap.cc:654] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.223837 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.224449 26210 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:30.225643 26249 leader_election.cc:304] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.226476 26356 raft_consensus.cc:2804] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.226811 26356 raft_consensus.cc:493] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.227131 26356 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.227434 26284 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:30.231755 26334 raft_consensus.cc:493] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.232125 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.232231 26334 raft_consensus.cc:515] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.232790 26135 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:30.233397 26354 raft_consensus.cc:515] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.234305 26334 leader_election.cc:290] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.235350 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.236027 26134 raft_consensus.cc:2468] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 0.
I20260709 13:06:30.237053 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.237165 26248 leader_election.cc:304] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.237113 26133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.238158 26133 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.238310 26334 raft_consensus.cc:2804] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:30.238596 26249 leader_election.cc:343] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:30.238842 26334 raft_consensus.cc:493] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.239302 26334 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.241482 26356 raft_consensus.cc:515] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.244299 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.245332 26333 raft_consensus.cc:493] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.245764 26333 raft_consensus.cc:515] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.247771 26333 leader_election.cc:290] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.244856 26135 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.249305 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.249794 26334 raft_consensus.cc:515] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.250192 26210 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 0.
I20260709 13:06:30.251698 26100 leader_election.cc:304] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.249279 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.252784 26333 raft_consensus.cc:2804] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.253217 26333 raft_consensus.cc:493] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.253552 26333 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.253832 26133 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:30.255353 26174 leader_election.cc:304] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.256521 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.256606 26345 raft_consensus.cc:2804] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.257195 26134 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.257351 26345 raft_consensus.cc:697] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:30.258529 26345 consensus_queue.cc:237] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.259882 26329 raft_consensus.cc:2804] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.261091 26333 raft_consensus.cc:515] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.263816 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.264369 26210 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.264834 26334 leader_election.cc:290] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.265465 26134 raft_consensus.cc:2468] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.266893 26248 leader_election.cc:304] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.267866 26334 raft_consensus.cc:2804] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.268340 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.269079 26334 raft_consensus.cc:697] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.270114 26334 consensus_queue.cc:237] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
W20260709 13:06:30.271107 26249 leader_election.cc:343] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:30.272785 26379 raft_consensus.cc:493] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.274458 26210 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 1.
I20260709 13:06:30.274134 26379 raft_consensus.cc:515] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.275594 26100 leader_election.cc:304] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.279879 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.280761 26283 raft_consensus.cc:2393] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 795cce09462b4bb3832f6b7dc5fc80d9 in current term 1: Already voted for candidate b71b02f329c742caab3b93f43a471ac7 in this term.
I20260709 13:06:30.252671 26284 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 0.
I20260709 13:06:30.283604 26379 leader_election.cc:290] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.284400 26379 raft_consensus.cc:2804] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.284875 26379 raft_consensus.cc:697] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:30.285720 26379 consensus_queue.cc:237] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.286159 26354 leader_election.cc:290] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.288130 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.288682 26284 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.287647 26135 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.301311 26248 leader_election.cc:304] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.302186 26334 raft_consensus.cc:2804] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.302847 26334 raft_consensus.cc:697] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.303409 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.306704 26356 leader_election.cc:290] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 1 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.310693 26329 raft_consensus.cc:697] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:30.310976 26210 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.311758 26333 leader_election.cc:290] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.320077 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.311259 26334 consensus_queue.cc:237] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.321898 26379 raft_consensus.cc:493] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.322425 26379 raft_consensus.cc:515] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.327868 26329 consensus_queue.cc:237] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.327634 26030 catalog_manager.cc:5697] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 1 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.329887 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.335773 26324 tablet_bootstrap.cc:492] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: No bootstrap required, opened a new log
I20260709 13:06:30.336232 26324 ts_tablet_manager.cc:1403] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: Time spent bootstrapping tablet: real 0.119s	user 0.044s	sys 0.035s
I20260709 13:06:30.321314 26283 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.325732 26379 leader_election.cc:290] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.331118 26031 catalog_manager.cc:5697] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.343271 26282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.344156 26282 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 0.
I20260709 13:06:30.345849 26098 leader_election.cc:304] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.347095 26381 raft_consensus.cc:2804] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.347579 26381 raft_consensus.cc:493] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.348021 26381 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.350667 26324 raft_consensus.cc:359] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.351325 26324 raft_consensus.cc:385] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.351636 26324 raft_consensus.cc:740] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.352527 26377 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.352939 26377 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.353348 26283 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 1.
I20260709 13:06:30.354564 26210 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 1.
I20260709 13:06:30.356138 26135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.356321 26377 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.356891 26135 raft_consensus.cc:2393] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b02f329c742caab3b93f43a471ac7 in current term 1: Already voted for candidate 1116545907f34dbfb26da42f901358ba in this term.
I20260709 13:06:30.354429 26324 consensus_queue.cc:260] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.358469 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7" is_pre_election: true
I20260709 13:06:30.358913 26324 ts_tablet_manager.cc:1434] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:06:30.359042 26209 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 0.
I20260709 13:06:30.360375 26100 leader_election.cc:304] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:30.361574 26379 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.362443 26381 raft_consensus.cc:515] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.357023 26032 catalog_manager.cc:5697] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.365228 26381 leader_election.cc:290] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.365336 26032 catalog_manager.cc:5697] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.371323 26379 raft_consensus.cc:2749] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:30.371304 26284 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 1.
I20260709 13:06:30.377743 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.378645 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.379236 26210 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.379233 26173 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b02f329c742caab3b93f43a471ac7; no voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.383576 26377 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.385572 26210 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 1.
I20260709 13:06:30.390527 26377 raft_consensus.cc:2749] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:30.392278 26100 leader_election.cc:304] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.393204 26385 raft_consensus.cc:2804] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.393389 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.393976 26283 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.394392 26385 raft_consensus.cc:697] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:30.395287 26385 consensus_queue.cc:237] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.396142 26032 catalog_manager.cc:5697] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 1 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.401027 26283 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 1.
I20260709 13:06:30.407138 26030 catalog_manager.cc:5697] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.416795 26377 consensus_queue.cc:1048] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.427177 26345 consensus_queue.cc:1048] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.451025 26345 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.460367 26377 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.489019 26334 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.499805 26334 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.632014 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:53128
I20260709 13:06:30.632534 26210 raft_consensus.cc:606] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.639339 26334 consensus_queue.cc:1048] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.647522 26283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:30.648149 26283 raft_consensus.cc:606] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.663767 26209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:53128
I20260709 13:06:30.664377 26209 raft_consensus.cc:606] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.665680 26361 consensus_queue.cc:1048] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.672096 26283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:30.672724 26283 raft_consensus.cc:606] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.676441 26396 raft_consensus.cc:993] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:30.676909 26361 raft_consensus.cc:1081] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:30.678375 26135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52112
I20260709 13:06:30.678953 26135 raft_consensus.cc:493] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.679405 26135 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.685518 26135 raft_consensus.cc:515] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.685942 26283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267b624339b5438d86168a4dd2746274"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:30.686506 26283 raft_consensus.cc:606] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Received request to transfer leadership to TS b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:30.688144 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.688509 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5a71f89dbc4e949be5ab1a8b540940" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.688843 26210 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.689061 26283 raft_consensus.cc:3055] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.689432 26283 raft_consensus.cc:740] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.690289 26283 consensus_queue.cc:260] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.691061 26377 raft_consensus.cc:493] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.691325 26283 raft_consensus.cc:3060] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.691497 26377 raft_consensus.cc:515] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.693627 26377 leader_election.cc:290] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.695187 26133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" is_pre_election: true
I20260709 13:06:30.695569 26210 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:30.696026 26133 raft_consensus.cc:2393] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b02f329c742caab3b93f43a471ac7 in current term 1: Already voted for candidate 1116545907f34dbfb26da42f901358ba in this term.
I20260709 13:06:30.696645 26100 leader_election.cc:304] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.697597 26385 raft_consensus.cc:2804] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.697652 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1116545907f34dbfb26da42f901358ba" is_pre_election: true
I20260709 13:06:30.697840 26282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:30.698163 26385 raft_consensus.cc:697] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:30.698468 26282 raft_consensus.cc:606] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Received request to transfer leadership to TS b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:30.699205 26173 leader_election.cc:304] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b02f329c742caab3b93f43a471ac7; no voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:30.699031 26385 consensus_queue.cc:237] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.700269 26377 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.702507 26135 leader_election.cc:290] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.706135 26283 raft_consensus.cc:2468] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:30.710263 26032 catalog_manager.cc:5697] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.712802 26377 raft_consensus.cc:2749] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:30.718235 26396 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.719447 26377 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.723991 26377 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.730260 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:52128
I20260709 13:06:30.730908 26134 raft_consensus.cc:606] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Received request to transfer leadership to TS 1116545907f34dbfb26da42f901358ba
I20260709 13:06:30.731745 26361 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.740409 26385 consensus_queue.cc:1048] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.747495 26361 consensus_queue.cc:1048] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.753218 26385 consensus_queue.cc:1048] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.755298 26334 raft_consensus.cc:993] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: : Instructing follower b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:30.755784 26356 raft_consensus.cc:1081] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Signalling peer b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:30.758899 26208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267b624339b5438d86168a4dd2746274"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:53122
I20260709 13:06:30.759456 26208 raft_consensus.cc:493] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.759868 26208 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.762517 26356 raft_consensus.cc:993] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: : Instructing follower b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:30.763070 26356 raft_consensus.cc:1081] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Signalling peer b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:30.767383 26208 raft_consensus.cc:515] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.770555 26334 consensus_queue.cc:1048] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.771165 26208 leader_election.cc:290] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.775028 26133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.775348 26210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:53122
I20260709 13:06:30.775597 26133 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.775911 26210 raft_consensus.cc:493] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.776423 26210 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.778587 26282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.779148 26282 raft_consensus.cc:3055] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.779464 26282 raft_consensus.cc:740] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.780332 26282 consensus_queue.cc:260] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.781638 26282 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.782991 26133 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 2.
I20260709 13:06:30.784062 26174 leader_election.cc:304] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.784910 26377 raft_consensus.cc:2804] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.785367 26377 raft_consensus.cc:697] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:30.786192 26377 consensus_queue.cc:237] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.789494 26210 raft_consensus.cc:515] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.790742 26208 raft_consensus.cc:1240] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 1116545907f34dbfb26da42f901358ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.795768 26361 consensus_queue.cc:1059] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.796940 26356 raft_consensus.cc:3055] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.797430 26356 raft_consensus.cc:740] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.798295 26356 consensus_queue.cc:260] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.804308 26379 raft_consensus.cc:993] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:30.804926 26379 raft_consensus.cc:1081] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Signalling peer 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:30.807242 26284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:06:30.807799 26284 raft_consensus.cc:493] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.808182 26284 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.808264 26377 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.810093 26356 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.815188 26282 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 2.
I20260709 13:06:30.819034 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.819649 26134 raft_consensus.cc:3060] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.819967 26282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f42e9eb034841698b6489dcefb6e5a5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:30.819862 26032 catalog_manager.cc:5697] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 1 to 2, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.821288 26210 leader_election.cc:290] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:30.829350 26134 raft_consensus.cc:2468] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 2.
I20260709 13:06:30.830724 26174 leader_election.cc:304] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:30.831827 26354 raft_consensus.cc:2804] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.832340 26354 raft_consensus.cc:697] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:30.833117 26354 consensus_queue.cc:237] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.833557 26284 raft_consensus.cc:515] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.834522 26282 raft_consensus.cc:2468] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 2.
I20260709 13:06:30.836125 26353 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.836684 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:30.837297 26134 raft_consensus.cc:3055] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.837743 26134 raft_consensus.cc:740] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:30.840235 26283 raft_consensus.cc:1240] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Rejecting Update request from peer 795cce09462b4bb3832f6b7dc5fc80d9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.841840 26284 leader_election.cc:290] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 2 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:30.842599 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf602c7e8014523ad7747588ab4ca7b" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:30.843354 26210 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.840373 26134 consensus_queue.cc:260] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.847386 26134 raft_consensus.cc:3060] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.853346 26134 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 2.
I20260709 13:06:30.854382 26210 raft_consensus.cc:2468] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 2.
I20260709 13:06:30.854502 26248 leader_election.cc:304] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:30.855540 26356 raft_consensus.cc:2804] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.856037 26356 raft_consensus.cc:697] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:30.856823 26356 consensus_queue.cc:237] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:30.864390 26030 catalog_manager.cc:5697] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 1 to 2, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.873111 26031 catalog_manager.cc:5697] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 1 to 2, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 2 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.875118 26385 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.887763 26381 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:31.004010 26353 raft_consensus.cc:993] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.004442 26354 raft_consensus.cc:1081] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.005884 26133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:06:31.006376 26133 raft_consensus.cc:493] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.006682 26133 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.011085 26133 raft_consensus.cc:515] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.012835 26133 leader_election.cc:290] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:31.013520 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:31.013862 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1d02eff14043d1917e29ea6599ea22" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:31.014102 26210 raft_consensus.cc:3055] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.014366 26283 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.014482 26210 raft_consensus.cc:740] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:31.015192 26210 consensus_queue.cc:260] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.016105 26210 raft_consensus.cc:3060] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.018962 26283 raft_consensus.cc:2468] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.020102 26098 leader_election.cc:304] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:31.020876 26385 raft_consensus.cc:2804] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.020946 26210 raft_consensus.cc:2468] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.021327 26385 raft_consensus.cc:697] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:31.022178 26385 consensus_queue.cc:237] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.028544 26031 catalog_manager.cc:5697] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from b71b02f329c742caab3b93f43a471ac7 (127.24.232.194) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.049618 26354 raft_consensus.cc:993] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.050103 26329 raft_consensus.cc:1081] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.051581 26133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:06:31.052210 26133 raft_consensus.cc:493] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.052605 26133 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.057533 26133 raft_consensus.cc:515] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.058990 26133 leader_election.cc:290] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:31.059935 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:31.060093 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:31.060431 26210 raft_consensus.cc:3055] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.060611 26283 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.060763 26210 raft_consensus.cc:740] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:31.061455 26210 consensus_queue.cc:260] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.062311 26210 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.065716 26283 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.066915 26098 leader_election.cc:304] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:31.067235 26210 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.067849 26385 raft_consensus.cc:2804] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.068341 26385 raft_consensus.cc:697] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:31.069176 26385 consensus_queue.cc:237] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.070392 26334 raft_consensus.cc:993] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.070806 26356 raft_consensus.cc:1081] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:31.072422 26133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52112
I20260709 13:06:31.072889 26133 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.073200 26133 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.076407 26031 catalog_manager.cc:5697] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from b71b02f329c742caab3b93f43a471ac7 (127.24.232.194) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.079784 26133 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.081508 26133 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:31.082226 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:31.082674 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:31.082813 26210 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.083215 26283 raft_consensus.cc:3055] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.083554 26283 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:31.084353 26283 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.085552 26283 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.088361 26210 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.089375 26100 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:31.090123 26385 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.090536 26385 raft_consensus.cc:697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:31.090592 26283 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:31.091408 26385 consensus_queue.cc:237] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:31.097608 26031 catalog_manager.cc:5697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.103520 26283 raft_consensus.cc:1275] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.104945 26385 consensus_queue.cc:1048] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.112126 26210 raft_consensus.cc:1275] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.113538 26385 consensus_queue.cc:1048] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.200009 26283 raft_consensus.cc:1275] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.201253 26329 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.208554 26133 raft_consensus.cc:1275] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.210340 26329 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.216503 26134 raft_consensus.cc:1275] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.218107 26329 consensus_queue.cc:1048] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.225788 26283 raft_consensus.cc:1275] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.227258 26377 consensus_queue.cc:1048] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.268755 26210 raft_consensus.cc:1275] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.270087 26356 consensus_queue.cc:1048] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.277407 26134 raft_consensus.cc:1275] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.278798 26334 consensus_queue.cc:1048] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.503079 26284 raft_consensus.cc:1275] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.504184 26379 consensus_queue.cc:1048] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.512267 26210 raft_consensus.cc:1275] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.513981 26379 consensus_queue.cc:1048] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.579121 26210 raft_consensus.cc:1275] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.580322 26379 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.588505 26284 raft_consensus.cc:1275] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.589764 26333 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.618191 26210 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.619421 26333 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.627780 26284 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.629123 26379 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.762073 25507 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:06:33.763010 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:33.784703 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:33.785386 26134 raft_consensus.cc:606] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Received request to transfer leadership to TS 1116545907f34dbfb26da42f901358ba
I20260709 13:06:33.788339 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:33.788887 26134 raft_consensus.cc:606] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Received request to transfer leadership to TS 1116545907f34dbfb26da42f901358ba
I20260709 13:06:33.790038 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:33.790495 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:33.997893 26381 raft_consensus.cc:993] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:33.998411 26427 raft_consensus.cc:1081] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Signalling peer 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:34.000098 26283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:06:34.000617 26283 raft_consensus.cc:493] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.000913 26283 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.005885 26283 raft_consensus.cc:515] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.007620 26283 leader_election.cc:290] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 2 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:34.008656 26133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:34.008956 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:34.009351 26133 raft_consensus.cc:3055] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.009516 26210 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.009719 26133 raft_consensus.cc:740] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:34.010540 26133 consensus_queue.cc:260] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.011539 26133 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.014556 26210 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 2.
I20260709 13:06:34.015986 26249 leader_election.cc:304] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:34.016881 26423 raft_consensus.cc:2804] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.017944 26133 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 2.
I20260709 13:06:34.019604 26423 raft_consensus.cc:697] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:34.020539 26423 consensus_queue.cc:237] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.029027 26030 catalog_manager.cc:5697] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 1 to 2, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 2 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.335021 26381 raft_consensus.cc:993] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:34.335503 26427 raft_consensus.cc:1081] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Signalling peer 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:34.336961 26283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:06:34.337430 26283 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.337725 26283 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.341777 26283 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.343261 26283 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:34.344009 26133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:34.344262 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:34.344579 26133 raft_consensus.cc:3055] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.344828 26210 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.344941 26133 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:34.345793 26133 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.346807 26133 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.349123 26210 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:34.350093 26249 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:34.350914 26423 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.351400 26423 raft_consensus.cc:697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:34.351615 26133 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:34.352250 26423 consensus_queue.cc:237] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.361457 26030 catalog_manager.cc:5697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 2 to 3, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 3 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.412616 26133 raft_consensus.cc:1275] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.414004 26423 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.424275 26210 raft_consensus.cc:1275] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.426673 26428 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.791332 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.804716 26284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:34.805253 26284 raft_consensus.cc:606] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:34.817449 26284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:06:34.817966 26284 raft_consensus.cc:606] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:34.822777 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:53128
I20260709 13:06:34.823220 26210 raft_consensus.cc:606] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:34.827653 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267b624339b5438d86168a4dd2746274"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:53128
I20260709 13:06:34.828110 26210 raft_consensus.cc:606] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:34.832540 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
mode: GRACEFUL
new_leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:53128
I20260709 13:06:34.832993 26210 raft_consensus.cc:606] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Received request to transfer leadership to TS 795cce09462b4bb3832f6b7dc5fc80d9
I20260709 13:06:34.834419 26428 raft_consensus.cc:993] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.834936 26423 raft_consensus.cc:1081] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.836530 26133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52112
I20260709 13:06:34.837117 26133 raft_consensus.cc:493] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.837568 26133 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.842628 26133 raft_consensus.cc:515] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.844342 26133 leader_election.cc:290] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 3 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:34.845039 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:34.845324 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684742d4d03d4626bb35c065bd212ee0" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:34.845607 26210 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.845928 26284 raft_consensus.cc:3055] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.846221 26284 raft_consensus.cc:740] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:34.846841 26284 consensus_queue.cc:260] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.847798 26284 raft_consensus.cc:3060] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.850572 26210 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 3.
I20260709 13:06:34.851853 26100 leader_election.cc:304] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:34.852653 26427 raft_consensus.cc:2804] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.853569 26427 raft_consensus.cc:697] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:34.853615 26284 raft_consensus.cc:2468] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 3.
I20260709 13:06:34.854547 26427 consensus_queue.cc:237] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.860420 26031 catalog_manager.cc:5697] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 2 to 3, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.882314 26133 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:34.883601 26423 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.889688 26428 raft_consensus.cc:993] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.890163 26438 raft_consensus.cc:1081] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.892071 26134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52112
I20260709 13:06:34.893220 26134 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.893625 26134 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.894886 26210 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:34.896387 26438 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:34.901357 26134 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.906767 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:34.907377 26134 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 4 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:34.907401 26209 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.908595 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:34.909160 26284 raft_consensus.cc:3055] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:34.909507 26284 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:34.910291 26284 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.911487 26284 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.915335 26209 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 4.
I20260709 13:06:34.916576 26100 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 795cce09462b4bb3832f6b7dc5fc80d9, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:34.917402 26427 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.917948 26427 raft_consensus.cc:697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:34.918188 26284 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 4.
I20260709 13:06:34.918740 26427 consensus_queue.cc:237] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:34.925119 26031 catalog_manager.cc:5697] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 3 to 4, leader changed from 1116545907f34dbfb26da42f901358ba (127.24.232.195) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 4 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.993547 26377 raft_consensus.cc:993] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.994009 26445 raft_consensus.cc:1081] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:34.995951 26134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:06:34.996480 26134 raft_consensus.cc:493] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.996798 26134 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.001742 26134 raft_consensus.cc:515] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.003362 26134 leader_election.cc:290] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:35.004310 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:35.004468 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:35.004828 26210 raft_consensus.cc:3055] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.004995 26284 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.005120 26210 raft_consensus.cc:740] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:35.005851 26210 consensus_queue.cc:260] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.006688 26210 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.009948 26284 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:35.010722 26210 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:35.011065 26098 leader_election.cc:304] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:35.011919 26427 raft_consensus.cc:2804] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.012358 26427 raft_consensus.cc:697] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:35.013083 26427 consensus_queue.cc:237] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.019934 26031 catalog_manager.cc:5697] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from b71b02f329c742caab3b93f43a471ac7 (127.24.232.194) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.123152 26445 raft_consensus.cc:993] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:35.123631 26444 raft_consensus.cc:1081] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:35.125213 26134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267b624339b5438d86168a4dd2746274"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:06:35.125703 26134 raft_consensus.cc:493] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.126019 26134 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.130561 26134 raft_consensus.cc:515] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.132253 26134 leader_election.cc:290] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 3 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:35.133121 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:35.133240 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267b624339b5438d86168a4dd2746274" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:35.133704 26210 raft_consensus.cc:3055] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.133710 26284 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.134207 26210 raft_consensus.cc:740] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:35.134950 26210 consensus_queue.cc:260] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.136072 26210 raft_consensus.cc:3060] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.140587 26284 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 3.
I20260709 13:06:35.141752 26098 leader_election.cc:304] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:35.141990 26210 raft_consensus.cc:2468] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 3.
I20260709 13:06:35.142462 26427 raft_consensus.cc:2804] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.142906 26427 raft_consensus.cc:697] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:35.143738 26427 consensus_queue.cc:237] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.149240 26445 raft_consensus.cc:993] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: : Instructing follower 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:35.149706 26444 raft_consensus.cc:1081] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Signalling peer 795cce09462b4bb3832f6b7dc5fc80d9 to start an election
I20260709 13:06:35.151304 26134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:06:35.151865 26134 raft_consensus.cc:493] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.152205 26134 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.151635 26031 catalog_manager.cc:5697] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 2 to 3, leader changed from b71b02f329c742caab3b93f43a471ac7 (127.24.232.194) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.157387 26134 raft_consensus.cc:515] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.159199 26134 leader_election.cc:290] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Requested vote from peers b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:35.160041 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:35.160287 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:35.160597 26210 raft_consensus.cc:3055] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.160816 26284 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.160934 26210 raft_consensus.cc:740] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:35.161556 26210 consensus_queue.cc:260] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.162338 26210 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.165792 26284 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:35.166699 26210 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795cce09462b4bb3832f6b7dc5fc80d9 in term 2.
I20260709 13:06:35.166893 26098 leader_election.cc:304] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, 795cce09462b4bb3832f6b7dc5fc80d9; no voters: 
I20260709 13:06:35.167770 26427 raft_consensus.cc:2804] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.168182 26427 raft_consensus.cc:697] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:35.168860 26427 consensus_queue.cc:237] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:35.176218 26031 catalog_manager.cc:5697] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 reported cstate change: term changed from 1 to 2, leader changed from b71b02f329c742caab3b93f43a471ac7 (127.24.232.194) to 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.256628 26210 raft_consensus.cc:1275] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.257911 26427 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.267527 26284 raft_consensus.cc:1275] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.269441 26449 consensus_queue.cc:1048] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.435001 26210 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 4 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:35.436214 26449 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.443174 26284 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 4 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:35.444814 26441 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.509085 26284 raft_consensus.cc:1275] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.510249 26449 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.518771 26210 raft_consensus.cc:1275] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.520229 26449 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.734889 26284 raft_consensus.cc:1275] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.735803 26283 raft_consensus.cc:1275] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.736172 26449 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.737035 26427 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.744902 26209 raft_consensus.cc:1275] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.746845 26441 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.751885 26209 raft_consensus.cc:1275] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Refusing update from remote peer 795cce09462b4bb3832f6b7dc5fc80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.753538 26449 consensus_queue.cc:1048] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:37.841145 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.850198 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:37.850905 26134 raft_consensus.cc:606] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Received request to transfer leadership to TS b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:37.853418 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:37.853879 26134 raft_consensus.cc:606] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Received request to transfer leadership to TS 1116545907f34dbfb26da42f901358ba
I20260709 13:06:37.856012 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:37.856462 26134 raft_consensus.cc:606] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Received request to transfer leadership to TS 1116545907f34dbfb26da42f901358ba
I20260709 13:06:37.858526 26134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
mode: GRACEFUL
new_leader_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:52134
I20260709 13:06:37.858964 26134 raft_consensus.cc:606] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 LEADER]: Received request to transfer leadership to TS b71b02f329c742caab3b93f43a471ac7
I20260709 13:06:37.859925 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:37.860374 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:37.884992 26457 raft_consensus.cc:993] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:37.885527 26458 raft_consensus.cc:1081] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Signalling peer 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:37.887072 26284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:06:37.887563 26284 raft_consensus.cc:493] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.887970 26284 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.892902 26284 raft_consensus.cc:515] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:37.894593 26284 leader_election.cc:290] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:37.895886 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:37.895665 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2071fb521fb4c4c9206f36d134f6524" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:37.896509 26209 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.896584 26134 raft_consensus.cc:3055] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.896960 26134 raft_consensus.cc:740] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:37.897790 26134 consensus_queue.cc:260] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:37.898797 26134 raft_consensus.cc:3060] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.901742 26209 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:37.903044 26249 leader_election.cc:304] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:37.903985 26438 raft_consensus.cc:2804] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:37.904479 26134 raft_consensus.cc:2468] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:37.905032 26438 raft_consensus.cc:697] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:37.906064 26438 consensus_queue.cc:237] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:37.912623 26030 catalog_manager.cc:5697] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 2 to 3, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 3 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.029775 26457 raft_consensus.cc:993] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:38.030221 26458 raft_consensus.cc:1081] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Signalling peer b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:38.031620 26209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:53120
I20260709 13:06:38.032100 26209 raft_consensus.cc:493] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.032400 26209 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.036963 26209 raft_consensus.cc:515] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.038676 26209 leader_election.cc:290] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:38.039515 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:38.039799 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212d0111cb04d22aba4a6817eb4dd3e" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:38.040081 26134 raft_consensus.cc:3055] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.040300 26284 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.040414 26134 raft_consensus.cc:740] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:38.041188 26134 consensus_queue.cc:260] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.042096 26134 raft_consensus.cc:3060] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.044523 26284 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 3.
I20260709 13:06:38.045688 26173 leader_election.cc:304] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:38.046571 26444 raft_consensus.cc:2804] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.047024 26134 raft_consensus.cc:2468] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 3.
I20260709 13:06:38.047889 26444 raft_consensus.cc:697] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:38.048720 26444 consensus_queue.cc:237] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.055510 26030 catalog_manager.cc:5697] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 2 to 3, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.274439 26457 raft_consensus.cc:993] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:38.274839 26458 raft_consensus.cc:1081] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Signalling peer 1116545907f34dbfb26da42f901358ba to start an election
I20260709 13:06:38.276331 26284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5"
dest_uuid: "1116545907f34dbfb26da42f901358ba"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:06:38.276777 26284 raft_consensus.cc:493] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.277061 26284 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.280913 26284 raft_consensus.cc:515] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.282495 26284 leader_election.cc:290] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), b71b02f329c742caab3b93f43a471ac7 (127.24.232.194:40993)
I20260709 13:06:38.283588 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
I20260709 13:06:38.283275 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda78663cfdd44688f9e6d1fea88a4a5" candidate_uuid: "1116545907f34dbfb26da42f901358ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:38.284407 26209 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.284425 26134 raft_consensus.cc:3055] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.284991 26134 raft_consensus.cc:740] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:38.285737 26134 consensus_queue.cc:260] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.286892 26134 raft_consensus.cc:3060] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.291213 26209 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:38.292315 26249 leader_election.cc:304] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:38.293066 26438 raft_consensus.cc:2804] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.293275 26133 raft_consensus.cc:1275] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.293560 26438 raft_consensus.cc:697] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Becoming Leader. State: Replica: 1116545907f34dbfb26da42f901358ba, State: Running, Role: LEADER
I20260709 13:06:38.293226 26134 raft_consensus.cc:2468] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1116545907f34dbfb26da42f901358ba in term 3.
I20260709 13:06:38.294631 26438 consensus_queue.cc:237] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.295126 26459 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.303901 26030 catalog_manager.cc:5697] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba reported cstate change: term changed from 2 to 3, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to 1116545907f34dbfb26da42f901358ba (127.24.232.195). New cstate: current_term: 3 leader_uuid: "1116545907f34dbfb26da42f901358ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.323910 26209 raft_consensus.cc:1275] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.325471 26459 consensus_queue.cc:1048] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.423025 26457 raft_consensus.cc:993] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: : Instructing follower b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:38.423472 26458 raft_consensus.cc:1081] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 LEADER]: Signalling peer b71b02f329c742caab3b93f43a471ac7 to start an election
I20260709 13:06:38.425067 26209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5"
dest_uuid: "b71b02f329c742caab3b93f43a471ac7"
 from {username='slave'} at 127.0.0.1:53120
I20260709 13:06:38.425599 26209 raft_consensus.cc:493] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.425923 26209 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.430733 26209 raft_consensus.cc:515] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.432446 26209 leader_election.cc:290] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569), 1116545907f34dbfb26da42f901358ba (127.24.232.195:32909)
I20260709 13:06:38.433193 26134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "795cce09462b4bb3832f6b7dc5fc80d9"
I20260709 13:06:38.433570 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac2742c36e243eb8c16e90f7e0ca9d5" candidate_uuid: "b71b02f329c742caab3b93f43a471ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1116545907f34dbfb26da42f901358ba"
I20260709 13:06:38.433735 26134 raft_consensus.cc:3055] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:38.434067 26284 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.434090 26134 raft_consensus.cc:740] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 795cce09462b4bb3832f6b7dc5fc80d9, State: Running, Role: LEADER
I20260709 13:06:38.434988 26134 consensus_queue.cc:260] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.435835 26134 raft_consensus.cc:3060] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.438330 26284 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 5.
I20260709 13:06:38.439249 26173 leader_election.cc:304] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1116545907f34dbfb26da42f901358ba, b71b02f329c742caab3b93f43a471ac7; no voters: 
I20260709 13:06:38.440055 26444 raft_consensus.cc:2804] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:38.440289 26134 raft_consensus.cc:2468] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b02f329c742caab3b93f43a471ac7 in term 5.
I20260709 13:06:38.440629 26444 raft_consensus.cc:697] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b71b02f329c742caab3b93f43a471ac7, State: Running, Role: LEADER
I20260709 13:06:38.441538 26444 consensus_queue.cc:237] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } }
I20260709 13:06:38.444072 26284 raft_consensus.cc:1275] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.445382 26465 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.449347 26031 catalog_manager.cc:5697] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 reported cstate change: term changed from 4 to 5, leader changed from 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193) to b71b02f329c742caab3b93f43a471ac7 (127.24.232.194). New cstate: current_term: 5 leader_uuid: "b71b02f329c742caab3b93f43a471ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.458814 26134 raft_consensus.cc:1275] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.460028 26444 consensus_queue.cc:1048] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.679172 26134 raft_consensus.cc:1275] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.680512 26459 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "795cce09462b4bb3832f6b7dc5fc80d9" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.690416 26209 raft_consensus.cc:1275] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Refusing update from remote peer 1116545907f34dbfb26da42f901358ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.691998 26438 consensus_queue.cc:1048] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b02f329c742caab3b93f43a471ac7" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.861238 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.867498 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:06:38.896929 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:38.897653 25507 tablet_replica.cc:333] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.898294 25507 raft_consensus.cc:2243] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.898852 25507 raft_consensus.cc:2272] T 1f42e9eb034841698b6489dcefb6e5a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.900856 25507 tablet_replica.cc:333] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.901633 25507 raft_consensus.cc:2243] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.902077 25507 raft_consensus.cc:2272] T b2071fb521fb4c4c9206f36d134f6524 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.904671 25507 tablet_replica.cc:333] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.905165 25507 raft_consensus.cc:2243] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.905593 25507 raft_consensus.cc:2272] T edf602c7e8014523ad7747588ab4ca7b P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.907280 25507 tablet_replica.cc:333] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.907853 25507 raft_consensus.cc:2243] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:38.908565 25507 raft_consensus.cc:2272] T 684742d4d03d4626bb35c065bd212ee0 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.910220 25507 tablet_replica.cc:333] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.910701 25507 raft_consensus.cc:2243] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:38.911406 25507 raft_consensus.cc:2272] T 2b1d02eff14043d1917e29ea6599ea22 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.913069 25507 tablet_replica.cc:333] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.913527 25507 raft_consensus.cc:2243] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.913909 25507 raft_consensus.cc:2272] T cda78663cfdd44688f9e6d1fea88a4a5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.915972 25507 tablet_replica.cc:333] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.916486 25507 raft_consensus.cc:2243] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:38.917228 25507 raft_consensus.cc:2272] T 7e5a71f89dbc4e949be5ab1a8b540940 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.919044 25507 tablet_replica.cc:333] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.919513 25507 raft_consensus.cc:2243] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.919901 25507 raft_consensus.cc:2272] T dac2742c36e243eb8c16e90f7e0ca9d5 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.921491 25507 tablet_replica.cc:333] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.922043 25507 raft_consensus.cc:2243] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:38.922771 25507 raft_consensus.cc:2272] T 267b624339b5438d86168a4dd2746274 P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:38.924633 26248 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:06:38.925132 25507 tablet_replica.cc:333] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9: stopping tablet replica
I20260709 13:06:38.925827 25507 raft_consensus.cc:2243] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:38.926323 25507 raft_consensus.cc:2272] T 1212d0111cb04d22aba4a6817eb4dd3e P 795cce09462b4bb3832f6b7dc5fc80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:38.927649 26248 consensus_peers.cc:597] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba -> Peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Couldn't send request to peer 795cce09462b4bb3832f6b7dc5fc80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.936020 26284 raft_consensus.cc:1275] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 5 FOLLOWER]: Refusing update from remote peer b71b02f329c742caab3b93f43a471ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:38.937803 26465 consensus_queue.cc:1048] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1116545907f34dbfb26da42f901358ba" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 32909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:38.947986 26174 consensus_peers.cc:597] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 -> Peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Couldn't send request to peer 795cce09462b4bb3832f6b7dc5fc80d9. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:43569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:38.948462 26174 consensus_peers.cc:597] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 -> Peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Couldn't send request to peer 795cce09462b4bb3832f6b7dc5fc80d9. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:43569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.951305 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
I20260709 13:06:38.976328 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
I20260709 13:06:38.998664 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:38.999449 25507 tablet_replica.cc:333] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.000140 25507 raft_consensus.cc:2243] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.000633 25507 raft_consensus.cc:2272] T 267b624339b5438d86168a4dd2746274 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.002403 25507 tablet_replica.cc:333] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.002929 25507 raft_consensus.cc:2243] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.003746 25507 raft_consensus.cc:2272] T 1f42e9eb034841698b6489dcefb6e5a5 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.005462 25507 tablet_replica.cc:333] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.005976 25507 raft_consensus.cc:2243] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.006393 25507 raft_consensus.cc:2272] T b2071fb521fb4c4c9206f36d134f6524 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.008517 25507 tablet_replica.cc:333] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.009027 25507 raft_consensus.cc:2243] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.009778 25507 raft_consensus.cc:2272] T dac2742c36e243eb8c16e90f7e0ca9d5 P b71b02f329c742caab3b93f43a471ac7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.011636 25507 tablet_replica.cc:333] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.012228 25507 raft_consensus.cc:2243] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.012686 25507 raft_consensus.cc:2272] T cda78663cfdd44688f9e6d1fea88a4a5 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.014559 25507 tablet_replica.cc:333] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.015055 25507 raft_consensus.cc:2243] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.015475 25507 raft_consensus.cc:2272] T 2b1d02eff14043d1917e29ea6599ea22 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.017099 25507 tablet_replica.cc:333] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.017571 25507 raft_consensus.cc:2243] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.017970 25507 raft_consensus.cc:2272] T 7e5a71f89dbc4e949be5ab1a8b540940 P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.019495 25507 tablet_replica.cc:333] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.019966 25507 raft_consensus.cc:2243] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.020637 25507 raft_consensus.cc:2272] T 1212d0111cb04d22aba4a6817eb4dd3e P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.022642 25507 tablet_replica.cc:333] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.023136 25507 raft_consensus.cc:2243] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.023540 25507 raft_consensus.cc:2272] T edf602c7e8014523ad7747588ab4ca7b P b71b02f329c742caab3b93f43a471ac7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.025115 25507 tablet_replica.cc:333] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7: stopping tablet replica
I20260709 13:06:39.025549 25507 raft_consensus.cc:2243] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.025943 25507 raft_consensus.cc:2272] T 684742d4d03d4626bb35c065bd212ee0 P b71b02f329c742caab3b93f43a471ac7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.053128 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
I20260709 13:06:39.071110 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
I20260709 13:06:39.102182 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:39.103019 25507 tablet_replica.cc:333] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.103749 25507 raft_consensus.cc:2243] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:39.104208 26248 consensus_peers.cc:597] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba -> Peer 795cce09462b4bb3832f6b7dc5fc80d9 (127.24.232.193:43569): Couldn't send request to peer 795cce09462b4bb3832f6b7dc5fc80d9. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:43569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:39.104373 25507 raft_consensus.cc:2272] T 1f42e9eb034841698b6489dcefb6e5a5 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.106259 25507 tablet_replica.cc:333] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.106743 25507 raft_consensus.cc:2243] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.107374 25507 raft_consensus.cc:2272] T b2071fb521fb4c4c9206f36d134f6524 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.109458 25507 tablet_replica.cc:333] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.109920 25507 raft_consensus.cc:2243] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.110630 25507 raft_consensus.cc:2272] T edf602c7e8014523ad7747588ab4ca7b P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.112311 25507 tablet_replica.cc:333] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.112773 25507 raft_consensus.cc:2243] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.113173 25507 raft_consensus.cc:2272] T 684742d4d03d4626bb35c065bd212ee0 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.114815 25507 tablet_replica.cc:333] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.115288 25507 raft_consensus.cc:2243] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.116051 25507 raft_consensus.cc:2272] T cda78663cfdd44688f9e6d1fea88a4a5 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.117904 25507 tablet_replica.cc:333] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.118400 25507 raft_consensus.cc:2243] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.118757 25507 raft_consensus.cc:2272] T 2b1d02eff14043d1917e29ea6599ea22 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.120468 25507 tablet_replica.cc:333] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.120916 25507 raft_consensus.cc:2243] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.121308 25507 raft_consensus.cc:2272] T 7e5a71f89dbc4e949be5ab1a8b540940 P 1116545907f34dbfb26da42f901358ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.122931 25507 tablet_replica.cc:333] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.123389 25507 raft_consensus.cc:2243] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.123827 25507 raft_consensus.cc:2272] T 1212d0111cb04d22aba4a6817eb4dd3e P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.125929 25507 tablet_replica.cc:333] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.126401 25507 raft_consensus.cc:2243] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.126809 25507 raft_consensus.cc:2272] T 267b624339b5438d86168a4dd2746274 P 1116545907f34dbfb26da42f901358ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.128436 25507 tablet_replica.cc:333] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba: stopping tablet replica
I20260709 13:06:39.128844 25507 raft_consensus.cc:2243] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:39.129222 25507 raft_consensus.cc:2272] T dac2742c36e243eb8c16e90f7e0ca9d5 P 1116545907f34dbfb26da42f901358ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.157027 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:06:39.175014 25507 master.cc:562] Master@127.24.232.254:43511 shutting down...
I20260709 13:06:39.193876 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:39.194446 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:39.194780 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7dd318ff2f8b4536ac402e64f7d00367: stopping tablet replica
I20260709 13:06:39.214810 25507 master.cc:584] Master@127.24.232.254:43511 shutdown complete.
1116545907f34dbfb26da42f901358ba  1
795cce09462b4bb3832f6b7dc5fc80d9  5
b71b02f329c742caab3b93f43a471ac7  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10411 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:39.255621 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:38345
I20260709 13:06:39.256794 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:39.262660 26486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.262919 26485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.263164 26488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.263895 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:39.264705 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:39.264915 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:39.265084 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602399265066 us; error 0 us; skew 500 ppm
I20260709 13:06:39.265604 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:39.267990 25507 webserver.cc:533] Webserver started at http://127.24.232.254:36635/ using document root <none> and password file <none>
I20260709 13:06:39.268468 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.268671 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.268975 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.270097 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "d386a230fc3e442b8633387e891e63d1"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.275038 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:06:39.278383 26493 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.279105 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:39.279384 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "d386a230fc3e442b8633387e891e63d1"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.279704 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.289497 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.290736 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.328728 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:38345
I20260709 13:06:39.328838 26544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:38345 every 8 connection(s)
I20260709 13:06:39.332787 26545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.342332 26545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Bootstrap starting.
I20260709 13:06:39.346843 26545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.350898 26545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: No bootstrap required, opened a new log
I20260709 13:06:39.353036 26545 raft_consensus.cc:359] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER }
I20260709 13:06:39.353430 26545 raft_consensus.cc:385] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.353673 26545 raft_consensus.cc:740] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d386a230fc3e442b8633387e891e63d1, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.354228 26545 consensus_queue.cc:260] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER }
I20260709 13:06:39.354676 26545 raft_consensus.cc:399] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:39.354893 26545 raft_consensus.cc:493] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:39.355172 26545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.359326 26545 raft_consensus.cc:515] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER }
I20260709 13:06:39.359874 26545 leader_election.cc:304] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d386a230fc3e442b8633387e891e63d1; no voters: 
I20260709 13:06:39.360976 26545 leader_election.cc:290] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:39.361299 26548 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.362589 26548 raft_consensus.cc:697] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 1 LEADER]: Becoming Leader. State: Replica: d386a230fc3e442b8633387e891e63d1, State: Running, Role: LEADER
I20260709 13:06:39.363250 26548 consensus_queue.cc:237] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER }
I20260709 13:06:39.363895 26545 sys_catalog.cc:565] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:39.368314 26550 sys_catalog.cc:455] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d386a230fc3e442b8633387e891e63d1. Latest consensus state: current_term: 1 leader_uuid: "d386a230fc3e442b8633387e891e63d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER } }
I20260709 13:06:39.369045 26550 sys_catalog.cc:458] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:39.370625 26549 sys_catalog.cc:455] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d386a230fc3e442b8633387e891e63d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d386a230fc3e442b8633387e891e63d1" member_type: VOTER } }
I20260709 13:06:39.371068 26555 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:39.371080 26549 sys_catalog.cc:458] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:39.377130 26555 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:39.382102 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:39.386020 26555 catalog_manager.cc:1383] Generated new cluster ID: 63a72fdf9b924682b3fe3b904915ef9b
I20260709 13:06:39.386328 26555 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:39.412139 26555 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:39.413451 26555 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:39.424081 26555 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Generated new TSK 0
I20260709 13:06:39.424723 26555 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:39.449668 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:39.455706 26566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.457149 26567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.458693 26569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.458873 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:39.460254 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:39.460434 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:39.460554 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602399460543 us; error 0 us; skew 500 ppm
I20260709 13:06:39.461006 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:39.463186 25507 webserver.cc:533] Webserver started at http://127.24.232.193:43729/ using document root <none> and password file <none>
I20260709 13:06:39.463620 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.463879 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.464102 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.465124 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "687d192f79a044ce838f0bf292f0c09f"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.469638 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:39.472805 26574 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.473547 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:06:39.473800 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "687d192f79a044ce838f0bf292f0c09f"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.474045 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.517954 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.519377 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.520985 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:39.523401 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:39.523633 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.523964 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:39.524129 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.565194 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:41483
I20260709 13:06:39.565296 26636 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:41483 every 8 connection(s)
I20260709 13:06:39.570219 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:39.576601 26641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.577469 26642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.581115 26644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.581246 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:39.582576 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:39.582800 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:39.582983 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602399582967 us; error 0 us; skew 500 ppm
I20260709 13:06:39.584146 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:39.586874 26637 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38345
I20260709 13:06:39.587275 26637 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:39.587477 25507 webserver.cc:533] Webserver started at http://127.24.232.194:40725/ using document root <none> and password file <none>
I20260709 13:06:39.588071 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.588171 26637 heartbeater.cc:507] Master 127.24.232.254:38345 requested a full tablet report, sending...
I20260709 13:06:39.588297 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.588642 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.590093 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "b9e8388401a74e84a2cc880930412709"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.590386 26510 ts_manager.cc:194] Registered new tserver with Master: 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:39.592875 26510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52272
I20260709 13:06:39.596189 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:06:39.599570 26649 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.600651 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:06:39.600950 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "b9e8388401a74e84a2cc880930412709"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.601224 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.616294 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.617506 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.618906 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:39.621145 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:39.621356 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.621631 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:39.621804 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.660916 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:36529
I20260709 13:06:39.661018 26711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:36529 every 8 connection(s)
I20260709 13:06:39.665731 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:39.672817 26715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.673954 26716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.679095 26712 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38345
I20260709 13:06:39.679757 26712 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:39.680091 26718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.680194 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:39.680874 26712 heartbeater.cc:507] Master 127.24.232.254:38345 requested a full tablet report, sending...
I20260709 13:06:39.681401 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:39.681613 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:39.681775 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602399681758 us; error 0 us; skew 500 ppm
I20260709 13:06:39.682463 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:39.683280 26510 ts_manager.cc:194] Registered new tserver with Master: b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:39.685087 26510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52284
I20260709 13:06:39.685685 25507 webserver.cc:533] Webserver started at http://127.24.232.195:39223/ using document root <none> and password file <none>
I20260709 13:06:39.686334 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.686614 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.686913 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.688303 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "e09ea9b455894a0189912a7b9b6b2f84"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.692730 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:06:39.696157 26723 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.696975 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:06:39.697285 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "e09ea9b455894a0189912a7b9b6b2f84"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-sdg5"
I20260709 13:06:39.697579 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.711524 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.712805 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.714280 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:39.716581 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:39.716820 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.717080 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:39.717258 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.756580 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:42613
I20260709 13:06:39.756709 26785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:42613 every 8 connection(s)
I20260709 13:06:39.770824 26786 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38345
I20260709 13:06:39.771225 26786 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:39.772111 26786 heartbeater.cc:507] Master 127.24.232.254:38345 requested a full tablet report, sending...
I20260709 13:06:39.774142 26510 ts_manager.cc:194] Registered new tserver with Master: e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:39.774381 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014487783s
I20260709 13:06:39.775705 26510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52286
I20260709 13:06:39.800590 26510 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52294:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:39.806958 26510 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:40.018354 26677 tablet_service.cc:1511] Processing CreateTablet for tablet e14c2c21312147dcbce6c84aad03a97f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:40.020046 26677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14c2c21312147dcbce6c84aad03a97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.022996 26602 tablet_service.cc:1511] Processing CreateTablet for tablet e14c2c21312147dcbce6c84aad03a97f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:40.024591 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14c2c21312147dcbce6c84aad03a97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.024518 26599 tablet_service.cc:1511] Processing CreateTablet for tablet 2457711189fa40e5bb77aa8997eca24b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:40.024948 26676 tablet_service.cc:1511] Processing CreateTablet for tablet 823c00a7d4b44bbea4d06e2ad87901ca (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:40.025995 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2457711189fa40e5bb77aa8997eca24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.026417 26676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823c00a7d4b44bbea4d06e2ad87901ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.026718 26598 tablet_service.cc:1511] Processing CreateTablet for tablet 6d46fffe7ef44d4c95a01a5e1b261924 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:40.028045 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d46fffe7ef44d4c95a01a5e1b261924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.028892 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 512480111cea40cebe7a32ae9439af70 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:40.028944 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 512480111cea40cebe7a32ae9439af70 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:40.030319 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512480111cea40cebe7a32ae9439af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.032423 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 2457711189fa40e5bb77aa8997eca24b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:40.032835 26601 tablet_service.cc:1511] Processing CreateTablet for tablet 823c00a7d4b44bbea4d06e2ad87901ca (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:40.032750 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 589b7d1d64684da8b771d0b30a73579f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:40.034454 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823c00a7d4b44bbea4d06e2ad87901ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.034825 26673 tablet_service.cc:1511] Processing CreateTablet for tablet 6d46fffe7ef44d4c95a01a5e1b261924 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:40.037751 26672 tablet_service.cc:1511] Processing CreateTablet for tablet 589b7d1d64684da8b771d0b30a73579f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:40.038398 26596 tablet_service.cc:1511] Processing CreateTablet for tablet d7a03ebddf0c40ebb4879344f54f5d24 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:40.040203 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a03ebddf0c40ebb4879344f54f5d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.040602 26671 tablet_service.cc:1511] Processing CreateTablet for tablet d7a03ebddf0c40ebb4879344f54f5d24 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:40.042758 26671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a03ebddf0c40ebb4879344f54f5d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.044094 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589b7d1d64684da8b771d0b30a73579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.044423 26673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d46fffe7ef44d4c95a01a5e1b261924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.046868 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589b7d1d64684da8b771d0b30a73579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.047775 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 719d8f6d8dda4888b6d16c7132ddde9f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:40.048422 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512480111cea40cebe7a32ae9439af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.049225 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719d8f6d8dda4888b6d16c7132ddde9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.049986 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2457711189fa40e5bb77aa8997eca24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.053640 26594 tablet_service.cc:1511] Processing CreateTablet for tablet c4f65a3c62194ad385b5c3a9d0b22e2b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:40.055068 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f65a3c62194ad385b5c3a9d0b22e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.057312 26670 tablet_service.cc:1511] Processing CreateTablet for tablet 719d8f6d8dda4888b6d16c7132ddde9f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:40.058970 26670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719d8f6d8dda4888b6d16c7132ddde9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.059526 26593 tablet_service.cc:1511] Processing CreateTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:40.060936 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04d1d6cb7c54df78a1746de67ce6198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.077701 26668 tablet_service.cc:1511] Processing CreateTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:40.079293 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04d1d6cb7c54df78a1746de67ce6198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.077700 26669 tablet_service.cc:1511] Processing CreateTablet for tablet c4f65a3c62194ad385b5c3a9d0b22e2b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:40.085258 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f65a3c62194ad385b5c3a9d0b22e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.090253 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 512480111cea40cebe7a32ae9439af70 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:40.091820 26744 tablet_service.cc:1511] Processing CreateTablet for tablet 719d8f6d8dda4888b6d16c7132ddde9f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:40.092859 26747 tablet_service.cc:1511] Processing CreateTablet for tablet 6d46fffe7ef44d4c95a01a5e1b261924 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:40.092981 26748 tablet_service.cc:1511] Processing CreateTablet for tablet 2457711189fa40e5bb77aa8997eca24b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:40.094287 26743 tablet_service.cc:1511] Processing CreateTablet for tablet c4f65a3c62194ad385b5c3a9d0b22e2b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:40.095136 26746 tablet_service.cc:1511] Processing CreateTablet for tablet 589b7d1d64684da8b771d0b30a73579f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:40.095266 26750 tablet_service.cc:1511] Processing CreateTablet for tablet 823c00a7d4b44bbea4d06e2ad87901ca (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:40.096719 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512480111cea40cebe7a32ae9439af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.096879 26742 tablet_service.cc:1511] Processing CreateTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:40.097302 26745 tablet_service.cc:1511] Processing CreateTablet for tablet d7a03ebddf0c40ebb4879344f54f5d24 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:40.098371 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04d1d6cb7c54df78a1746de67ce6198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.099608 26751 tablet_service.cc:1511] Processing CreateTablet for tablet e14c2c21312147dcbce6c84aad03a97f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:40.100082 26750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823c00a7d4b44bbea4d06e2ad87901ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.100867 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14c2c21312147dcbce6c84aad03a97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.103103 26748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2457711189fa40e5bb77aa8997eca24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.103983 26743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f65a3c62194ad385b5c3a9d0b22e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.105167 26745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a03ebddf0c40ebb4879344f54f5d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.105948 26744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719d8f6d8dda4888b6d16c7132ddde9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.108098 26746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589b7d1d64684da8b771d0b30a73579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.112092 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d46fffe7ef44d4c95a01a5e1b261924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.160849 26596 tablet_service.cc:1511] Processing CreateTablet for tablet ff2d7a4b795a4095a12bf45ed815682e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:40.161703 26594 tablet_service.cc:1511] Processing CreateTablet for tablet f607ad667e17480ca4cc0366f3f7ce3b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:40.162232 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2d7a4b795a4095a12bf45ed815682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.162981 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607ad667e17480ca4cc0366f3f7ce3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.165728 26602 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ea054f23d4b8f8034806c6b565279 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:40.167153 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ea054f23d4b8f8034806c6b565279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.186959 26750 tablet_service.cc:1511] Processing CreateTablet for tablet ff2d7a4b795a4095a12bf45ed815682e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:40.190748 26598 tablet_service.cc:1511] Processing CreateTablet for tablet 3d654edc77c345a4859c8e9dcbac7a2e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:40.194140 26749 tablet_service.cc:1511] Processing CreateTablet for tablet f607ad667e17480ca4cc0366f3f7ce3b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:40.194413 26601 tablet_service.cc:1511] Processing CreateTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:40.192761 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8af8f9b5044a94b8f38a96387fc68d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:40.196403 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d654edc77c345a4859c8e9dcbac7a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.198752 26750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2d7a4b795a4095a12bf45ed815682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.204203 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607ad667e17480ca4cc0366f3f7ce3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.205950 26593 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42105a7b264fbeb08ebb417ed538f0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:40.198786 26801 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:40.218006 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 859da230e1ac4e1dadde67628eb91af0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:40.220268 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8af8f9b5044a94b8f38a96387fc68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.224200 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da4a43c4ca64471b27b22ea1a167d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.230685 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18e1296ad84de08dd646beec73c343 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:40.232039 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18e1296ad84de08dd646beec73c343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.236243 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859da230e1ac4e1dadde67628eb91af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.248462 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42105a7b264fbeb08ebb417ed538f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.254395 26602 tablet_service.cc:1511] Processing CreateTablet for tablet 923e107aa6da49eb820049f53360fba9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:40.256331 26802 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:40.258153 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 463e1353202746e9b791d1dc0cc818f8 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:40.251480 26599 tablet_service.cc:1511] Processing CreateTablet for tablet f81a23e6878f49ccb8b9f964611190bc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:40.268712 26751 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ea054f23d4b8f8034806c6b565279 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:40.269944 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e107aa6da49eb820049f53360fba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.271835 26674 tablet_service.cc:1511] Processing CreateTablet for tablet f607ad667e17480ca4cc0366f3f7ce3b (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:40.272228 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a23e6878f49ccb8b9f964611190bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.276870 26668 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ea054f23d4b8f8034806c6b565279 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:40.279443 26745 tablet_service.cc:1511] Processing CreateTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:40.267396 26672 tablet_service.cc:1511] Processing CreateTablet for tablet ff2d7a4b795a4095a12bf45ed815682e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:40.280664 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463e1353202746e9b791d1dc0cc818f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.272495 26801 tablet_bootstrap.cc:654] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.273532 26744 tablet_service.cc:1511] Processing CreateTablet for tablet 3d654edc77c345a4859c8e9dcbac7a2e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:40.273833 26748 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8af8f9b5044a94b8f38a96387fc68d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:40.274549 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ea054f23d4b8f8034806c6b565279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.285771 26744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d654edc77c345a4859c8e9dcbac7a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.287029 26748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8af8f9b5044a94b8f38a96387fc68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.291401 26746 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18e1296ad84de08dd646beec73c343 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:40.263480 26802 tablet_bootstrap.cc:654] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.308107 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607ad667e17480ca4cc0366f3f7ce3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.292464 26747 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42105a7b264fbeb08ebb417ed538f0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:40.283172 26743 tablet_service.cc:1511] Processing CreateTablet for tablet 859da230e1ac4e1dadde67628eb91af0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:40.320890 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ea054f23d4b8f8034806c6b565279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.320866 26745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da4a43c4ca64471b27b22ea1a167d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.325404 26670 tablet_service.cc:1511] Processing CreateTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:40.327199 26670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da4a43c4ca64471b27b22ea1a167d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.333076 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8af8f9b5044a94b8f38a96387fc68d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:40.335026 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8af8f9b5044a94b8f38a96387fc68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.337136 26671 tablet_service.cc:1511] Processing CreateTablet for tablet 3d654edc77c345a4859c8e9dcbac7a2e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:40.339031 26671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d654edc77c345a4859c8e9dcbac7a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.342269 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2d7a4b795a4095a12bf45ed815682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.353647 26746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18e1296ad84de08dd646beec73c343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.356869 26742 tablet_service.cc:1511] Processing CreateTablet for tablet f81a23e6878f49ccb8b9f964611190bc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:40.358207 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a23e6878f49ccb8b9f964611190bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.360186 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42105a7b264fbeb08ebb417ed538f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.362797 26677 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42105a7b264fbeb08ebb417ed538f0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:40.373369 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:40.367434 26669 tablet_service.cc:1511] Processing CreateTablet for tablet 859da230e1ac4e1dadde67628eb91af0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:40.367501 26598 tablet_service.cc:1511] Processing CreateTablet for tablet ce09a05f88f44c7188fd7b1975336615 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:40.369710 26673 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18e1296ad84de08dd646beec73c343 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:40.370152 26676 tablet_service.cc:1511] Processing CreateTablet for tablet f81a23e6878f49ccb8b9f964611190bc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:40.370420 26597 tablet_service.cc:1511] Processing CreateTablet for tablet fc2fd83897434de6b94e4a1d72d147dc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:40.371325 26803 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:40.373914 26677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42105a7b264fbeb08ebb417ed538f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.364334 26743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859da230e1ac4e1dadde67628eb91af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.390532 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859da230e1ac4e1dadde67628eb91af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.391853 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.394879 26673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18e1296ad84de08dd646beec73c343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.396528 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce09a05f88f44c7188fd7b1975336615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.398726 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2fd83897434de6b94e4a1d72d147dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.400360 26676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81a23e6878f49ccb8b9f964611190bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:40.403579 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:40.416239 26801 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:40.416774 26801 ts_tablet_manager.cc:1403] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.218s	user 0.023s	sys 0.028s
I20260709 13:06:40.429523 26801 raft_consensus.cc:359] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.430387 26801 raft_consensus.cc:385] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.430718 26801 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.431929 26802 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:40.432420 26802 ts_tablet_manager.cc:1403] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.017s
I20260709 13:06:40.435559 26596 tablet_service.cc:1511] Processing CreateTablet for tablet c820b8b86e594946bfb5f18fbb98296d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:40.435426 26802 raft_consensus.cc:359] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.459944 26802 raft_consensus.cc:385] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.460285 26802 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.460707 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c820b8b86e594946bfb5f18fbb98296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.461229 26802 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.464200 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 923e107aa6da49eb820049f53360fba9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:40.465540 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e107aa6da49eb820049f53360fba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.442564 26602 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdb199be824317848395c2d8402714 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:40.446493 26801 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.467839 26601 tablet_service.cc:1511] Processing CreateTablet for tablet b14d4a32f52541d5a619dddf54757a10 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:40.468505 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdb199be824317848395c2d8402714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.469197 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d4a32f52541d5a619dddf54757a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.471501 26751 tablet_service.cc:1511] Processing CreateTablet for tablet fc2fd83897434de6b94e4a1d72d147dc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:40.472828 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2fd83897434de6b94e4a1d72d147dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.477577 26803 tablet_bootstrap.cc:654] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.459357 26750 tablet_service.cc:1511] Processing CreateTablet for tablet 463e1353202746e9b791d1dc0cc818f8 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:40.485443 26599 tablet_service.cc:1511] Processing CreateTablet for tablet af410dd1881e4b8b87c381cfbb16f9f7 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:40.486089 26750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463e1353202746e9b791d1dc0cc818f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.486754 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af410dd1881e4b8b87c381cfbb16f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.503526 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cacedac354143ab8977803382d0af (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:40.505139 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cacedac354143ab8977803382d0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.506129 26747 tablet_service.cc:1511] Processing CreateTablet for tablet c820b8b86e594946bfb5f18fbb98296d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:40.507858 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c820b8b86e594946bfb5f18fbb98296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.510785 26593 tablet_service.cc:1511] Processing CreateTablet for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:40.511545 26673 tablet_service.cc:1511] Processing CreateTablet for tablet 923e107aa6da49eb820049f53360fba9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:40.513392 26673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e107aa6da49eb820049f53360fba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.478713 26744 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:40.520684 26744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.535007 26748 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdb199be824317848395c2d8402714 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:40.542153 26595 tablet_service.cc:1511] Processing CreateTablet for tablet f2e750113ebc4804835df06f3637c083 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:40.551926 26742 tablet_service.cc:1511] Processing CreateTablet for tablet ce09a05f88f44c7188fd7b1975336615 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:40.561013 26674 tablet_service.cc:1511] Processing CreateTablet for tablet ce09a05f88f44c7188fd7b1975336615 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:40.577673 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce09a05f88f44c7188fd7b1975336615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.563529 26668 tablet_service.cc:1511] Processing CreateTablet for tablet fc2fd83897434de6b94e4a1d72d147dc (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:40.580116 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2fd83897434de6b94e4a1d72d147dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.581506 26748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdb199be824317848395c2d8402714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.566449 26673 tablet_service.cc:1511] Processing CreateTablet for tablet b14d4a32f52541d5a619dddf54757a10 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:40.582664 26673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d4a32f52541d5a619dddf54757a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.569639 26747 tablet_service.cc:1511] Processing CreateTablet for tablet af410dd1881e4b8b87c381cfbb16f9f7 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:40.584124 26670 tablet_service.cc:1511] Processing CreateTablet for tablet c820b8b86e594946bfb5f18fbb98296d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:40.584897 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af410dd1881e4b8b87c381cfbb16f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.585368 26670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c820b8b86e594946bfb5f18fbb98296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.590735 26600 tablet_service.cc:1511] Processing CreateTablet for tablet c89abadd4c4c4ff0b1ac684dff13b140 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:40.561939 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.565354 26669 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:40.527235 26671 tablet_service.cc:1511] Processing CreateTablet for tablet 463e1353202746e9b791d1dc0cc818f8 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:40.623819 26671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463e1353202746e9b791d1dc0cc818f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.624521 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.595858 26637 heartbeater.cc:499] Master 127.24.232.254:38345 was elected leader, sending a full tablet report...
I20260709 13:06:40.609261 26786 heartbeater.cc:499] Master 127.24.232.254:38345 was elected leader, sending a full tablet report...
I20260709 13:06:40.609751 26802 ts_tablet_manager.cc:1434] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.177s	user 0.023s	sys 0.037s
I20260709 13:06:40.610714 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce09a05f88f44c7188fd7b1975336615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.614300 26675 tablet_service.cc:1511] Processing CreateTablet for tablet af410dd1881e4b8b87c381cfbb16f9f7 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:40.614856 26677 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cacedac354143ab8977803382d0af (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:40.621600 26803 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:40.573041 26746 tablet_service.cc:1511] Processing CreateTablet for tablet b14d4a32f52541d5a619dddf54757a10 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:40.633513 26802 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:40.644330 26746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d4a32f52541d5a619dddf54757a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.650239 26802 tablet_bootstrap.cc:654] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.634797 26803 ts_tablet_manager.cc:1403] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.264s	user 0.010s	sys 0.006s
I20260709 13:06:40.662689 26803 raft_consensus.cc:359] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.663488 26803 raft_consensus.cc:385] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.663980 26803 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.664994 26803 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.634882 26801 ts_tablet_manager.cc:1434] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.218s	user 0.028s	sys 0.045s
I20260709 13:06:40.651705 26806 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.666590 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 830acec67d794b8f8517f8240289bd62 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:40.666616 26806 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.670604 26806 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:40.623823 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e750113ebc4804835df06f3637c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.652679 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af410dd1881e4b8b87c381cfbb16f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.687697 26712 heartbeater.cc:499] Master 127.24.232.254:38345 was elected leader, sending a full tablet report...
I20260709 13:06:40.687958 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89abadd4c4c4ff0b1ac684dff13b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.690382 26807 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.690894 26807 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:40.725513 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 432efd5ca613406d884cf1deda00ed97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:40.711701 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830acec67d794b8f8517f8240289bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.729238 26745 tablet_service.cc:1511] Processing CreateTablet for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:40.730786 26745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.732437 26743 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4cacedac354143ab8977803382d0af (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:40.756340 26801 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:40.757771 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432efd5ca613406d884cf1deda00ed97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.754908 26807 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:40.772156 26743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cacedac354143ab8977803382d0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.773092 26599 tablet_service.cc:1511] Processing CreateTablet for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:40.783795 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.784615 26742 tablet_service.cc:1511] Processing CreateTablet for tablet c89abadd4c4c4ff0b1ac684dff13b140 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:40.785957 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89abadd4c4c4ff0b1ac684dff13b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.774940 26677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cacedac354143ab8977803382d0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.790611 26803 ts_tablet_manager.cc:1434] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.131s	user 0.014s	sys 0.005s
I20260709 13:06:40.766953 26676 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdb199be824317848395c2d8402714 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:40.791618 26803 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:40.792086 26676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdb199be824317848395c2d8402714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.799068 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:40.800938 26577 leader_election.cc:343] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.801970 26602 tablet_service.cc:1511] Processing CreateTablet for tablet a3e56fc6bfb947aeb096f93897752238 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:40.803421 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e56fc6bfb947aeb096f93897752238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.810961 26801 tablet_bootstrap.cc:654] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.828011 26750 tablet_service.cc:1511] Processing CreateTablet for tablet 830acec67d794b8f8517f8240289bd62 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:40.829424 26750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830acec67d794b8f8517f8240289bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.847092 26803 tablet_bootstrap.cc:654] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.848604 26672 tablet_service.cc:1511] Processing CreateTablet for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:40.854354 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.858978 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:40.860699 26724 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.861970 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 839ee616b28745bca2748a7ec4f718dd (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:40.867563 26748 tablet_service.cc:1511] Processing CreateTablet for tablet 432efd5ca613406d884cf1deda00ed97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:40.871055 26748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432efd5ca613406d884cf1deda00ed97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.876358 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 6d135ef1afa441eb97645c3639222a71 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:40.854727 26749 tablet_service.cc:1511] Processing CreateTablet for tablet f2e750113ebc4804835df06f3637c083 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:40.881618 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e750113ebc4804835df06f3637c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.882107 26747 tablet_service.cc:1511] Processing CreateTablet for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:40.885615 26668 tablet_service.cc:1511] Processing CreateTablet for tablet f2e750113ebc4804835df06f3637c083 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:40.887063 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e750113ebc4804835df06f3637c083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.891914 26672 tablet_service.cc:1511] Processing CreateTablet for tablet 830acec67d794b8f8517f8240289bd62 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:40.893322 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830acec67d794b8f8517f8240289bd62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.909710 26751 tablet_service.cc:1511] Processing CreateTablet for tablet a3e56fc6bfb947aeb096f93897752238 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:40.916428 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.942909 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d135ef1afa441eb97645c3639222a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.949678 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ee616b28745bca2748a7ec4f718dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.966068 26677 tablet_service.cc:1511] Processing CreateTablet for tablet 432efd5ca613406d884cf1deda00ed97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:40.967823 26677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432efd5ca613406d884cf1deda00ed97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.953768 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e56fc6bfb947aeb096f93897752238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.885615 26673 tablet_service.cc:1511] Processing CreateTablet for tablet c89abadd4c4c4ff0b1ac684dff13b140 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:40.982148 26673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89abadd4c4c4ff0b1ac684dff13b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.996150 26744 tablet_service.cc:1511] Processing CreateTablet for tablet 839ee616b28745bca2748a7ec4f718dd (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:40.996466 26669 tablet_service.cc:1511] Processing CreateTablet for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:40.997561 26744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ee616b28745bca2748a7ec4f718dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.997816 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2731f6fa719f4ecfa9f1f5dc06a0aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:40.998924 26801 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:41.005915 26801 ts_tablet_manager.cc:1403] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.260s	user 0.006s	sys 0.012s
I20260709 13:06:41.009089 26801 raft_consensus.cc:359] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.010499 26743 tablet_service.cc:1511] Processing CreateTablet for tablet 6d135ef1afa441eb97645c3639222a71 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:41.004474 26593 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24ff1c29324f5a8133ee5214778e97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:41.001777 26671 tablet_service.cc:1511] Processing CreateTablet for tablet a3e56fc6bfb947aeb096f93897752238 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:41.012420 26671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e56fc6bfb947aeb096f93897752238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.003823 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 839ee616b28745bca2748a7ec4f718dd (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:41.010816 26801 raft_consensus.cc:385] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.018213 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:41.018491 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ee616b28745bca2748a7ec4f718dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.018355 26801 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.019347 26801 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:41.019739 26726 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.020308 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:41.021394 26806 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.023561 26801 ts_tablet_manager.cc:1434] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:41.024564 26801 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:41.033285 26802 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.033813 26802 ts_tablet_manager.cc:1403] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.401s	user 0.010s	sys 0.006s
I20260709 13:06:41.037645 26802 raft_consensus.cc:359] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.038448 26802 raft_consensus.cc:385] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.038527 26803 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.038929 26802 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.039188 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24ff1c29324f5a8133ee5214778e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.039428 26803 ts_tablet_manager.cc:1403] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.248s	user 0.010s	sys 0.031s
I20260709 13:06:41.043550 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:41.045571 26576 leader_election.cc:343] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.046103 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.047331 26807 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.048202 26802 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.052285 26743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d135ef1afa441eb97645c3639222a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.053054 26802 ts_tablet_manager.cc:1434] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:06:41.054605 26809 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.055133 26809 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.060904 26809 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.066599 26677 tablet_service.cc:1511] Processing CreateTablet for tablet 6d135ef1afa441eb97645c3639222a71 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:41.068183 26803 raft_consensus.cc:359] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:41.069079 26496 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44670.3us
I20260709 13:06:41.073405 26745 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24ff1c29324f5a8133ee5214778e97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:41.074803 26745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24ff1c29324f5a8133ee5214778e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.074868 26802 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:41.077463 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4358ddab16449aa08eeb30a7b58bc2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:41.078852 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4358ddab16449aa08eeb30a7b58bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.069099 26803 raft_consensus.cc:385] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.079694 26803 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.080627 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 034fec0349004eddaaed6e75ce9c56ad (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:41.080691 26803 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.083361 26803 ts_tablet_manager.cc:1434] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.043s	user 0.001s	sys 0.007s
I20260709 13:06:41.084450 26803 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:41.093080 26806 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.093648 26806 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.099417 26806 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:41.102871 26599 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4358ddab16449aa08eeb30a7b58bc2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:41.118299 26746 tablet_service.cc:1511] Processing CreateTablet for tablet 034fec0349004eddaaed6e75ce9c56ad (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:41.121804 26601 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80723b610f4fe18839109c29ed64de (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:41.124246 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec0349004eddaaed6e75ce9c56ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.127844 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:41.129453 26724 leader_election.cc:343] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.129714 26803 tablet_bootstrap.cc:654] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.130707 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80723b610f4fe18839109c29ed64de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.133373 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4358ddab16449aa08eeb30a7b58bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.140120 26746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec0349004eddaaed6e75ce9c56ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.148823 26677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d135ef1afa441eb97645c3639222a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.149209 26809 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.149878 26809 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.159739 26809 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.162346 26801 tablet_bootstrap.cc:654] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.174583 26748 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80723b610f4fe18839109c29ed64de (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:41.176249 26748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80723b610f4fe18839109c29ed64de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.190377 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:41.191641 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:41.191746 26668 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24ff1c29324f5a8133ee5214778e97 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:41.192435 26687 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:41.193048 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24ff1c29324f5a8133ee5214778e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.194993 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:41.195268 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.195976 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:41.196440 26676 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4358ddab16449aa08eeb30a7b58bc2 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:06:41.196743 26650 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.197671 26676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4358ddab16449aa08eeb30a7b58bc2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:41.197875 26650 leader_election.cc:343] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.203162 26670 tablet_service.cc:1511] Processing CreateTablet for tablet 034fec0349004eddaaed6e75ce9c56ad (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:41.203357 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:41.204656 26670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec0349004eddaaed6e75ce9c56ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.205411 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80723b610f4fe18839109c29ed64de (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:41.206712 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80723b610f4fe18839109c29ed64de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.204671 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.208457 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:41.209672 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.227926 26802 tablet_bootstrap.cc:654] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.235435 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 30f1ccf978694c0f81383b6ddf01bedf (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:41.236822 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f1ccf978694c0f81383b6ddf01bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.236963 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:41.238209 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.248523 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:41.249783 26806 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:41.250181 26806 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.250550 26806 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:41.250560 26750 tablet_service.cc:1511] Processing CreateTablet for tablet 30f1ccf978694c0f81383b6ddf01bedf (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:41.252097 26750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f1ccf978694c0f81383b6ddf01bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.254921 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:41.256305 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.262414 26807 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.262979 26807 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.265223 26807 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.267038 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:41.268968 26576 leader_election.cc:343] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.270244 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 87d025654eac4cceb374a7a730d59309 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:41.272012 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d025654eac4cceb374a7a730d59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.275394 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:41.277165 26577 leader_election.cc:343] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.277566 26803 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.277601 26577 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.278223 26803 ts_tablet_manager.cc:1403] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.194s	user 0.008s	sys 0.010s
I20260709 13:06:41.278888 26807 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.281457 26803 raft_consensus.cc:359] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.282220 26803 raft_consensus.cc:385] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.282523 26803 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.285984 26803 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.289289 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:41.289717 26671 tablet_service.cc:1511] Processing CreateTablet for tablet 87d025654eac4cceb374a7a730d59309 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:41.290689 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:41.292546 26671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d025654eac4cceb374a7a730d59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.297446 26803 ts_tablet_manager.cc:1434] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:06:41.298491 26803 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:41.295835 26745 tablet_service.cc:1511] Processing CreateTablet for tablet 87d025654eac4cceb374a7a730d59309 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:41.314448 26745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d025654eac4cceb374a7a730d59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.315613 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 272d473e821e4c15a9f3fa0471adfdc6 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:41.316888 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d473e821e4c15a9f3fa0471adfdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.303851 26806 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.328681 26751 tablet_service.cc:1511] Processing CreateTablet for tablet 272d473e821e4c15a9f3fa0471adfdc6 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:41.324816 26668 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:41.330142 26602 tablet_service.cc:1511] Processing CreateTablet for tablet f64501a1194b4fc59c6dc2502e1b7c73 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:41.330675 26668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:41.329680 26651 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.343560 26760 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:41.345389 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d473e821e4c15a9f3fa0471adfdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.346982 26742 tablet_service.cc:1511] Processing CreateTablet for tablet f64501a1194b4fc59c6dc2502e1b7c73 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:41.341986 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64501a1194b4fc59c6dc2502e1b7c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.348340 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64501a1194b4fc59c6dc2502e1b7c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.349344 26747 tablet_service.cc:1511] Processing CreateTablet for tablet c93a33496b2c4716b8e1e571c2bd3a5e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:41.349831 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.350770 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a33496b2c4716b8e1e571c2bd3a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.351840 26809 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.352826 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.352720 26596 tablet_service.cc:1511] Processing CreateTablet for tablet c93a33496b2c4716b8e1e571c2bd3a5e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:41.353387 26669 tablet_service.cc:1511] Processing CreateTablet for tablet f64501a1194b4fc59c6dc2502e1b7c73 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:41.354136 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a33496b2c4716b8e1e571c2bd3a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.354616 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64501a1194b4fc59c6dc2502e1b7c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.356428 26802 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.356971 26802 ts_tablet_manager.cc:1403] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.282s	user 0.003s	sys 0.016s
I20260709 13:06:41.356839 26672 tablet_service.cc:1511] Processing CreateTablet for tablet c93a33496b2c4716b8e1e571c2bd3a5e (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:41.358121 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a33496b2c4716b8e1e571c2bd3a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.361085 26809 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:41.320928 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 30f1ccf978694c0f81383b6ddf01bedf (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:41.368487 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f1ccf978694c0f81383b6ddf01bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.368815 26803 tablet_bootstrap.cc:654] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.369710 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:41.377926 26724 leader_election.cc:343] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.369002 26806 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:41.381850 26801 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:41.382368 26801 ts_tablet_manager.cc:1403] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.358s	user 0.027s	sys 0.009s
I20260709 13:06:41.385327 26801 raft_consensus.cc:359] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.386054 26801 raft_consensus.cc:385] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.386374 26801 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.387387 26802 raft_consensus.cc:359] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.388105 26802 raft_consensus.cc:385] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.388401 26802 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.389274 26809 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.396116 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:41.395975 26802 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.399506 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 272d473e821e4c15a9f3fa0471adfdc6 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:41.402166 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d473e821e4c15a9f3fa0471adfdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.402197 26802 ts_tablet_manager.cc:1434] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:06:41.405849 26802 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
W20260709 13:06:41.406855 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:41.387089 26801 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.429986 26802 tablet_bootstrap.cc:654] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.430442 26801 ts_tablet_manager.cc:1434] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:06:41.432675 26801 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:41.439086 26801 tablet_bootstrap.cc:654] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.441249 26803 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.442018 26803 ts_tablet_manager.cc:1403] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.014s
I20260709 13:06:41.444981 26803 raft_consensus.cc:359] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.445734 26803 raft_consensus.cc:385] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.446025 26803 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.449306 26602 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0a742797f949c583d86fd5006dab3d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:41.450757 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0a742797f949c583d86fd5006dab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.455291 26803 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.453312 26687 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:41.461894 26803 ts_tablet_manager.cc:1434] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:06:41.463723 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:41.464005 26802 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.464198 26803 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:41.464596 26802 ts_tablet_manager.cc:1403] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.010s
I20260709 13:06:41.464944 26806 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:41.473255 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0a742797f949c583d86fd5006dab3d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:41.482879 26807 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.483611 26807 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.486552 26807 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.487758 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:41.491987 26576 leader_election.cc:343] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.489018 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0a742797f949c583d86fd5006dab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.493929 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:41.493067 26806 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:41.494843 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0a742797f949c583d86fd5006dab3d (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:06:41.495656 26577 leader_election.cc:343] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.496176 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0a742797f949c583d86fd5006dab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.495867 26806 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.496146 26577 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.497637 26807 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.500984 26801 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:41.501508 26801 ts_tablet_manager.cc:1403] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.030s
I20260709 13:06:41.493774 26802 raft_consensus.cc:359] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.503903 26802 raft_consensus.cc:385] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.504220 26802 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.504606 26801 raft_consensus.cc:359] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.504786 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 78e89d788bee4a128b18985e582217d9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:41.505363 26801 raft_consensus.cc:385] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.505695 26801 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.506150 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e89d788bee4a128b18985e582217d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.506424 26801 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.498204 26803 tablet_bootstrap.cc:654] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.511152 26801 ts_tablet_manager.cc:1434] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:41.504958 26802 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.512246 26801 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:41.513221 26802 ts_tablet_manager.cc:1434] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:06:41.515455 26802 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:41.518816 26801 tablet_bootstrap.cc:654] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.521147 26829 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.521703 26829 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.525537 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:41.527438 26724 leader_election.cc:343] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.530313 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:41.532030 26726 leader_election.cc:343] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.532670 26726 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:41.534976 26829 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:41.535724 26829 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.547219 26672 tablet_service.cc:1511] Processing CreateTablet for tablet 78e89d788bee4a128b18985e582217d9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:41.548800 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e89d788bee4a128b18985e582217d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.547204 26802 tablet_bootstrap.cc:654] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.552491 26747 tablet_service.cc:1511] Processing CreateTablet for tablet 78e89d788bee4a128b18985e582217d9 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:41.554338 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e89d788bee4a128b18985e582217d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.561729 26669 tablet_service.cc:1511] Processing CreateTablet for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:41.563032 26669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.566176 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:41.567575 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.560690 26602 tablet_service.cc:1511] Processing CreateTablet for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:41.573551 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3f44630f03419aaf2afaa55030ded4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:41.574837 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3f44630f03419aaf2afaa55030ded4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.577584 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3f44630f03419aaf2afaa55030ded4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:41.578878 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3f44630f03419aaf2afaa55030ded4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.579489 26802 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.580010 26802 ts_tablet_manager.cc:1403] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.003s
I20260709 13:06:41.581378 26801 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:41.581846 26801 ts_tablet_manager.cc:1403] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.070s	user 0.033s	sys 0.019s
I20260709 13:06:41.583201 26802 raft_consensus.cc:359] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.583951 26802 raft_consensus.cc:385] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.584067 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414ef95ecc9a4f13ba0cc2a2bea97cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.584277 26802 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.584771 26801 raft_consensus.cc:359] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.585486 26801 raft_consensus.cc:385] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.585779 26801 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.590564 26802 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.590564 26801 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.593245 26802 ts_tablet_manager.cc:1434] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:06:41.594257 26801 ts_tablet_manager.cc:1434] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:06:41.594262 26802 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:41.595281 26801 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:41.601404 26802 tablet_bootstrap.cc:654] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.603261 26801 tablet_bootstrap.cc:654] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.595528 26509 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.605439 26803 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.605935 26803 ts_tablet_manager.cc:1403] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.015s
I20260709 13:06:41.609858 26803 raft_consensus.cc:359] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.610570 26803 raft_consensus.cc:385] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.610867 26803 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.613534 26749 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3f44630f03419aaf2afaa55030ded4 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:41.614991 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3f44630f03419aaf2afaa55030ded4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.621830 26803 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.626569 26803 ts_tablet_manager.cc:1434] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:06:41.627547 26803 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:41.642189 26595 tablet_service.cc:1511] Processing CreateTablet for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:41.648484 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.648959 26803 tablet_bootstrap.cc:654] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.641965 26809 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.648895 26672 tablet_service.cc:1511] Processing CreateTablet for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:41.650066 26809 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.650964 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.652253 26802 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.652300 26809 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.653148 26802 ts_tablet_manager.cc:1403] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 13:06:41.653569 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:41.656134 26802 raft_consensus.cc:359] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:41.656548 26650 leader_election.cc:343] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.656896 26802 raft_consensus.cc:385] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.657238 26802 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.658013 26802 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.658917 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:41.660327 26802 ts_tablet_manager.cc:1434] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
W20260709 13:06:41.660890 26651 leader_election.cc:343] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:41.661432 26802 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:41.661537 26651 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:41.663604 26809 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:41.710376 26803 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.711030 26803 ts_tablet_manager.cc:1403] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.015s
I20260709 13:06:41.716789 26803 raft_consensus.cc:359] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.717760 26803 raft_consensus.cc:385] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.718116 26803 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.719007 26803 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.721431 26803 ts_tablet_manager.cc:1434] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:06:41.721961 26749 tablet_service.cc:1511] Processing CreateTablet for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:41.722520 26801 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:41.723016 26801 ts_tablet_manager.cc:1403] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.128s	user 0.020s	sys 0.024s
I20260709 13:06:41.723187 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c94b0ed2c04d78b5e39ffdf89ff51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.726141 26801 raft_consensus.cc:359] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.726883 26801 raft_consensus.cc:385] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.727176 26801 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.727914 26801 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.722494 26803 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:41.733141 26802 tablet_bootstrap.cc:654] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.735471 26803 tablet_bootstrap.cc:654] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:41.746064 26801 ts_tablet_manager.cc:1434] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:06:41.754540 26809 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.754653 26801 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:41.754995 26809 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.748553 26803 tablet_bootstrap.cc:492] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:41.753250 26672 tablet_service.cc:1511] Processing CreateTablet for tablet e17759cb7022408583bb0bc7c6cc4eba (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:41.758168 26802 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:41.758539 26809 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:41.758868 26802 ts_tablet_manager.cc:1403] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.010s
I20260709 13:06:41.759723 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:41.764744 26802 raft_consensus.cc:359] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.765607 26802 raft_consensus.cc:385] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:41.765939 26802 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:41.766888 26802 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:41.757006 26803 ts_tablet_manager.cc:1403] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.009s
W20260709 13:06:42.409795 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:42.996457 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb740 after lost signal to thread 25510
I20260709 13:06:43.088876 26844 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.089563 26844 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.091799 26844 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:43.092895 26844 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.093034 26595 tablet_service.cc:1511] Processing CreateTablet for tablet e17759cb7022408583bb0bc7c6cc4eba (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:43.093385 26844 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.094451 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17759cb7022408583bb0bc7c6cc4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.095449 26844 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.108628 26845 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.109261 26845 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.111172 26845 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.111268 26510 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:52294 (request call id 29) took 1382 ms. Trace:
I20260709 13:06:43.111754 26510 rpcz_store.cc:276] 0709 13:06:41.728716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.110660 (+1381944us) service_pool.cc:224] Handling call
0709 13:06:43.110959 (+   299us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:06:43.111108 (+   149us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=53065f01274e4d70b03e81ed71365825]
0709 13:06:43.111213 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:43.122696 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17759cb7022408583bb0bc7c6cc4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.135164 26845 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.135706 26845 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.135854 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:43.137632 26650 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.137773 26845 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.139343 26672 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55242 (request call id 55) took 1387 ms. Trace:
I20260709 13:06:43.139328 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.139883 26672 rpcz_store.cc:276] 0709 13:06:41.752087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.752266 (+   179us) service_pool.cc:224] Handling call
0709 13:06:43.122128 (+1369862us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:43.122227 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:43.131576 (+  9349us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:43.139012 (+  7436us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:43.139301 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:43.140961 26650 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.141655 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 403ab0598478421094af52431235a129 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:43.141866 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.142493 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:43.142868 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403ab0598478421094af52431235a129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.143983 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:43.144814 26845 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.145183 26845 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.145498 26845 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.151201 26846 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.151693 26846 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.148650 26602 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae2b4b46548d6b153c9953ffe1708 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:43.153113 26602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae2b4b46548d6b153c9953ffe1708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.155067 26509 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 6) took 1562 ms. Trace:
I20260709 13:06:43.157625 26845 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.159832 26845 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.160591 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.161172 26611 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.155435 26509 rpcz_store.cc:276] 0709 13:06:41.592639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.592801 (+   162us) service_pool.cc:224] Handling call
0709 13:06:43.154994 (+1562193us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:41.646794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:41.647576 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:41.647605 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:06:41.647625 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:41.647946 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:41.647994 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:41.648018 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:41.648196 (+   178us) tablet.cc:701] Row locks acquired
0709 13:06:41.648219 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:06:41.648356 (+   137us) write_op.cc:270] Start()
0709 13:06:41.648448 (+    92us) write_op.cc:276] Timestamp: P: 1783602401648312 usec, L: 0
0709 13:06:41.648483 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:06:41.649120 (+   637us) log.cc:844] Serialized 543 byte log entry
0709 13:06:41.729953 (+ 80833us) op_driver.cc:464] REPLICATION: finished
0709 13:06:42.026335 (+296382us) write_op.cc:301] APPLY: starting
0709 13:06:42.026456 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:42.026596 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:42.026754 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:42.027011 (+   257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:42.027220 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:42.027284 (+    64us) write_op.cc:312] APPLY: finished
0709 13:06:42.027559 (+   275us) log.cc:844] Serialized 22 byte log entry
0709 13:06:42.027780 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.027881 (+   101us) write_op.cc:454] Released schema lock
0709 13:06:42.027928 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.028292 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.028338 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":296055,"apply.run_cpu_time_us":1988,"apply.run_wall_time_us":1990,"num_ops":1,"prepare.queue_time_us":39344,"prepare.run_cpu_time_us":18097,"prepare.run_wall_time_us":21485,"raft.queue_time_us":59290,"raft.run_cpu_time_us":1337,"raft.run_wall_time_us":29343,"replication_time_us":81341,"thread_start_us":120463,"threads_started":4,"wal-append.queue_time_us":19186}]]}
I20260709 13:06:43.167928 26846 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.168535 26846 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.168956 26846 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.169941 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:43.170967 26846 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.172228 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.172401 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:06:43.173877 26577 leader_election.cc:343] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.175619 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 8a056abe51184f1d85dc02b3ff21b29f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:43.176977 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a056abe51184f1d85dc02b3ff21b29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.176486 26803 raft_consensus.cc:359] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.177305 26803 raft_consensus.cc:385] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.177605 26803 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.178582 26803 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.177526 26845 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.186154 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.186904 26612 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:43.188350 26802 ts_tablet_manager.cc:1434] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 1.429s	user 0.011s	sys 0.019s
W20260709 13:06:43.188678 26802 ts_tablet_manager.cc:1467] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Tablet startup took 1429ms
W20260709 13:06:43.188999 26802 ts_tablet_manager.cc:1469] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Trace:
0709 13:06:40.089511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.091747 (+  2236us) service_pool.cc:224] Handling call
0709 13:06:40.093673 (+  1926us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:40.093779 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:40.149605 (+ 55826us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:40.278128 (+128523us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:40.278530 (+   402us) inbound_call.cc:177] Queueing success response
0709 13:06:41.661073 (+1382543us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:41.759217 (+ 98144us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:41.759859 (+   642us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:41.760608 (+   749us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":134,"tablet-open.queue_time_us":1382610}
I20260709 13:06:43.190752 26802 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:41.762774 26809 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.193996 26809 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.196179 26802 tablet_bootstrap.cc:654] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:43.186909 26724 consensus_peers.cc:597] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.197875 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:43.198231 26803 ts_tablet_manager.cc:1434] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.004s
W20260709 13:06:43.198562 26803 ts_tablet_manager.cc:1467] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Tablet startup took 1218ms
I20260709 13:06:43.198753 26829 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.199270 26829 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.199702 26829 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.200132 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:43.198834 26803 ts_tablet_manager.cc:1469] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Trace:
0709 13:06:40.016180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.017223 (+  1043us) service_pool.cc:224] Handling call
0709 13:06:40.019357 (+  2134us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:40.019526 (+   169us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:40.182866 (+163340us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:40.297346 (+114480us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:40.361154 (+ 63808us) inbound_call.cc:177] Queueing success response
0709 13:06:41.722133 (+1360979us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:43.169127 (+1446994us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:43.169552 (+   425us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:43.170153 (+   601us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":4258,"raft.queue_time_us":18214,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"tablet-open.queue_time_us":1369200,"thread_start_us":17100,"threads_started":1}
I20260709 13:06:43.200773 26612 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:43.201798 26803 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.201996 26809 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.202739 26747 tablet_service.cc:1511] Processing CreateTablet for tablet 403ab0598478421094af52431235a129 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:43.204123 26747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403ab0598478421094af52431235a129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.208415 26803 tablet_bootstrap.cc:654] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.208834 26829 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.195930 26845 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:43.210680 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:43.211800 26809 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.211118 26845 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.212312 26809 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.212805 26809 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.219619 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.220484 26612 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.220752 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.226270 26844 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.227010 26844 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.229826 26844 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:43.231338 26577 leader_election.cc:343] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.231956 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.233723 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.234594 26761 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
W20260709 13:06:43.236819 26724 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.238219 26809 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.239825 26576 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.241460 26807 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.241954 26807 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.242107 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.242417 26807 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.242981 26611 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.255815 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.261471 26611 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:43.263216 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:43.264966 26809 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.266026 26809 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.266891 26809 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:43.268069 26809 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.275429 26749 tablet_service.cc:1511] Processing CreateTablet for tablet e17759cb7022408583bb0bc7c6cc4eba (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:43.276865 26749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17759cb7022408583bb0bc7c6cc4eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.276752 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:43.277530 26724 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.277556 26760 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:43.279690 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae2b4b46548d6b153c9953ffe1708 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:43.280094 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.280962 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae2b4b46548d6b153c9953ffe1708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.282017 26844 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.282644 26844 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.284130 26751 tablet_service.cc:1511] Processing CreateTablet for tablet 8a056abe51184f1d85dc02b3ff21b29f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:43.284977 26844 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.285326 26751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a056abe51184f1d85dc02b3ff21b29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.292107 26674 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae2b4b46548d6b153c9953ffe1708 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:43.293383 26674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae2b4b46548d6b153c9953ffe1708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.296314 26508 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 9) took 1642 ms. Trace:
I20260709 13:06:43.296361 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.294638 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.297379 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.303550 26760 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:43.298056 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.304987 26761 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:43.306118 26508 rpcz_store.cc:276] 0709 13:06:41.653332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.654800 (+  1468us) service_pool.cc:224] Handling call
0709 13:06:43.173272 (+1518472us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:06:43.296106 (+122834us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":29207424}
I20260709 13:06:43.298538 26844 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.308005 26844 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.309311 26758 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
W20260709 13:06:43.309967 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbe20 after lost signal to thread 26544
W20260709 13:06:43.311132 26633 debug-util.cc:398] Leaking SignalData structure 0x7b0800208c00 after lost signal to thread 26636
W20260709 13:06:43.311455 26633 debug-util.cc:398] Leaking SignalData structure 0x7b0800208ba0 after lost signal to thread 26637
I20260709 13:06:43.275312 26672 tablet_service.cc:1511] Processing CreateTablet for tablet 403ab0598478421094af52431235a129 (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:43.313277 26853 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.313771 26672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403ab0598478421094af52431235a129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.313805 26853 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.317570 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.317580 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.318351 26686 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
W20260709 13:06:43.319587 26724 leader_election.cc:343] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.319849 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:06:43.321758 26633 debug-util.cc:398] Leaking SignalData structure 0x7b0800208ae0 after lost signal to thread 26711
W20260709 13:06:43.323155 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce740 after lost signal to thread 26785
W20260709 13:06:43.325292 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08001545e0 after lost signal to thread 26823
I20260709 13:06:43.324908 26675 tablet_service.cc:1511] Processing CreateTablet for tablet 8a056abe51184f1d85dc02b3ff21b29f (DEFAULT_TABLE table=test-workload [id=53065f01274e4d70b03e81ed71365825]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:43.326774 26675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a056abe51184f1d85dc02b3ff21b29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.328888 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.329871 26686 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:43.332947 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.333901 26687 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:43.329178 26844 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.336575 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:43.337159 26687 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.338423 26803 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.338901 26803 ts_tablet_manager.cc:1403] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.137s	user 0.038s	sys 0.033s
I20260709 13:06:43.341501 26803 raft_consensus.cc:359] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.342166 26803 raft_consensus.cc:385] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.342432 26803 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.344807 26803 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.347868 26803 ts_tablet_manager.cc:1434] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:06:43.353004 26803 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.230497 26829 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:43.359831 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.360555 26685 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:43.363201 26803 tablet_bootstrap.cc:654] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.370422 26807 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.375734 26612 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:43.376729 26846 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.379232 26854 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.379914 26854 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.380424 26854 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.384277 26853 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.353641 26687 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:43.388051 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.389598 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.389854 26853 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.391012 26576 leader_election.cc:343] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.390571 26853 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.393636 26853 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.394214 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.394882 26685 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:43.395941 26577 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:43.396847 26846 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.396984 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.397258 26846 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.397593 26846 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:43.398427 26576 leader_election.cc:343] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.405675 26846 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.358595 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.406502 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:43.407029 26611 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:43.407786 26846 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:06:43.408308 26577 leader_election.cc:343] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.409083 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:43.409654 26686 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.410519 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.410576 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.411521 26758 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:43.411703 26651 leader_election.cc:343] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.411778 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:43.412235 26576 leader_election.cc:343] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:43.412755 26651 leader_election.cc:343] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.413688 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:43.405817 26807 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.418401 26848 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.418509 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:43.418852 26848 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.418655 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:43.419358 26848 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.419878 26829 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.421188 26829 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:43.422047 26829 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.427001 26686 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:43.429728 26845 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.431136 26845 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.431615 26845 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:43.432382 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:43.435782 26802 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.436512 26802 ts_tablet_manager.cc:1403] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.246s	user 0.078s	sys 0.111s
I20260709 13:06:43.435782 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.437237 26761 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.440245 26801 tablet_bootstrap.cc:654] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.439855 26802 raft_consensus.cc:359] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.442044 26577 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.443004 26807 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.443320 26803 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.443508 26807 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:43.443794 26803 ts_tablet_manager.cc:1403] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.015s
I20260709 13:06:43.444540 26807 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.446540 26803 raft_consensus.cc:359] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.447242 26845 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.447268 26803 raft_consensus.cc:385] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.449767 26803 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.450589 26803 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.442041 26802 raft_consensus.cc:385] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.451867 26802 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.453238 26803 ts_tablet_manager.cc:1434] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:43.452903 26802 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.455092 26802 ts_tablet_manager.cc:1434] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:06:43.455999 26802 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.456804 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:43.456944 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.456907 26854 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:43.458348 26650 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.459792 26803 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.458645 26844 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.460101 26845 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.460323 26844 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.439898 26507 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.460731 26844 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.469265 26802 tablet_bootstrap.cc:654] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.464058 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:43.464658 26829 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.471305 26833 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.471722 26833 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.472162 26833 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.471645 26829 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.474380 26803 tablet_bootstrap.cc:654] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.451855 26761 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:06:43.476884 26726 leader_election.cc:343] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.477941 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.484925 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:06:43.487023 26576 leader_election.cc:343] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.487246 26848 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.483862 26726 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.487902 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:43.488519 26686 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.488595 26806 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.484871 26829 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.490278 26829 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.491478 26848 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.492255 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.493628 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:43.494834 26650 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.497820 26508 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.499910 26686 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:43.482702 26854 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.501495 26507 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.502810 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:43.504886 26758 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:43.506520 26576 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.507870 26854 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.507596 26844 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.509382 26854 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:43.513382 26833 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.513171 26854 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.515067 26759 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:43.517685 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.520076 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.520720 26848 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.520900 26801 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:43.521908 26760 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:43.522631 26801 ts_tablet_manager.cc:1403] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 1.768s	user 0.025s	sys 0.000s
I20260709 13:06:43.524806 26859 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.524124 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.528520 26845 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.530601 26801 raft_consensus.cc:359] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.531602 26801 raft_consensus.cc:385] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.531991 26801 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.532900 26801 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.544885 26848 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.546489 26848 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.546746 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:43.548195 26724 leader_election.cc:343] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.548579 26848 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.550119 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.537437 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.550928 26760 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 1: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:06:43.551397 26686 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:06:43.526662 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.552588 26807 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.552798 26726 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.553294 26807 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:43.553659 26844 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.554244 26844 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.554550 26807 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.556252 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.555493 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:43.557922 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:06:43.557937 26724 leader_election.cc:343] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.558702 26686 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:43.560585 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.564133 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.565438 26848 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.565899 26859 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.566298 26844 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.570726 26801 ts_tablet_manager.cc:1434] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:06:43.571925 26801 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:43.577514 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:43.573688 26848 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.583818 26687 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:43.585296 26802 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.585672 26802 ts_tablet_manager.cc:1403] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.017s
I20260709 13:06:43.576891 26833 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.590356 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.594228 26802 raft_consensus.cc:359] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.595162 26802 raft_consensus.cc:385] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.595752 26802 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.600512 26802 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.593290 26833 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.607419 26801 tablet_bootstrap.cc:654] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.609485 26802 ts_tablet_manager.cc:1434] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.007s
I20260709 13:06:43.610602 26802 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.614565 26803 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.615034 26803 ts_tablet_manager.cc:1403] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.011s
I20260709 13:06:43.617697 26803 raft_consensus.cc:359] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.618388 26803 raft_consensus.cc:385] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.618661 26803 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.622315 26509 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.619246 26803 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.628491 26508 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.632094 26508 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.635576 26802 tablet_bootstrap.cc:654] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.630079 26803 ts_tablet_manager.cc:1434] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:06:43.643086 26803 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.647473 26802 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.648042 26802 ts_tablet_manager.cc:1403] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.012s
I20260709 13:06:43.650647 26802 raft_consensus.cc:359] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.651485 26802 raft_consensus.cc:385] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.652940 26802 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.653589 26802 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.655584 26802 ts_tablet_manager.cc:1434] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:06:43.656481 26802 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.661934 26803 tablet_bootstrap.cc:654] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.667336 26801 tablet_bootstrap.cc:492] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:43.667930 26801 ts_tablet_manager.cc:1403] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.021s
I20260709 13:06:43.668321 26802 tablet_bootstrap.cc:654] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.672415 26801 raft_consensus.cc:359] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.675132 26803 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.675808 26803 ts_tablet_manager.cc:1403] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:06:43.678617 26803 raft_consensus.cc:359] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.679315 26803 raft_consensus.cc:385] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.679571 26803 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.680480 26803 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.682791 26803 ts_tablet_manager.cc:1434] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:43.683120 26801 raft_consensus.cc:385] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.683856 26802 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.684278 26803 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.684370 26802 ts_tablet_manager.cc:1403] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.002s
I20260709 13:06:43.683866 26801 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.686045 26848 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:43.687366 26801 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.687435 26802 raft_consensus.cc:359] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.688213 26802 raft_consensus.cc:385] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.688484 26802 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.689491 26801 ts_tablet_manager.cc:1434] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:06:43.689368 26802 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.692641 26801 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:43.693367 26802 ts_tablet_manager.cc:1434] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:43.694263 26802 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.698130 26803 tablet_bootstrap.cc:654] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.700660 26802 tablet_bootstrap.cc:654] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.704977 26801 tablet_bootstrap.cc:654] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.710191 26847 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:43.711207 26803 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.713507 26612 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.715514 26803 ts_tablet_manager.cc:1403] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:06:43.735216 26803 raft_consensus.cc:359] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.736088 26803 raft_consensus.cc:385] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.736346 26803 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.737083 26803 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.740074 26803 ts_tablet_manager.cc:1434] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:06:43.741024 26803 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.747198 26803 tablet_bootstrap.cc:654] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.749409 26801 tablet_bootstrap.cc:492] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:43.752728 26801 ts_tablet_manager.cc:1403] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.013s
I20260709 13:06:43.756098 26801 raft_consensus.cc:359] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.756826 26801 raft_consensus.cc:385] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.757154 26801 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.757907 26802 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.758509 26802 ts_tablet_manager.cc:1403] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.026s
I20260709 13:06:43.757933 26801 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.760505 26801 ts_tablet_manager.cc:1434] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:43.761477 26801 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:43.761039 26802 raft_consensus.cc:359] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.761911 26802 raft_consensus.cc:385] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.762255 26802 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.763077 26802 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.768038 26802 ts_tablet_manager.cc:1434] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:43.768980 26802 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.769675 26803 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.770211 26803 ts_tablet_manager.cc:1403] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:06:43.772914 26803 raft_consensus.cc:359] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.773592 26803 raft_consensus.cc:385] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.773851 26803 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.774734 26803 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.775099 26847 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.777349 26803 ts_tablet_manager.cc:1434] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:43.778569 26803 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.779153 26801 tablet_bootstrap.cc:654] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.783764 26760 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.791347 26803 tablet_bootstrap.cc:654] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.795286 26848 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.798532 26801 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:43.799103 26801 ts_tablet_manager.cc:1403] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 13:06:43.802665 26801 raft_consensus.cc:359] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.803565 26801 raft_consensus.cc:385] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.803922 26801 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.804705 26801 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.804894 26833 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.807044 26801 ts_tablet_manager.cc:1434] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:43.808409 26801 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:43.814314 26802 tablet_bootstrap.cc:654] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.825039 26847 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.825582 26847 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.828629 26847 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.829792 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.830497 26833 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:43.831388 26650 leader_election.cc:343] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.832185 26803 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.833065 26803 ts_tablet_manager.cc:1403] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.007s
I20260709 13:06:43.834743 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:43.837133 26651 leader_election.cc:343] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.837586 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.838378 26847 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.842139 26801 tablet_bootstrap.cc:654] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.845192 26803 raft_consensus.cc:359] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.846114 26803 raft_consensus.cc:385] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.846494 26803 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.847209 26803 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.861331 26803 ts_tablet_manager.cc:1434] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:06:43.862696 26803 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.874648 26801 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:43.875263 26801 ts_tablet_manager.cc:1403] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.025s
I20260709 13:06:43.876209 26803 tablet_bootstrap.cc:654] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.876896 26802 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.877580 26802 ts_tablet_manager.cc:1403] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.009s
I20260709 13:06:43.880756 26802 raft_consensus.cc:359] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.881875 26802 raft_consensus.cc:385] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.882299 26802 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.883402 26802 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.883693 26801 raft_consensus.cc:359] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.884335 26807 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.884647 26801 raft_consensus.cc:385] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.884867 26807 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.887199 26807 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.887776 26802 ts_tablet_manager.cc:1434] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:43.888371 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.888840 26802 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.888788 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.889662 26686 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:43.889108 26760 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:43.885080 26801 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.895452 26801 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.898046 26801 ts_tablet_manager.cc:1434] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:06:43.900255 26802 tablet_bootstrap.cc:654] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.900993 26801 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:43.903584 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.905381 26829 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.906069 26829 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.909250 26829 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.911993 26847 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.912616 26847 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.912825 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.914862 26847 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.914789 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.915629 26801 tablet_bootstrap.cc:654] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:43.916640 26724 leader_election.cc:343] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:43.917827 26726 leader_election.cc:343] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.918506 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:43.919960 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.920136 26829 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.922793 26803 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:43.923516 26803 ts_tablet_manager.cc:1403] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.026s
I20260709 13:06:43.924896 26807 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:43.928135 26651 leader_election.cc:343] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.928409 26802 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.928251 26803 raft_consensus.cc:359] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.929196 26802 ts_tablet_manager.cc:1403] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.008s
I20260709 13:06:43.929728 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.929080 26803 raft_consensus.cc:385] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.937135 26803 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.937975 26803 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:43.938903 26650 leader_election.cc:343] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.939801 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:43.939548 26802 raft_consensus.cc:359] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.940397 26803 ts_tablet_manager.cc:1434] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:06:43.940572 26802 raft_consensus.cc:385] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.940835 26802 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.941366 26803 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:43.941406 26809 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.941813 26802 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.944124 26802 ts_tablet_manager.cc:1434] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:43.945153 26802 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:43.948115 26803 tablet_bootstrap.cc:654] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.951030 26802 tablet_bootstrap.cc:654] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.958958 26829 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.959751 26829 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.930997 26847 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.962144 26847 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:43.963815 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.964519 26847 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:43.966907 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:43.967841 26760 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
W20260709 13:06:43.968858 26724 leader_election.cc:343] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:43.969316 26651 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:43.969832 26854 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.971397 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:43.972298 26612 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:43.973403 26829 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:43.976514 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:43.977478 26686 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:43.978847 26847 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.979372 26847 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.979820 26847 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.983507 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:43.983938 26854 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:43.984805 26859 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:43.985178 26859 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.985574 26859 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.986469 26802 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:43.987069 26802 ts_tablet_manager.cc:1403] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 13:06:43.997172 26802 raft_consensus.cc:359] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.001873 26807 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:43.998203 26802 raft_consensus.cc:385] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.022898 26760 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.035554 26802 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.036722 26847 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.036842 26802 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.027146 26846 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:44.039978 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:44.040585 26612 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.042580 26802 ts_tablet_manager.cc:1434] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:06:44.028469 26859 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.044076 26802 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.045680 26859 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.045924 26846 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:44.048249 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:44.049856 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:44.050669 26686 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.053507 26612 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:44.054500 26809 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.054658 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:44.055202 26809 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.055511 26859 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.055567 26848 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.056615 26859 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:44.057497 26724 leader_election.cc:343] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.059197 26809 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.060775 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.070551 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.071823 26859 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:44.075452 26650 leader_election.cc:343] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.076459 26809 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.077200 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.077092 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.061486 26760 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:44.064834 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.081509 26761 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.079838 26847 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.081616 26809 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.085878 26801 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:44.086323 26801 ts_tablet_manager.cc:1403] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.186s	user 0.016s	sys 0.027s
I20260709 13:06:44.088289 26809 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.089895 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:44.091322 26651 leader_election.cc:343] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.093549 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.095188 26900 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.095932 26900 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:44.101933 26650 leader_election.cc:343] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.102434 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.104043 26724 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.103962 26686 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:44.100565 26761 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:44.106966 26809 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.108244 26900 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.110303 26651 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:44.111830 26859 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.119297 26803 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:44.114635 26847 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.120070 26803 ts_tablet_manager.cc:1403] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.179s	user 0.057s	sys 0.053s
I20260709 13:06:44.115581 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:44.120510 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.120393 26847 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.121214 26829 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.121248 26847 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.121855 26829 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:44.122736 26829 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.111615 26848 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:44.113909 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:44.129024 26577 leader_election.cc:343] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.130044 26803 raft_consensus.cc:359] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.115026 26900 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:06:44.132124 26803 raft_consensus.cc:385] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.134572 26803 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.132534 26801 raft_consensus.cc:359] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.135452 26803 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.135906 26801 raft_consensus.cc:385] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.137267 26801 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.137828 26801 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.141142 26803 ts_tablet_manager.cc:1434] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:44.142253 26803 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:44.149962 26846 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:44.150032 26847 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.136933 26759 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:44.152122 26801 ts_tablet_manager.cc:1434] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.009s
I20260709 13:06:44.159698 26801 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:44.160320 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.161208 26807 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.161592 26807 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.161710 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:44.161950 26807 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.155354 26848 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:44.163014 26650 leader_election.cc:343] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.170547 26847 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.170854 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.172761 26758 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.181186 26802 tablet_bootstrap.cc:654] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.182499 26803 tablet_bootstrap.cc:654] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.188535 26846 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.189002 26846 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.190554 26807 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.192618 26846 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.193020 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.195021 26760 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:44.195851 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.193610 26801 tablet_bootstrap.cc:654] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.196669 26686 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:44.199080 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.197683 26509 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.202405 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.202806 26760 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.184485 26758 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:44.206597 26807 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.207628 26846 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.209283 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:44.211532 26651 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:06:44.211763 26577 leader_election.cc:343] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.212704 26848 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.213596 26848 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:44.214438 26848 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.217857 26846 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.220759 26760 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:44.238611 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.255398 26901 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.259596 26803 tablet_bootstrap.cc:492] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:44.260139 26803 ts_tablet_manager.cc:1403] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.001s
I20260709 13:06:44.260915 26802 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:44.261339 26802 ts_tablet_manager.cc:1403] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.218s	user 0.022s	sys 0.011s
I20260709 13:06:44.262737 26803 raft_consensus.cc:359] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.263407 26803 raft_consensus.cc:385] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.259596 26801 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:44.264127 26801 ts_tablet_manager.cc:1403] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.012s
I20260709 13:06:44.263957 26802 raft_consensus.cc:359] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.264611 26802 raft_consensus.cc:385] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.264926 26802 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.265662 26802 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.266732 26801 raft_consensus.cc:359] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.267422 26801 raft_consensus.cc:385] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.267740 26801 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.267879 26802 ts_tablet_manager.cc:1434] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:06:44.268837 26901 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:44.268057 26803 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.269341 26802 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.270349 26901 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.297406 26803 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.297415 26801 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.299655 26803 ts_tablet_manager.cc:1434] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.001s
I20260709 13:06:44.311403 26803 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:44.305239 26510 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.302440 26801 ts_tablet_manager.cc:1434] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.009s
I20260709 13:06:44.318471 26801 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:44.320077 26802 tablet_bootstrap.cc:654] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.328135 26807 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.328689 26807 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.330814 26807 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.332752 26803 tablet_bootstrap.cc:654] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.336673 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.345687 26687 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:44.339051 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.347051 26801 tablet_bootstrap.cc:654] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.348292 26576 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.349488 26901 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.344753 26509 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.344950 26802 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:44.352229 26802 ts_tablet_manager.cc:1403] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.002s
I20260709 13:06:44.354807 26802 raft_consensus.cc:359] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.355405 26802 raft_consensus.cc:385] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.360591 26901 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.360970 26802 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.364058 26802 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.365646 26802 ts_tablet_manager.cc:1434] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:44.366580 26802 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.372236 26802 tablet_bootstrap.cc:654] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.375419 26859 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.383836 26844 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.406929 26844 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.409650 26844 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.411864 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:44.413789 26724 leader_election.cc:343] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.388762 26859 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.417380 26859 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.419557 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:44.421705 26724 leader_election.cc:343] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.424609 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.425369 26685 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:44.426733 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.429095 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:06:44.433924 26726 leader_election.cc:343] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.434999 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.436522 26844 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.437021 26844 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.437554 26844 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.379626 26510 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.448628 26859 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:44.452669 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:44.458206 26902 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.458743 26902 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.461030 26902 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.462355 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.466073 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:44.467592 26650 leader_election.cc:343] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:44.468127 26651 leader_election.cc:343] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.468631 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.469507 26902 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.485404 26803 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:44.485934 26803 ts_tablet_manager.cc:1403] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.000s
I20260709 13:06:44.488569 26803 raft_consensus.cc:359] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.489207 26803 raft_consensus.cc:385] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.489476 26803 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.490222 26803 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.492689 26803 ts_tablet_manager.cc:1434] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:44.490706 26801 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:44.493638 26801 ts_tablet_manager.cc:1403] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.175s	user 0.048s	sys 0.064s
I20260709 13:06:44.494309 26803 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:44.496405 26801 raft_consensus.cc:359] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.497073 26801 raft_consensus.cc:385] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.497367 26801 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.497840 26844 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.498189 26801 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.500471 26801 ts_tablet_manager.cc:1434] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:44.502033 26844 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.502270 26802 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:44.505777 26802 ts_tablet_manager.cc:1403] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.139s	user 0.037s	sys 0.068s
I20260709 13:06:44.508533 26802 raft_consensus.cc:359] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.509202 26802 raft_consensus.cc:385] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.509473 26802 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.510118 26802 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.504391 26803 tablet_bootstrap.cc:654] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.504319 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:44.512096 26612 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.512661 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:44.513221 26687 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.513819 26802 ts_tablet_manager.cc:1434] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:44.520850 26802 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.523038 26612 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:44.524340 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:44.525219 26859 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.525707 26859 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:44.526551 26859 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.528391 26802 tablet_bootstrap.cc:654] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.529167 26687 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:44.505257 26801 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:44.537524 26803 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:44.537676 26801 tablet_bootstrap.cc:654] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.538160 26803 ts_tablet_manager.cc:1403] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:06:44.546196 26859 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:44.547596 26803 raft_consensus.cc:359] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.546916 26508 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.548380 26803 raft_consensus.cc:385] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.548813 26803 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.550717 26803 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.559517 26803 ts_tablet_manager.cc:1434] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:06:44.560909 26803 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:44.567605 26803 tablet_bootstrap.cc:654] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.572755 26829 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.573274 26829 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.575351 26829 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.578697 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.584043 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.584903 26902 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:44.585242 26726 leader_election.cc:343] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.585780 26829 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:44.586076 26724 leader_election.cc:343] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.586717 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.588145 26859 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.591446 26802 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:44.592176 26802 ts_tablet_manager.cc:1403] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.022s
I20260709 13:06:44.596673 26901 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.597182 26901 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.595580 26802 raft_consensus.cc:359] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.600011 26802 raft_consensus.cc:385] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.600361 26802 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.601181 26802 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.605235 26802 ts_tablet_manager.cc:1434] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:44.607908 26801 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:44.608491 26801 ts_tablet_manager.cc:1403] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.021s
I20260709 13:06:44.608845 26802 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.608819 26902 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:44.611238 26801 raft_consensus.cc:359] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.611958 26801 raft_consensus.cc:385] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.612243 26801 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.612854 26801 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.621570 26854 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.622043 26854 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.624125 26854 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.628703 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.629151 26801 ts_tablet_manager.cc:1434] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:06:44.629422 26759 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:44.630679 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:44.632040 26901 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.632566 26901 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.632880 26901 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.633200 26901 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.636773 26809 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.637226 26809 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.638041 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.638692 26687 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:44.639236 26809 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.640043 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.640774 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:06:44.641314 26650 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.641404 26576 leader_election.cc:343] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.642246 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.643069 26758 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 1: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:06:44.643874 26801 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:44.643971 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.646113 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.649154 26686 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:44.655860 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.657392 26902 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.649318 26807 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.662911 26807 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.665499 26848 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:44.666832 26807 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.646661 26901 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.679931 26803 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:44.680438 26803 ts_tablet_manager.cc:1403] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.000s
I20260709 13:06:44.694424 26847 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.696369 26901 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.697857 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.698720 26760 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.693806 26807 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.695132 26847 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.800341 26801 tablet_bootstrap.cc:654] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.801873 26802 tablet_bootstrap.cc:654] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.827780 26902 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.836720 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.802067 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:44.837985 26761 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:44.838379 26807 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.841840 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:06:44.823530 26792 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.24.232.254:38345, user_credentials={real_user=slave}} blocked reactor thread for 92351.3us
I20260709 13:06:44.843518 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:44.835484 26847 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.844928 26684 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.847338 26847 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.849967 26847 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.850425 26847 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.845364 26846 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:44.849063 26803 raft_consensus.cc:359] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.844923 26687 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.847524 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.860165 26803 raft_consensus.cc:385] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.864596 26803 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
W20260709 13:06:44.865309 26576 leader_election.cc:343] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.868448 26803 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.869721 26760 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:44.870998 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:44.871930 26846 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.872455 26846 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:44.872902 26684 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:44.873368 26846 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.874151 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:44.875039 26801 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:44.879312 26801 ts_tablet_manager.cc:1403] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.236s	user 0.021s	sys 0.017s
I20260709 13:06:44.875173 26901 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.880843 26901 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:44.881803 26901 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.882476 26801 raft_consensus.cc:359] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.883270 26801 raft_consensus.cc:385] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.883617 26801 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.884523 26801 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.886726 26801 ts_tablet_manager.cc:1434] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:44.887631 26801 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:44.893759 26902 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.894290 26902 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.878492 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.878192 26847 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.897432 26902 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.897825 26847 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:44.874377 26687 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:44.900017 26854 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:44.894711 26801 tablet_bootstrap.cc:654] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:44.906905 26650 leader_election.cc:343] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.907531 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:44.906821 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.908774 26829 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.911010 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:44.911157 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:44.911774 26758 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.871011 26803 ts_tablet_manager.cc:1434] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.190s	user 0.022s	sys 0.027s
I20260709 13:06:44.911711 26759 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
W20260709 13:06:44.912921 26650 leader_election.cc:343] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.911283 26802 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
W20260709 13:06:44.913671 26650 leader_election.cc:343] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.914671 26802 ts_tablet_manager.cc:1403] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.306s	user 0.026s	sys 0.022s
I20260709 13:06:44.909322 26829 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.916536 26829 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:44.918181 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:44.920485 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:44.925918 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:44.926117 26847 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.926535 26758 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:44.925887 26803 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
W20260709 13:06:44.929762 26726 leader_election.cc:343] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:44.930963 26724 leader_election.cc:343] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.931535 26724 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:44.932505 26859 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.933964 26802 raft_consensus.cc:359] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.934229 26844 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:44.934727 26802 raft_consensus.cc:385] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.935062 26802 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.926723 26847 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.936203 26847 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.937853 26802 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.961179 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:44.966153 26847 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.968022 26902 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.968716 26902 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:44.969790 26902 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:44.972702 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:44.975983 26650 leader_election.cc:343] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.976300 26802 ts_tablet_manager.cc:1434] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:06:44.977458 26802 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:44.982348 26829 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:44.990602 26802 tablet_bootstrap.cc:654] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.003543 26801 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.004048 26801 ts_tablet_manager.cc:1403] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.117s	user 0.027s	sys 0.040s
I20260709 13:06:45.004948 26847 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.007315 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:45.007977 26760 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.009667 26803 tablet_bootstrap.cc:654] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.009331 26801 raft_consensus.cc:359] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.010026 26801 raft_consensus.cc:385] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.010288 26801 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.010951 26801 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.012406 26802 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.012872 26802 ts_tablet_manager.cc:1403] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 13:06:45.013196 26801 ts_tablet_manager.cc:1434] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:06:45.014262 26801 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:45.013458 26510 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.016773 26802 raft_consensus.cc:359] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.017418 26802 raft_consensus.cc:385] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.017664 26802 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.018479 26760 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:45.018409 26802 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.019775 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:45.022541 26844 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.022826 26847 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.023051 26844 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.023548 26847 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:45.024461 26847 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.025214 26844 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.026860 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.027464 26611 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:45.028654 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.030395 26829 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.030735 26829 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.031069 26829 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.032506 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.033121 26687 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:45.035234 26802 ts_tablet_manager.cc:1434] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:06:45.035256 26510 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.049789 26801 tablet_bootstrap.cc:654] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.054185 26829 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.057217 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.057832 26612 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.060869 26829 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.036281 26802 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.065076 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:45.065676 26687 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.078642 26687 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.080768 26803 tablet_bootstrap.cc:492] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.082779 26612 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.103197 26726 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.087308 26802 tablet_bootstrap.cc:654] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.103747 26803 ts_tablet_manager.cc:1403] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.178s	user 0.018s	sys 0.018s
I20260709 13:06:45.106894 26803 raft_consensus.cc:359] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.107550 26803 raft_consensus.cc:385] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.107833 26803 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.108424 26803 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.109360 26829 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.108635 26508 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.109987 26829 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:45.110590 26803 ts_tablet_manager.cc:1434] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:45.111522 26803 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.110893 26508 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.110991 26829 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.132169 26509 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.145452 26803 tablet_bootstrap.cc:654] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.145401 26902 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.145215 26801 tablet_bootstrap.cc:492] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.146390 26801 ts_tablet_manager.cc:1403] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.006s
I20260709 13:06:45.146170 26902 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.149281 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.149206 26801 raft_consensus.cc:359] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.150086 26611 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:45.150238 26801 raft_consensus.cc:385] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.150658 26801 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.151487 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:45.151659 26801 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.152377 26847 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.152753 26847 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.153096 26847 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.153949 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:45.154558 26760 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:45.155953 26902 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.158182 26801 ts_tablet_manager.cc:1434] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:45.159086 26801 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:45.160027 26847 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.162803 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.163383 26611 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.166112 26801 tablet_bootstrap.cc:654] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.145694 26802 tablet_bootstrap.cc:492] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.167596 26802 ts_tablet_manager.cc:1403] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.131s	user 0.004s	sys 0.017s
I20260709 13:06:45.170269 26611 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:45.170377 26802 raft_consensus.cc:359] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.171056 26802 raft_consensus.cc:385] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.171342 26802 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.171736 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:45.172554 26902 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.176858 26847 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.172070 26802 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.180444 26901 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.180898 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:45.177762 26902 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:45.181850 26760 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.181723 26901 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.182544 26902 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.183885 26901 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.184965 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.186839 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:45.187893 26758 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:45.189937 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:45.190721 26760 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:45.190992 26901 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.203498 26803 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.204257 26803 ts_tablet_manager.cc:1403] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.019s
I20260709 13:06:45.205878 26802 ts_tablet_manager.cc:1434] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:06:45.207209 26802 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.207839 26803 raft_consensus.cc:359] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.208719 26803 raft_consensus.cc:385] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.209090 26803 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.209965 26803 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.219812 26803 ts_tablet_manager.cc:1434] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 13:06:45.221055 26803 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.229143 26829 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.229683 26829 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.230736 26803 tablet_bootstrap.cc:654] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.233131 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:45.234786 26724 leader_election.cc:343] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.236981 26802 tablet_bootstrap.cc:654] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.237174 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.237794 26687 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:45.239264 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:45.235690 26829 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.230763 26801 tablet_bootstrap.cc:492] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.241184 26801 ts_tablet_manager.cc:1403] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.035s
I20260709 13:06:45.241523 26901 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.242427 26944 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.242966 26944 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.243521 26944 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.250536 26508 catalog_manager.cc:5697] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.252942 26944 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.256601 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.258324 26803 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.259369 26803 ts_tablet_manager.cc:1403] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.003s
I20260709 13:06:45.260488 26944 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.261521 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:45.262166 26687 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.264096 26846 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.265354 26803 raft_consensus.cc:359] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.266287 26803 raft_consensus.cc:385] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.266661 26803 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.264530 26802 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.267637 26802 ts_tablet_manager.cc:1403] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.010s
I20260709 13:06:45.269958 26687 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.270704 26803 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.271104 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.272190 26829 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.272652 26829 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:45.272734 26802 raft_consensus.cc:359] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.274492 26802 raft_consensus.cc:385] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.274853 26802 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.275564 26802 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.277738 26802 ts_tablet_manager.cc:1434] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:06:45.247159 26801 raft_consensus.cc:359] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.273461 26829 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.278640 26802 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.274175 26803 ts_tablet_manager.cc:1434] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:45.280728 26803 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.286672 26803 tablet_bootstrap.cc:654] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.287647 26801 raft_consensus.cc:385] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.288328 26801 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.289628 26801 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.291275 26612 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.298555 26612 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.293107 26802 tablet_bootstrap.cc:654] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.306155 26902 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.310433 26507 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.306751 26902 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.314225 26854 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.318384 26803 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.318888 26803 ts_tablet_manager.cc:1403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:06:45.320458 26944 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.321735 26944 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.322260 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:45.324406 26651 leader_election.cc:343] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.324658 26802 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.325090 26847 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.325309 26803 raft_consensus.cc:359] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.325621 26847 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.326107 26803 raft_consensus.cc:385] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.326448 26803 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.327117 26803 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.327773 26847 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.329615 26803 ts_tablet_manager.cc:1434] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:45.330569 26803 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.330467 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.325130 26802 ts_tablet_manager.cc:1403] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.000s
W20260709 13:06:45.333760 26650 leader_election.cc:343] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.334743 26802 raft_consensus.cc:359] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.335107 26901 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.335393 26802 raft_consensus.cc:385] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.336356 26802 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.337623 26802 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.344372 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:45.339679 26802 ts_tablet_manager.cc:1434] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:45.348289 26802 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
W20260709 13:06:45.349998 26651 leader_election.cc:343] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.350492 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:45.351599 26809 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.322424 26902 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.359138 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.323027 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.361238 26803 tablet_bootstrap.cc:654] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.361945 26802 tablet_bootstrap.cc:654] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.366806 26801 ts_tablet_manager.cc:1434] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.000s
I20260709 13:06:45.368160 26801 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
W20260709 13:06:45.370395 26650 leader_election.cc:343] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.371030 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:45.373107 26848 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.377794 26944 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.378298 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.382282 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:45.383335 26859 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.385821 26944 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.386250 26944 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.391901 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.392244 26944 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.392536 26611 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.393563 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.394187 26684 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.395413 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.395901 26801 tablet_bootstrap.cc:654] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.396577 26944 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.396970 26944 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.397310 26944 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.405133 26944 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.407893 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.408469 26611 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.411808 26802 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.412256 26802 ts_tablet_manager.cc:1403] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.003s
I20260709 13:06:45.414283 26760 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.422341 26944 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.416455 26611 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:06:45.427461 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.428123 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:45.428386 26829 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.428750 26687 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.428853 26829 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.431463 26829 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.432917 26944 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.435109 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.435285 26944 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:06:45.436640 26726 leader_election.cc:343] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.433229 26802 raft_consensus.cc:359] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.437829 26802 raft_consensus.cc:385] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.437114 26944 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.438148 26802 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.436110 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:45.439862 26724 leader_election.cc:343] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.440349 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:45.441563 26829 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.444923 26803 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.444854 26854 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.435997 26687 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:06:45.446980 26803 ts_tablet_manager.cc:1403] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.008s
I20260709 13:06:45.449244 26801 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.445879 26802 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.449690 26801 ts_tablet_manager.cc:1403] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.014s
W20260709 13:06:45.458098 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:45.457475 26507 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 2, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.460891 26801 raft_consensus.cc:359] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.461872 26801 raft_consensus.cc:385] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.462028 26802 ts_tablet_manager.cc:1434] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:06:45.462255 26801 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.462991 26802 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.463277 26801 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.465929 26801 ts_tablet_manager.cc:1434] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:06:45.466215 26803 raft_consensus.cc:359] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.466977 26803 raft_consensus.cc:385] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.467097 26801 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:45.467290 26803 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.468022 26803 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.474114 26801 tablet_bootstrap.cc:654] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.483989 26803 ts_tablet_manager.cc:1434] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:06:45.487854 26802 tablet_bootstrap.cc:654] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.489176 26803 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
W20260709 13:06:45.490417 26650 consensus_peers.cc:597] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.497475 26944 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.497978 26944 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.500056 26944 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.501581 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:45.502965 26724 leader_election.cc:343] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.504537 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:45.505316 26687 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:45.506414 26902 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.506808 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:45.506887 26902 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.507843 26944 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.508209 26944 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.508561 26944 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.509094 26902 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.510076 26902 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.510577 26902 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.511034 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:45.512732 26651 leader_election.cc:343] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.513814 26902 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.513885 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.514290 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.514890 26611 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:06:45.515208 26650 leader_election.cc:343] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.515730 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:45.516309 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:45.516903 26760 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:45.517241 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:45.517968 26848 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.518563 26848 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.518909 26848 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.519258 26848 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.521752 26847 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.526865 26848 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.531038 26803 tablet_bootstrap.cc:654] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.531426 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.532094 26611 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.536260 26944 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.539063 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.539351 26611 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:06:45.540359 26724 leader_election.cc:343] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.540478 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:45.541296 26902 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.541771 26902 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:45.546916 26902 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.550057 26944 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.549965 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:45.550655 26687 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.559026 26687 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.559046 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:45.559777 26760 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.563481 26809 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.566380 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:45.567474 26859 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.568017 26859 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:45.568526 26829 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.568843 26859 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.569188 26829 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.573683 26829 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.573896 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:45.576710 26726 leader_election.cc:343] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.577551 26803 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.578025 26803 ts_tablet_manager.cc:1403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.004s
I20260709 13:06:45.580042 26848 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.581072 26803 raft_consensus.cc:359] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.581880 26802 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.582401 26802 ts_tablet_manager.cc:1403] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.120s	user 0.003s	sys 0.007s
I20260709 13:06:45.581946 26803 raft_consensus.cc:385] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.577862 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.582785 26803 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.585175 26848 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.585040 26803 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.590682 26803 ts_tablet_manager.cc:1434] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:45.592089 26803 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.584949 26611 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:45.595062 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:45.596807 26859 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.597321 26859 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.597865 26859 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.601457 26802 raft_consensus.cc:359] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.602159 26802 raft_consensus.cc:385] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.602439 26802 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.603255 26507 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 2, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.614781 26802 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.616932 26802 ts_tablet_manager.cc:1434] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:06:45.620309 26801 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.620767 26801 ts_tablet_manager.cc:1403] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.154s	user 0.041s	sys 0.052s
I20260709 13:06:45.623359 26801 raft_consensus.cc:359] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.624135 26801 raft_consensus.cc:385] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.624400 26801 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.624761 26509 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.607659 26760 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:06:45.626515 26801 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.627590 26802 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.629766 26801 ts_tablet_manager.cc:1434] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:45.630713 26801 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:45.634100 26848 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.636288 26801 tablet_bootstrap.cc:654] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.643620 26859 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.647989 26802 tablet_bootstrap.cc:654] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.648550 26803 tablet_bootstrap.cc:654] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.659782 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:45.660409 26611 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.660956 26859 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:45.662637 26802 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.663156 26802 ts_tablet_manager.cc:1403] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.001s
I20260709 13:06:45.692883 26802 raft_consensus.cc:359] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.694202 26802 raft_consensus.cc:385] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.694602 26802 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.695374 26802 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.693499 26803 tablet_bootstrap.cc:492] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.696792 26803 ts_tablet_manager.cc:1403] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.004s
I20260709 13:06:45.704057 26859 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.711887 26802 ts_tablet_manager.cc:1434] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.048s	user 0.014s	sys 0.002s
I20260709 13:06:45.717046 26803 raft_consensus.cc:359] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.717947 26803 raft_consensus.cc:385] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.714215 26802 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.731861 26802 tablet_bootstrap.cc:654] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.718297 26803 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.732930 26803 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.734694 26803 ts_tablet_manager.cc:1434] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.002s
I20260709 13:06:45.735801 26803 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.744807 26803 tablet_bootstrap.cc:654] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.754560 26803 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.757087 26803 ts_tablet_manager.cc:1403] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:06:45.760040 26902 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.759052 26802 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.760964 26802 ts_tablet_manager.cc:1403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.005s
I20260709 13:06:45.760747 26902 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.763819 26802 raft_consensus.cc:359] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.764179 26803 raft_consensus.cc:359] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.764547 26802 raft_consensus.cc:385] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.764809 26803 raft_consensus.cc:385] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.764936 26802 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.766122 26802 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.768682 26802 ts_tablet_manager.cc:1434] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:06:45.769693 26802 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.765118 26803 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.770483 26803 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.776661 26802 tablet_bootstrap.cc:654] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.777055 26803 ts_tablet_manager.cc:1434] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:06:45.778002 26803 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.796065 26803 tablet_bootstrap.cc:654] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.808240 26902 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.810608 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:45.812266 26650 leader_election.cc:343] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.817039 26803 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.817701 26803 ts_tablet_manager.cc:1403] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
I20260709 13:06:45.821431 26803 raft_consensus.cc:359] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.822345 26803 raft_consensus.cc:385] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.822675 26803 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.823493 26803 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.825717 26803 ts_tablet_manager.cc:1434] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:45.826978 26803 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
W20260709 13:06:45.828245 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 205894us
I20260709 13:06:45.834810 26803 tablet_bootstrap.cc:654] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.835886 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:45.861258 26611 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.863134 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:45.864135 26829 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:45.864675 26829 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:45.865541 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:45.865499 26829 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.866360 26687 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.866859 26803 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.867314 26803 ts_tablet_manager.cc:1403] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.008s
I20260709 13:06:45.870061 26803 raft_consensus.cc:359] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.870915 26803 raft_consensus.cc:385] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.871238 26803 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.876737 26803 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.879024 26803 ts_tablet_manager.cc:1434] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:45.879951 26803 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.896515 26803 tablet_bootstrap.cc:654] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.899842 26686 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:45.902184 26902 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:45.903720 26651 leader_election.cc:343] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.904333 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:45.905342 26902 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:45.907258 26844 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.912145 26687 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:45.916383 26803 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.916852 26803 ts_tablet_manager.cc:1403] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:06:45.917845 26802 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:45.918445 26802 ts_tablet_manager.cc:1403] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.149s	user 0.043s	sys 0.049s
I20260709 13:06:45.920106 26803 raft_consensus.cc:359] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.920854 26803 raft_consensus.cc:385] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.921315 26803 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.922065 26803 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.923406 26829 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.924584 26803 ts_tablet_manager.cc:1434] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:06:45.924427 26802 raft_consensus.cc:359] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.925108 26802 raft_consensus.cc:385] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.925365 26802 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.925490 26801 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:45.926055 26801 ts_tablet_manager.cc:1403] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.296s	user 0.071s	sys 0.190s
I20260709 13:06:45.925537 26803 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:45.926087 26802 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.928263 26802 ts_tablet_manager.cc:1434] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:06:45.929162 26802 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:45.930047 26801 raft_consensus.cc:359] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.930696 26801 raft_consensus.cc:385] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.930944 26801 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.931559 26801 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.933650 26801 ts_tablet_manager.cc:1434] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:45.934531 26801 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:45.935696 26844 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.940563 26801 tablet_bootstrap.cc:654] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.940634 26510 catalog_manager.cc:5697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.942144 26829 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.953161 26612 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:45.954749 26809 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.956020 26902 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.955219 26809 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.960489 26809 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:45.962349 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:45.963605 26803 tablet_bootstrap.cc:654] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.964113 26609 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:06:45.968266 26650 leader_election.cc:343] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.970734 26829 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.980406 26803 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:45.981009 26803 ts_tablet_manager.cc:1403] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.000s
I20260709 13:06:45.986148 26803 raft_consensus.cc:359] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.987007 26803 raft_consensus.cc:385] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.987325 26803 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.988186 26803 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:45.997987 26803 ts_tablet_manager.cc:1434] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:45.999213 26803 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.007489 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.008213 26760 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:46.027347 26809 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.027951 26809 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.041054 26651 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.043588 26803 tablet_bootstrap.cc:654] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.048059 26972 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.048507 26972 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.048892 26972 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:46.036423 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61104us
I20260709 13:06:46.051622 26809 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.051828 26848 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.067183 26848 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.069330 26848 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.056453 26610 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.054692 26802 tablet_bootstrap.cc:654] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.059758 26760 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:46.056838 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:46.082722 26972 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.085013 26809 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.085727 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153347us
I20260709 13:06:46.085541 26809 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.088444 26972 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.088630 26809 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.107025 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:46.098660 26944 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.121075 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:46.115078 26944 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.124600 26944 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.129257 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:46.130687 26650 leader_election.cc:343] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.135653 26990 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.136523 26801 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:46.137719 26801 ts_tablet_manager.cc:1403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.203s	user 0.057s	sys 0.077s
I20260709 13:06:46.142573 26990 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.128785 26944 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.140117 26650 leader_election.cc:343] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.149885 26844 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.150380 26844 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.152812 26802 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:46.146100 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:46.153208 26802 ts_tablet_manager.cc:1403] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.013s
I20260709 13:06:46.145730 26944 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.157828 26944 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:46.159134 26724 leader_election.cc:343] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.159639 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.152573 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.153633 26844 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.153004 26611 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.155457 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:46.155946 26650 leader_election.cc:343] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.161582 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:46.164985 26724 consensus_peers.cc:597] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:46.166461 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:46.168035 26724 leader_election.cc:343] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:46.168362 26650 leader_election.cc:343] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.168516 26577 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:46.157828 26990 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:06:46.168756 26724 leader_election.cc:343] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.172708 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.173467 26758 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:46.181458 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.182106 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.182665 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:46.182665 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.190809 26684 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:46.191813 26758 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.193141 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.193823 26686 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:46.182737 26759 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:46.203339 26972 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:46.203989 26803 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:46.204452 26803 ts_tablet_manager.cc:1403] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.206s	user 0.017s	sys 0.007s
W20260709 13:06:46.205235 26651 leader_election.cc:343] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.205698 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:46.213788 26972 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.216150 26651 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.216928 26972 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.217286 26972 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.217609 26972 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.250766 26801 raft_consensus.cc:359] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.251552 26801 raft_consensus.cc:385] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.251857 26801 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.252501 26801 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.254189 26802 raft_consensus.cc:359] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.254894 26802 raft_consensus.cc:385] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.255162 26802 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.255393 26803 raft_consensus.cc:359] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.256052 26803 raft_consensus.cc:385] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.255825 26802 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.256333 26803 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.257004 26803 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.257493 26802 ts_tablet_manager.cc:1434] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:06:46.258405 26802 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:46.258997 26803 ts_tablet_manager.cc:1434] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:06:46.260912 26972 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.263625 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:46.264883 26802 tablet_bootstrap.cc:654] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.264809 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.266929 26999 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.267213 26801 ts_tablet_manager.cc:1434] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.129s	user 0.003s	sys 0.011s
I20260709 13:06:46.267329 26999 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.267810 26999 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.268232 26801 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
W20260709 13:06:46.267246 26650 leader_election.cc:343] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.274717 26758 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:46.275866 26801 tablet_bootstrap.cc:654] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:46.276557 26726 leader_election.cc:343] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.277019 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:46.278149 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.274741 26999 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.279584 26844 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.280093 26803 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.282572 26999 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.284899 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:46.286496 26650 leader_election.cc:343] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.287348 26994 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.290179 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:46.290788 26760 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.292096 26944 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.292448 26944 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.292773 26944 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.292837 26726 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.294077 26803 tablet_bootstrap.cc:654] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.295840 26829 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:46.297227 26829 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.297595 26829 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.297942 26829 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.301698 26944 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.312740 26829 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.314765 26801 tablet_bootstrap.cc:492] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:46.316195 26944 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.316414 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:46.318347 26760 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:06:46.325380 26724 leader_election.cc:343] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.320034 26801 ts_tablet_manager.cc:1403] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.009s
I20260709 13:06:46.321501 26829 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.330368 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:46.322539 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:46.331936 26724 leader_election.cc:343] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.330997 26760 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.335641 26651 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.337113 26803 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:46.330973 26801 raft_consensus.cc:359] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.337647 26803 ts_tablet_manager.cc:1403] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.009s
I20260709 13:06:46.337839 26801 raft_consensus.cc:385] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.338125 26801 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.341281 26999 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.341991 26999 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:46.342803 26999 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.339550 26801 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.350231 26803 raft_consensus.cc:359] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.350765 26801 ts_tablet_manager.cc:1434] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:06:46.350957 26803 raft_consensus.cc:385] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.351297 26803 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.351852 26760 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:46.262714 26972 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.347951 26651 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.352504 26803 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.354043 26801 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:46.355489 26972 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.356226 26802 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:46.356700 26802 ts_tablet_manager.cc:1403] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.009s
I20260709 13:06:46.356989 26803 ts_tablet_manager.cc:1434] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:06:46.357957 26803 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.356153 26972 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:46.360803 26972 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.362825 26801 tablet_bootstrap.cc:654] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.359215 26802 raft_consensus.cc:359] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.364938 26802 raft_consensus.cc:385] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.365213 26803 tablet_bootstrap.cc:654] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.365259 26802 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.366154 26802 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.368876 26802 ts_tablet_manager.cc:1434] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:46.371136 26802 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:46.372021 26801 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:46.372663 26801 ts_tablet_manager.cc:1403] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:06:46.416633 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:46.418058 26687 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.414336 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:46.435271 26990 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.436151 26990 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.438349 26803 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:46.439280 26803 ts_tablet_manager.cc:1403] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.003s
I20260709 13:06:46.439281 26508 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.446442 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.467461 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.453423 26994 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.470849 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58858.9us
I20260709 13:06:46.473709 26999 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.474351 26999 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:46.465830 26683 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.475706 27008 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:46.466917 26990 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.471095 26994 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.483731 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.485127 26759 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:06:46.491348 26994 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.491894 26576 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:46.493495 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.495520 26990 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.498059 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.476362 26999 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.504472 26801 raft_consensus.cc:359] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.505271 26801 raft_consensus.cc:385] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.505656 26801 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.506407 26801 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.527400 26687 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:46.521209 26801 ts_tablet_manager.cc:1434] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.148s	user 0.005s	sys 0.011s
I20260709 13:06:46.533226 26802 tablet_bootstrap.cc:654] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.516832 26803 raft_consensus.cc:359] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.536392 26803 raft_consensus.cc:385] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.545393 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.546813 26859 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.547451 26859 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:46.548487 26859 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.554745 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:46.536957 26803 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.559517 26801 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:46.561285 26854 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.561403 26803 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.569813 26990 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.574290 27008 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:46.576788 26683 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:46.594156 26610 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.596885 26726 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.598142 27008 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.598767 27008 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:46.599967 27008 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.603538 26803 ts_tablet_manager.cc:1434] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.003s
I20260709 13:06:46.628440 26803 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.649757 26803 tablet_bootstrap.cc:654] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.650197 26801 tablet_bootstrap.cc:654] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.651911 26802 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:46.652540 26802 ts_tablet_manager.cc:1403] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.282s	user 0.018s	sys 0.018s
I20260709 13:06:46.660861 26848 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.661628 26848 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.663373 26802 raft_consensus.cc:359] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.664127 26802 raft_consensus.cc:385] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.664305 26902 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.664455 26802 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.664507 26848 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.664927 26902 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.665349 26802 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.667191 26902 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.668463 26802 ts_tablet_manager.cc:1434] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:06:46.671145 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.672250 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:46.673674 26802 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:46.664918 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:46.680307 26650 leader_election.cc:343] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.672909 26758 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
W20260709 13:06:46.674371 26651 leader_election.cc:343] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.689314 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.690451 26999 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.692356 26999 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.692830 26999 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.693266 26802 tablet_bootstrap.cc:654] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.715348 26944 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.716058 26944 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.725126 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:46.725991 26608 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:46.727984 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:46.728917 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:46.732450 26848 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:46.737815 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:46.739713 26844 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.740186 26844 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.740595 26844 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.746646 26510 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.770234 26999 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.743752 26944 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.782500 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:46.783877 26650 leader_election.cc:343] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.784415 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:46.785907 26902 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.795096 26508 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.797536 26801 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:46.798336 26801 ts_tablet_manager.cc:1403] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.244s	user 0.049s	sys 0.033s
I20260709 13:06:46.797574 26508 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:46.801616 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48513.4us
I20260709 13:06:46.801898 26801 raft_consensus.cc:359] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.802830 26801 raft_consensus.cc:385] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.803211 26801 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.804548 26801 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.807331 26801 ts_tablet_manager.cc:1434] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:46.808535 26801 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
W20260709 13:06:46.811946 26650 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:46.812193 26510 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.816354 26844 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.819380 26803 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:46.819381 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:46.820350 26611 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.822121 26803 ts_tablet_manager.cc:1403] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.004s
I20260709 13:06:46.827914 26801 tablet_bootstrap.cc:654] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.830890 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:46.832291 26650 leader_election.cc:343] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.833585 26999 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:46.833488 26803 raft_consensus.cc:359] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.834396 26803 raft_consensus.cc:385] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.834700 26803 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.834854 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:46.835441 26758 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.835419 26803 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.837790 26803 ts_tablet_manager.cc:1434] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:46.838955 26803 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.843961 26758 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:46.845376 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:46.846696 26999 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.847211 26999 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:46.848153 26999 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.852322 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:46.853088 26683 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.862151 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:46.863430 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:46.864631 26829 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:46.865109 26829 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:46.865962 26829 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.874663 26611 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:46.875995 26803 tablet_bootstrap.cc:654] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.877302 26844 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:46.892735 26848 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:46.903632 26803 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:46.904297 26803 ts_tablet_manager.cc:1403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.004s
I20260709 13:06:46.912531 26803 raft_consensus.cc:359] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.913558 26803 raft_consensus.cc:385] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.913934 26803 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
W20260709 13:06:46.916486 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:46.920286 26508 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.914876 26803 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.929543 26803 ts_tablet_manager.cc:1434] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:06:46.930665 26803 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:46.933682 26999 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:46.934824 26802 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:46.935299 26802 ts_tablet_manager.cc:1403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.265s	user 0.050s	sys 0.101s
I20260709 13:06:46.943416 26508 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:46.949891 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:46.950965 26802 raft_consensus.cc:359] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.951958 26802 raft_consensus.cc:385] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.952301 26802 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.953148 26802 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.956094 26802 ts_tablet_manager.cc:1434] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:06:46.957803 26802 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:46.960129 26803 tablet_bootstrap.cc:654] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.967876 26802 tablet_bootstrap.cc:654] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.968708 26801 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:46.969143 26801 ts_tablet_manager.cc:1403] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.161s	user 0.027s	sys 0.025s
I20260709 13:06:46.973049 26801 raft_consensus.cc:359] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.973794 26801 raft_consensus.cc:385] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.974094 26801 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.974817 26801 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:46.989964 26801 ts_tablet_manager.cc:1434] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:06:47.007210 26803 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.007787 26803 ts_tablet_manager.cc:1403] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.008s
I20260709 13:06:47.012382 26848 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.013083 26848 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.016347 26854 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.016891 26854 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.017266 26803 raft_consensus.cc:359] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.018033 26803 raft_consensus.cc:385] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.018314 26803 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.019039 26803 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.022325 26994 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.022521 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.022837 26994 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.024430 26803 ts_tablet_manager.cc:1434] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:47.025045 26994 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.025524 26803 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.026309 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.028004 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.029038 26684 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:47.029982 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.030797 26683 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:47.031658 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:47.034830 26848 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.037221 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:47.040539 26651 leader_election.cc:343] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.048758 26650 leader_election.cc:343] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.049257 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.052728 26999 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.053382 26829 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.053843 26829 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.055656 26829 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.044473 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.019536 26854 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.059888 26994 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.067934 26801 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.069998 26802 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.070391 26802 ts_tablet_manager.cc:1403] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.040s
I20260709 13:06:47.069464 26829 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.071470 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.072993 26724 leader_election.cc:343] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.075367 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.076375 26684 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:47.079034 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.080018 26829 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.063405 26577 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.080369 26829 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.080720 26829 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.081414 26854 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.088532 26994 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.089172 26854 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.093431 26803 tablet_bootstrap.cc:654] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.096385 26829 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:47.098227 26650 consensus_peers.cc:597] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.099059 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:47.100437 26724 leader_election.cc:343] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.102718 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.103248 26684 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.109280 26684 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.109863 26802 raft_consensus.cc:359] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.110586 26802 raft_consensus.cc:385] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.110486 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.110841 26802 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.111408 26844 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.111953 26844 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.111790 26802 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.112773 26844 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.116384 26801 tablet_bootstrap.cc:654] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.124163 26944 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.126890 26802 ts_tablet_manager.cc:1434] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:06:47.128577 26802 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.129652 26803 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.130100 26803 ts_tablet_manager.cc:1403] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.000s
I20260709 13:06:47.132710 26803 raft_consensus.cc:359] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.133380 26803 raft_consensus.cc:385] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.133641 26803 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.134277 26803 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.134829 26802 tablet_bootstrap.cc:654] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.136912 26803 ts_tablet_manager.cc:1434] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:47.137521 26829 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.141345 26803 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.140000 26801 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.143055 26801 ts_tablet_manager.cc:1403] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.005s
I20260709 13:06:47.143748 26847 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:47.150451 26801 raft_consensus.cc:359] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.163216 26801 raft_consensus.cc:385] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.163601 26801 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.168219 26801 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.172561 26801 ts_tablet_manager.cc:1434] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:06:47.175345 26803 tablet_bootstrap.cc:654] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.186277 26829 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.185228 26510 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.189023 26803 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.189602 26803 ts_tablet_manager.cc:1403] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 13:06:47.191358 26847 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.193686 26847 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.196493 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.197875 26650 leader_election.cc:343] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.198802 26847 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.199555 26847 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.200083 26847 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.202948 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:47.204010 26847 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:06:47.204284 26650 leader_election.cc:343] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.206372 26803 raft_consensus.cc:359] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.207113 26803 raft_consensus.cc:385] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.207449 26803 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.208199 26803 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.218114 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.218434 26802 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.218953 26802 ts_tablet_manager.cc:1403] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.091s	user 0.030s	sys 0.045s
I20260709 13:06:47.221071 26803 ts_tablet_manager.cc:1434] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:06:47.222020 26802 raft_consensus.cc:359] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.222779 26802 raft_consensus.cc:385] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.223054 26802 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.223789 26802 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.226195 26802 ts_tablet_manager.cc:1434] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:06:47.227303 26802 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.228705 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.230252 26994 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.230760 26994 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.233006 26994 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.233757 26802 tablet_bootstrap.cc:654] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.235999 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.236421 26844 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.237177 26844 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.240325 26844 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.241529 26847 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.242254 26847 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.242587 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.245898 26724 leader_election.cc:343] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.246025 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.249089 26650 leader_election.cc:343] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.248952 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.250892 26611 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.251914 26576 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.259877 26999 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.260418 26999 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.262454 26999 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.264724 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.266619 26650 leader_election.cc:343] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.267789 26847 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.234587 26801 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.279736 26829 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.280486 26829 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.283285 26829 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:47.285491 26651 leader_election.cc:343] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.285905 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.289934 26803 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.290910 26999 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:47.291798 26651 leader_election.cc:343] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.292284 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.297482 26972 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.298897 26801 tablet_bootstrap.cc:654] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.304378 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.306540 26724 leader_election.cc:343] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.306807 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.309172 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.314328 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.315102 26683 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:47.319088 26803 tablet_bootstrap.cc:654] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.324894 26802 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.325487 26802 ts_tablet_manager.cc:1403] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.098s	user 0.030s	sys 0.056s
I20260709 13:06:47.328011 26847 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.328634 26847 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.328279 26802 raft_consensus.cc:359] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.332763 26802 raft_consensus.cc:385] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.333076 26802 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.333763 26802 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.335391 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.336995 26650 leader_election.cc:343] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.338075 26847 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.344403 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.345289 26687 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:47.346019 26802 ts_tablet_manager.cc:1434] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
W20260709 13:06:47.350065 26651 leader_election.cc:343] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.350557 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.351915 26802 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.350339 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:06:47.352536 26651 leader_election.cc:343] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.352874 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.353853 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.356184 26999 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.356333 26902 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.356751 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.356436 26844 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.357898 26844 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.357820 26760 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:47.358281 26844 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.359685 27008 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.360363 27008 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.363540 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.364429 27030 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.365880 26854 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.368260 26801 tablet_bootstrap.cc:492] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.368814 26801 ts_tablet_manager.cc:1403] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.006s
I20260709 13:06:47.362164 26944 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.371313 26944 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.371850 26944 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.373585 26848 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.376228 26848 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.379468 27008 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.382308 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:47.380391 26801 raft_consensus.cc:359] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.376609 26848 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.384034 26801 raft_consensus.cc:385] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.388137 26801 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.388568 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:47.387120 26650 consensus_peers.cc:597] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.388810 26801 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:47.388705 26724 leader_election.cc:343] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.391892 26687 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:47.400861 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.401858 27030 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.402366 27030 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.402758 27030 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.412478 26944 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.418728 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:47.415176 26803 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.419992 26803 ts_tablet_manager.cc:1403] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.009s
W20260709 13:06:47.420250 26724 leader_election.cc:343] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.416430 26801 ts_tablet_manager.cc:1434] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:06:47.428154 26859 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.428695 26859 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.431183 26844 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.399243 26848 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.435528 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:47.436559 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.438066 26724 leader_election.cc:343] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.438385 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:47.438974 26650 leader_election.cc:343] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.441188 26724 leader_election.cc:343] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.441268 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.442061 26687 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:47.443599 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.445735 26801 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.446722 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.447348 26687 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.447610 26803 raft_consensus.cc:359] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.448556 26803 raft_consensus.cc:385] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.448892 26803 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.449721 26803 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.450843 27008 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.451354 27008 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.439738 26859 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.457422 26803 ts_tablet_manager.cc:1434] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.005s
I20260709 13:06:47.458495 26687 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.460711 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.452291 26844 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.464583 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:47.465153 26760 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.454989 27008 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.462423 26944 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.472610 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.473133 26687 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.482000 26803 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.501030 26760 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:47.497208 26687 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.469230 26859 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.507349 26859 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.508277 26859 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.462729 26848 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.511698 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.514005 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.522025 26801 tablet_bootstrap.cc:654] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.484071 26847 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:06:47.513134 26844 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.524501 26612 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.524703 26844 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.526984 26844 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.530335 26802 tablet_bootstrap.cc:654] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.517313 26848 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.536196 27008 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.538232 27008 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.482000 27030 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.540375 27030 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.541268 27030 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.543040 26848 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:47.544466 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:47.544524 26848 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.546651 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:47.547823 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.548434 26684 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.540270 27054 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:47.552959 26724 leader_election.cc:343] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.553650 26724 leader_election.cc:343] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.556166 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.560998 26687 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.570518 26687 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.572149 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.573241 26829 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.573738 26829 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.574427 26684 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.574999 26803 tablet_bootstrap.cc:654] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.575131 26829 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.576659 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.598296 27057 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.598847 27057 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.599618 26801 tablet_bootstrap.cc:492] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.599792 27057 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.604671 26801 ts_tablet_manager.cc:1403] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.011s
I20260709 13:06:47.617414 26801 raft_consensus.cc:359] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.618471 26801 raft_consensus.cc:385] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.619356 26801 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.624508 26847 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.624537 26801 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.625032 26847 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.632737 26847 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.633379 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.634591 26650 leader_election.cc:343] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.637651 26610 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.647754 26801 ts_tablet_manager.cc:1434] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:06:47.650331 26801 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.654992 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.648895 26803 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.657060 26507 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:47.659435 26651 leader_election.cc:343] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.659909 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.660692 26803 ts_tablet_manager.cc:1403] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.007s
I20260709 13:06:47.661744 26848 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.669721 26801 tablet_bootstrap.cc:654] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.670243 26803 raft_consensus.cc:359] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.674296 26803 raft_consensus.cc:385] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.676895 26803 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.678014 26803 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.678218 26859 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.684624 26510 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.687005 26803 ts_tablet_manager.cc:1434] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:06:47.693478 26803 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.699327 26803 tablet_bootstrap.cc:654] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.672724 26802 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.702853 26802 ts_tablet_manager.cc:1403] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.351s	user 0.010s	sys 0.019s
I20260709 13:06:47.705778 26802 raft_consensus.cc:359] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.706534 26802 raft_consensus.cc:385] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.706847 26802 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.707512 26802 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.709604 26802 ts_tablet_manager.cc:1434] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:06:47.710644 26802 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.713569 26509 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.718501 26509 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.728247 26803 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.731127 26803 ts_tablet_manager.cc:1403] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.038s	user 0.002s	sys 0.008s
I20260709 13:06:47.730476 26801 tablet_bootstrap.cc:492] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.731796 26801 ts_tablet_manager.cc:1403] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.003s
I20260709 13:06:47.734498 26801 raft_consensus.cc:359] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.739820 26801 raft_consensus.cc:385] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.740219 26801 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.741490 26802 tablet_bootstrap.cc:654] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.744992 26509 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.741940 26801 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.749794 26801 ts_tablet_manager.cc:1434] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:06:47.750954 26801 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.738250 26803 raft_consensus.cc:359] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.751888 26803 raft_consensus.cc:385] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.752262 26803 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.753338 26803 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.755488 26803 ts_tablet_manager.cc:1434] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.004s
I20260709 13:06:47.756572 26803 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.760905 26801 tablet_bootstrap.cc:654] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.781731 26803 tablet_bootstrap.cc:654] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.784725 26802 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.785276 26802 ts_tablet_manager.cc:1403] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.011s
I20260709 13:06:47.786865 26801 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.787318 26801 ts_tablet_manager.cc:1403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.004s
I20260709 13:06:47.799333 26801 raft_consensus.cc:359] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.793728 26802 raft_consensus.cc:359] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.800436 26801 raft_consensus.cc:385] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.800853 26801 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.800863 26802 raft_consensus.cc:385] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.801579 26802 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.801661 26801 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.802453 26802 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.803797 26801 ts_tablet_manager.cc:1434] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.007s
I20260709 13:06:47.804549 26802 ts_tablet_manager.cc:1434] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:06:47.805109 26801 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.814558 26801 tablet_bootstrap.cc:654] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.815793 26802 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.825002 26802 tablet_bootstrap.cc:654] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.839224 26801 tablet_bootstrap.cc:492] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.839766 26801 ts_tablet_manager.cc:1403] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:06:47.842347 26801 raft_consensus.cc:359] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.843040 26801 raft_consensus.cc:385] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.843302 26801 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.843964 26801 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.845288 26803 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.845824 26803 ts_tablet_manager.cc:1403] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.032s
I20260709 13:06:47.848621 26801 ts_tablet_manager.cc:1434] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:06:47.848589 26803 raft_consensus.cc:359] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.849490 26803 raft_consensus.cc:385] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.849746 26801 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.849846 26803 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.850672 26803 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.851140 26802 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.851727 26802 ts_tablet_manager.cc:1403] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 13:06:47.852979 26803 ts_tablet_manager.cc:1434] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:47.854478 26802 raft_consensus.cc:359] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.855237 26802 raft_consensus.cc:385] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.855502 26802 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.858397 26803 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.856181 26802 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.861481 26802 ts_tablet_manager.cc:1434] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:47.862393 26802 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.864396 26801 tablet_bootstrap.cc:654] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.868767 26985 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.869279 26985 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.875890 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.876897 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.879386 26847 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.879963 26847 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.881610 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.882494 26985 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.884922 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:47.886322 26847 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.888844 26803 tablet_bootstrap.cc:654] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.888818 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:47.889585 26650 leader_election.cc:343] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.883001 26854 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:47.896126 26651 leader_election.cc:343] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.894737 26859 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.896523 26651 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.896698 26859 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.897471 26847 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.900285 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:47.900503 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:47.901062 26683 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
W20260709 13:06:47.901675 26724 leader_election.cc:343] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.902344 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.903234 27030 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.903312 26802 tablet_bootstrap.cc:654] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.903533 26801 tablet_bootstrap.cc:492] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.903604 27030 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.904099 26801 ts_tablet_manager.cc:1403] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.015s
I20260709 13:06:47.904048 27030 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.906828 26859 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.926738 26803 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:47.927245 26803 ts_tablet_manager.cc:1403] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.001s
I20260709 13:06:47.928866 26801 raft_consensus.cc:359] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.931860 26801 raft_consensus.cc:385] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.932168 26801 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.932608 26802 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:47.933065 26802 ts_tablet_manager.cc:1403] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260709 13:06:47.932957 26801 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.929731 26803 raft_consensus.cc:359] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.934758 26803 raft_consensus.cc:385] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.935070 26803 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.935822 26801 ts_tablet_manager.cc:1434] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:06:47.936120 27030 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.937286 26801 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.937549 26803 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.938771 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:47.940059 26724 leader_election.cc:343] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.937305 26802 raft_consensus.cc:359] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.941733 26802 raft_consensus.cc:385] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.943492 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:47.941975 26802 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.944150 26683 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.944715 26802 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.946450 26802 ts_tablet_manager.cc:1434] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:47.947427 26801 tablet_bootstrap.cc:654] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.947984 26803 ts_tablet_manager.cc:1434] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:47.948967 26803 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:47.950958 26683 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:47.952363 26802 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:47.952234 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:47.953208 26859 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.953696 26859 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:47.954479 26859 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.955744 26847 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.956151 26847 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.957496 27030 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:47.957885 26847 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:47.959746 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:47.960740 26724 consensus_peers.cc:597] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:47.962493 26650 leader_election.cc:343] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.966539 26802 tablet_bootstrap.cc:654] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.969944 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:47.972267 26803 tablet_bootstrap.cc:654] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.975535 26801 tablet_bootstrap.cc:492] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:47.976075 26801 ts_tablet_manager.cc:1403] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.001s
I20260709 13:06:47.978734 26801 raft_consensus.cc:359] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:47.979128 26651 leader_election.cc:343] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.979758 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:47.980821 26847 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.981592 26801 raft_consensus.cc:385] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.981978 26801 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.982764 26801 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:47.989506 26801 ts_tablet_manager.cc:1434] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:47.990532 26801 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:47.992093 26610 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.996690 26801 tablet_bootstrap.cc:654] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.002767 26803 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:48.003260 26803 ts_tablet_manager.cc:1403] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.002s
I20260709 13:06:48.005859 26803 raft_consensus.cc:359] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.005892 27057 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.006623 26803 raft_consensus.cc:385] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.006916 26803 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.006731 27057 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.009120 27057 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.010921 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.011583 26683 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:48.007568 26803 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.013218 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:48.013907 26829 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.014320 26829 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.014719 26829 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.015513 26801 tablet_bootstrap.cc:492] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:48.016898 26803 ts_tablet_manager.cc:1434] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:48.018026 26803 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:48.019927 26859 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.025102 26859 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.025750 26801 ts_tablet_manager.cc:1403] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.007s
I20260709 13:06:48.029338 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.030936 26801 raft_consensus.cc:359] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:48.032502 26724 leader_election.cc:343] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.033361 26801 raft_consensus.cc:385] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.034103 26801 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.037312 26801 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.042752 26801 ts_tablet_manager.cc:1434] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:48.046627 26859 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:48.053031 26859 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.052480 26508 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.055800 26803 tablet_bootstrap.cc:654] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.059257 26829 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.068409 26801 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:48.067576 26985 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.072996 26985 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.079777 26847 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.080399 26847 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.087018 26612 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.088442 26801 tablet_bootstrap.cc:654] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.088977 26847 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.112692 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:48.113615 26687 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.115747 26829 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.118810 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:48.119405 26611 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.107609 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.134123 26611 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:48.137734 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.138376 26609 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.143534 26651 leader_election.cc:343] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.145608 26829 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:48.144738 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:48.164552 26687 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
W20260709 13:06:48.160924 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:48.162693 26985 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.157601 26848 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:06:48.161365 27030 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:48.209491 27086 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:06:48.213459 26802 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:48.214097 26802 ts_tablet_manager.cc:1403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.262s	user 0.034s	sys 0.020s
I20260709 13:06:48.218645 26829 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.219098 26829 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.216375 27030 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:48.223205 26854 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.224040 26854 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.224104 27030 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.222307 26848 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.228534 26854 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.207417 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.230576 26802 raft_consensus.cc:359] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.225586 26848 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.240300 26829 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.248857 26803 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:48.249452 26803 ts_tablet_manager.cc:1403] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.232s	user 0.043s	sys 0.049s
I20260709 13:06:48.231477 26802 raft_consensus.cc:385] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.264537 26802 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.277842 26802 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.261071 27008 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.279724 26803 raft_consensus.cc:359] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.282130 26803 raft_consensus.cc:385] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.283242 27008 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.286211 26801 tablet_bootstrap.cc:492] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:48.282487 26803 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.287405 26801 ts_tablet_manager.cc:1403] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.011s
I20260709 13:06:48.285737 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.292151 26854 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.298409 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.299990 26854 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.302177 26854 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.308867 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:48.304610 26650 leader_election.cc:343] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.316743 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.305739 26682 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:48.323371 26802 ts_tablet_manager.cc:1434] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.006s
I20260709 13:06:48.327708 26801 raft_consensus.cc:359] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.328883 26801 raft_consensus.cc:385] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.329267 26801 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.331372 26801 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.319041 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.330843 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:48.334800 26650 consensus_peers.cc:597] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.323944 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.338254 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.339861 27094 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.344169 26802 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:48.321738 27096 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:48.351761 26724 leader_election.cc:343] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.354638 26803 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.353804 27054 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:48.356353 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.357445 27008 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.357936 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.358283 26848 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.352782 27057 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:48.360260 26577 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.363160 26803 ts_tablet_manager.cc:1434] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.113s	user 0.010s	sys 0.001s
I20260709 13:06:48.368014 27092 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:06:48.368005 27089 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:48.380671 26650 leader_election.cc:343] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.383270 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.393196 26801 ts_tablet_manager.cc:1434] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.000s
W20260709 13:06:48.394583 26724 leader_election.cc:343] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.393404 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:48.398608 26803 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:48.411300 26844 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.411937 26844 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.412385 26844 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.394016 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.423286 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.368636 27092 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.425737 27089 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.437656 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.443318 26604 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.445958 27054 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.453809 26686 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:48.455431 26612 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.459977 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:48.466914 26801 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
W20260709 13:06:48.470924 26651 leader_election.cc:343] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.471727 26651 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.474115 26847 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.471287 26508 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.481103 26829 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.481581 26829 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.488735 27092 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.495263 26829 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.509215 26847 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.509727 26847 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.519454 26847 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.512143 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.525185 27098 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.529350 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.534806 26682 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:48.567543 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:48.587693 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:48.561445 27098 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.610895 27103 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.615079 27096 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.583503 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:48.610967 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44841.7us
I20260709 13:06:48.618256 27098 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.627861 26651 leader_election.cc:343] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:48.628842 26724 leader_election.cc:343] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:48.630963 26724 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.635594 26802 tablet_bootstrap.cc:654] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.629945 27103 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.644879 26844 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:48.644536 27106 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:48.654597 26803 tablet_bootstrap.cc:654] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.638403 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.655453 27103 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.636077 27096 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.692060 27096 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.692399 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:48.693003 26686 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.695533 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:48.699105 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.695899 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:48.705621 26724 leader_election.cc:343] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.702780 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.706126 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.708027 27098 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.708779 27096 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.708081 26844 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.717188 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.722534 26985 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.734385 26609 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.723487 26650 leader_election.cc:343] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.736357 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.726287 26801 tablet_bootstrap.cc:654] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.742398 27113 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.744604 27098 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.746538 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:48.750481 26724 leader_election.cc:343] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.752096 27057 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.754254 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:48.756196 26685 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.756762 27112 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:48.740775 26686 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:48.751830 27103 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.773830 26685 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:48.775311 27103 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:48.787523 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:48.797662 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:48.802023 27115 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.802565 27115 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:48.802474 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:48.806409 27115 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.809341 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:48.803076 27057 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.811543 26684 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.814994 26801 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:48.815588 26801 ts_tablet_manager.cc:1403] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.349s	user 0.021s	sys 0.011s
I20260709 13:06:48.818931 27057 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:06:48.819181 26724 leader_election.cc:343] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.819885 27057 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.821010 26801 raft_consensus.cc:359] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.821687 26801 raft_consensus.cc:385] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.821950 26801 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.823635 26684 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:48.824519 26801 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.824846 27098 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.826819 26801 ts_tablet_manager.cc:1434] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:48.827159 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:48.828914 27103 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.827849 26801 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:48.839108 26803 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:48.839605 26803 ts_tablet_manager.cc:1403] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.452s	user 0.018s	sys 0.008s
I20260709 13:06:48.830853 27103 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:48.844445 27103 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.849246 26802 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:48.849766 26802 ts_tablet_manager.cc:1403] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.506s	user 0.009s	sys 0.020s
I20260709 13:06:48.849965 26803 raft_consensus.cc:359] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.851585 26803 raft_consensus.cc:385] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.852206 26803 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.852649 26802 raft_consensus.cc:359] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.852856 26803 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.853308 26802 raft_consensus.cc:385] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.853571 26802 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.854233 26802 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.857967 26803 ts_tablet_manager.cc:1434] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:48.864256 26802 ts_tablet_manager.cc:1434] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:06:48.873922 27096 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.874487 27096 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.877236 27096 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.878628 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:48.879021 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:48.879750 26683 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:48.881269 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:48.882082 27096 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.882414 27096 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.882699 27096 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.887391 26576 leader_election.cc:343] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.892052 26802 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:48.893726 26803 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:48.896620 26801 tablet_bootstrap.cc:654] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.901693 27096 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.913722 26803 tablet_bootstrap.cc:654] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.913858 27096 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:48.914517 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:48.916977 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:06:48.926503 26576 leader_election.cc:343] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.927224 26683 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.919911 26508 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.932691 26802 tablet_bootstrap.cc:654] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.928917 26508 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.937831 26508 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.942689 26801 tablet_bootstrap.cc:492] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:48.943137 26801 ts_tablet_manager.cc:1403] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.006s
I20260709 13:06:48.944092 26683 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:48.945236 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:48.945629 26801 raft_consensus.cc:359] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.946317 26801 raft_consensus.cc:385] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.946601 26801 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.950946 26803 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:48.951428 26803 ts_tablet_manager.cc:1403] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.005s
I20260709 13:06:48.954510 26803 raft_consensus.cc:359] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.955173 27096 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.955168 26803 raft_consensus.cc:385] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.955787 26803 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.956451 26803 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.956873 27096 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:48.957738 27096 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.958482 26803 ts_tablet_manager.cc:1434] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:06:48.947216 26801 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.961589 26802 tablet_bootstrap.cc:492] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:48.961992 26802 ts_tablet_manager.cc:1403] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:06:48.964299 26802 raft_consensus.cc:359] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.964928 26802 raft_consensus.cc:385] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.965185 26802 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.967303 26801 ts_tablet_manager.cc:1434] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:06:48.965785 26802 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.969111 26803 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:48.974315 26803 tablet_bootstrap.cc:654] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.975401 26510 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.977093 26802 ts_tablet_manager.cc:1434] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:06:48.978415 26802 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:48.981606 26801 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:48.984931 26803 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:48.987334 26803 ts_tablet_manager.cc:1403] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 13:06:48.990264 26802 tablet_bootstrap.cc:654] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.995707 26803 raft_consensus.cc:359] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.996436 26803 raft_consensus.cc:385] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.996731 26803 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.997390 26803 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:48.999439 26803 ts_tablet_manager.cc:1434] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.000s
I20260709 13:06:49.006660 26801 tablet_bootstrap.cc:654] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.008948 26803 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.009768 26802 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.010259 26802 ts_tablet_manager.cc:1403] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.008s
I20260709 13:06:49.013175 26802 raft_consensus.cc:359] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.013897 26802 raft_consensus.cc:385] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.014194 26802 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.014869 26803 tablet_bootstrap.cc:654] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.014876 26802 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.017625 26802 ts_tablet_manager.cc:1434] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:49.026877 26802 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.032801 26802 tablet_bootstrap.cc:654] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.039001 26801 tablet_bootstrap.cc:492] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:49.039441 26801 ts_tablet_manager.cc:1403] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.022s
I20260709 13:06:49.042408 26801 raft_consensus.cc:359] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.042937 26801 raft_consensus.cc:385] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.043175 26801 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.043771 26801 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.043987 26802 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.044862 26802 ts_tablet_manager.cc:1403] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:06:49.047454 26802 raft_consensus.cc:359] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.048115 26802 raft_consensus.cc:385] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.048377 26802 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.048980 26802 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.050900 26802 ts_tablet_manager.cc:1434] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:49.051863 26802 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.053933 26803 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.054420 26803 ts_tablet_manager.cc:1403] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 13:06:49.057020 26803 raft_consensus.cc:359] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.057485 26802 tablet_bootstrap.cc:654] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.057684 26803 raft_consensus.cc:385] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.057958 26803 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.059109 26803 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.060268 26801 ts_tablet_manager.cc:1434] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
W20260709 13:06:49.063521 26638 tablet.cc:2406] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:49.066998 26803 ts_tablet_manager.cc:1434] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:49.068125 26803 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.086006 26801 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:49.097364 27115 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.097656 26801 tablet_bootstrap.cc:654] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.097906 27115 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.101300 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.102145 26609 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:49.103749 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:49.104832 27057 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.105340 27057 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.105759 27057 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.128219 27115 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.130147 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.131068 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:49.147425 26972 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.147955 26972 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.149919 26972 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.151825 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:49.153369 26651 leader_election.cc:343] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.154942 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.156219 26650 leader_election.cc:343] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.156689 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.157680 26972 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.162299 27057 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.183516 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:49.184269 26609 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.184624 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:49.185217 26683 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.193418 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:49.195145 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:49.196120 27115 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.196604 27115 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:49.197396 27115 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.199774 27057 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.202181 26803 tablet_bootstrap.cc:654] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.203905 26609 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:49.210220 27057 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.210947 27057 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.214270 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.215397 27057 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.221910 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.222594 26683 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:49.224159 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:06:49.227283 26724 leader_election.cc:343] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.229324 26802 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.229781 26802 ts_tablet_manager.cc:1403] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.178s	user 0.031s	sys 0.039s
I20260709 13:06:49.226302 27103 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.231638 26508 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.227851 27057 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.234747 27057 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.236356 27057 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.237517 26609 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.233611 27103 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.243108 27057 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.242815 27098 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.245221 27103 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.247084 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.248541 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.249459 26685 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:06:49.249900 26802 raft_consensus.cc:359] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.250645 26802 raft_consensus.cc:385] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.250912 26802 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.252152 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:06:49.254016 26802 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.258589 26803 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.259058 26803 ts_tablet_manager.cc:1403] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.191s	user 0.023s	sys 0.008s
I20260709 13:06:49.253898 26844 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.263192 26803 raft_consensus.cc:359] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.265117 26802 ts_tablet_manager.cc:1434] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 13:06:49.266309 26802 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.265059 26803 raft_consensus.cc:385] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.269356 26803 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.269994 26803 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.271884 26803 ts_tablet_manager.cc:1434] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:06:49.272850 26803 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.276786 26844 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.279147 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:49.281600 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:49.279137 26801 tablet_bootstrap.cc:492] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:49.282196 26684 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:49.282662 26724 leader_election.cc:343] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.282820 26801 ts_tablet_manager.cc:1403] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.197s	user 0.057s	sys 0.060s
I20260709 13:06:49.293988 26801 raft_consensus.cc:359] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.295305 26684 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:49.295787 27057 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.296725 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.294685 26801 raft_consensus.cc:385] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.298029 26801 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.297459 27115 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.300216 27116 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.300345 27115 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:49.301630 27115 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.312479 26801 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.325855 26802 tablet_bootstrap.cc:654] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:49.340145 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:49.350664 26509 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.352357 26801 ts_tablet_manager.cc:1434] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:06:49.352913 26972 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.355208 26972 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.357450 26972 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.360186 26803 tablet_bootstrap.cc:654] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.361934 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.362368 26985 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.362686 26758 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:49.364487 26651 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:49.365286 26972 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.365871 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.369437 26650 leader_election.cc:343] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.370887 27116 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.366729 26972 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.374123 26972 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.372069 26801 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:49.384824 27057 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:49.413794 26985 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.414342 26985 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.414716 26972 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.424392 26847 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.424998 26847 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.431500 26803 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.432056 26803 ts_tablet_manager.cc:1403] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.159s	user 0.008s	sys 0.008s
I20260709 13:06:49.434794 26972 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.434989 26985 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.435642 26847 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.434707 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:49.438180 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.440915 26650 leader_election.cc:343] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.440203 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.446542 26847 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.447003 26847 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.440234 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:49.448684 26759 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.444440 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.449483 26684 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:06:49.451169 26650 leader_election.cc:343] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.453517 26972 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.453964 26972 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.457257 27030 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.457744 27030 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.459447 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.460796 26650 leader_election.cc:343] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.461277 26803 raft_consensus.cc:359] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.461901 26803 raft_consensus.cc:385] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.462219 26803 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
W20260709 13:06:49.461810 26651 leader_election.cc:343] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.460721 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.463507 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.462839 26803 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.465764 26847 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.466652 26972 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.469753 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.470685 27094 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.470871 26802 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
W20260709 13:06:49.471107 26650 leader_election.cc:343] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.471309 26802 ts_tablet_manager.cc:1403] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.205s	user 0.021s	sys 0.006s
I20260709 13:06:49.480537 26803 ts_tablet_manager.cc:1434] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.001s
I20260709 13:06:49.460667 27030 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.490260 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.490792 26607 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.490702 26759 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:49.492224 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.492221 26724 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.502043 26803 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.503269 26802 raft_consensus.cc:359] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.504801 26802 raft_consensus.cc:385] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.505102 26802 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.509724 26802 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.518143 26985 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.521373 26801 tablet_bootstrap.cc:654] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:49.514755 26724 leader_election.cc:343] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.527063 26802 ts_tablet_manager.cc:1434] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:06:49.529131 27030 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.534422 26803 tablet_bootstrap.cc:654] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:49.535501 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 70064.4us
I20260709 13:06:49.540737 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.541388 26761 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 0.
I20260709 13:06:49.543467 26802 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.552330 26651 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.548157 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.556622 26684 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:49.562656 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.568132 27148 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.568737 27148 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:49.569590 27094 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.569577 27148 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.570313 27094 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.572376 27094 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.574110 26651 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.575052 27094 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.575431 27094 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.575788 27094 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.581717 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.581718 27092 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:06:49.584908 26650 leader_election.cc:343] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:49.586469 26651 leader_election.cc:343] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.587568 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.595417 26803 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.596534 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.597927 27103 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.598057 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.598332 27103 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.598714 27103 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.592655 26972 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.599395 26972 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.599581 27098 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.601399 26972 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.592825 27149 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:49.603019 26651 leader_election.cc:343] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.604197 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.603432 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.606133 27149 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.610294 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.614846 26803 ts_tablet_manager.cc:1403] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.002s
W20260709 13:06:49.608108 26651 leader_election.cc:343] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:49.620131 26650 leader_election.cc:343] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.617062 26509 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.620692 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.641168 26801 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:49.641644 26801 ts_tablet_manager.cc:1403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.270s	user 0.026s	sys 0.026s
I20260709 13:06:49.641929 26803 raft_consensus.cc:359] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.642613 26803 raft_consensus.cc:385] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.642860 26803 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.629449 27148 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.592618 27094 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.691897 26803 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.647655 26801 raft_consensus.cc:359] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.694617 26801 raft_consensus.cc:385] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.694986 26801 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.637943 27103 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.698087 27103 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.700891 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:49.703192 26724 leader_election.cc:343] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.706183 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:49.706854 26684 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.716223 26802 tablet_bootstrap.cc:654] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.721091 26803 ts_tablet_manager.cc:1434] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:06:49.726294 26801 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.728848 26803 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
W20260709 13:06:49.732924 26724 consensus_peers.cc:597] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.737946 26684 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:49.739890 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.744239 27116 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.744721 27116 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:49.745536 27116 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.747332 26801 ts_tablet_manager.cc:1434] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.011s
I20260709 13:06:49.748159 26802 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.748379 26801 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:49.749858 26802 ts_tablet_manager.cc:1403] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.009s
I20260709 13:06:49.766726 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:49.768114 26650 leader_election.cc:343] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.767318 27094 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.772925 26802 raft_consensus.cc:359] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.773633 26802 raft_consensus.cc:385] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.773902 26802 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.774715 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:49.775300 26757 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.780695 27057 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.782214 26803 tablet_bootstrap.cc:654] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.782621 26802 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.785820 26801 tablet_bootstrap.cc:654] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.787726 26803 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.788188 26803 ts_tablet_manager.cc:1403] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.007s
I20260709 13:06:49.789427 26802 ts_tablet_manager.cc:1434] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:06:49.790398 26802 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.796521 26803 raft_consensus.cc:359] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.797220 26803 raft_consensus.cc:385] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.797556 26803 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.798506 26803 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.801251 26803 ts_tablet_manager.cc:1434] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:06:49.802222 26803 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.807926 26803 tablet_bootstrap.cc:654] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.809481 26757 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:06:49.810577 26651 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:49.811338 26972 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.811970 26972 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:06:49.812737 26510 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.813041 26972 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.819523 26802 tablet_bootstrap.cc:654] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.820024 26801 tablet_bootstrap.cc:492] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:49.820503 26801 ts_tablet_manager.cc:1403] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 13:06:49.825306 26803 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.825747 26803 ts_tablet_manager.cc:1403] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 13:06:49.828193 26803 raft_consensus.cc:359] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.828867 26803 raft_consensus.cc:385] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.828203 26801 raft_consensus.cc:359] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.829161 26803 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.829411 26801 raft_consensus.cc:385] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.829857 26801 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.830571 26801 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.833112 26802 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.833532 26802 ts_tablet_manager.cc:1403] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:06:49.834208 26801 ts_tablet_manager.cc:1434] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:49.836197 26801 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:49.836128 26802 raft_consensus.cc:359] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.836867 26802 raft_consensus.cc:385] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.837141 26802 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.837926 26803 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.840422 26803 ts_tablet_manager.cc:1434] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:49.841478 27150 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.841998 27150 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.842104 26802 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.844357 27150 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.845395 26803 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.847617 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.847990 26802 ts_tablet_manager.cc:1434] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:06:49.848929 26802 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.849028 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.849915 26685 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:49.851022 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.852274 27150 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.866590 26803 tablet_bootstrap.cc:654] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.869704 26802 tablet_bootstrap.cc:654] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.869637 26972 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.870223 26972 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.873850 26972 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.876698 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:49.878767 26650 leader_election.cc:343] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.881294 26844 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.883132 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:49.886536 26651 leader_election.cc:343] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.887295 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.887863 26510 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.889317 27148 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.902273 26608 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.912353 26801 tablet_bootstrap.cc:654] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.916242 27150 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.918776 26802 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.924821 26802 ts_tablet_manager.cc:1403] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.007s
I20260709 13:06:49.927358 26803 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.927983 26803 ts_tablet_manager.cc:1403] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.004s
I20260709 13:06:49.927747 26802 raft_consensus.cc:359] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.928655 26802 raft_consensus.cc:385] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.929284 26802 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.930056 26802 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.930680 26803 raft_consensus.cc:359] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.931339 26803 raft_consensus.cc:385] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.931605 26803 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.932542 26802 ts_tablet_manager.cc:1434] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:49.932333 26803 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.937284 26802 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:49.938719 26803 ts_tablet_manager.cc:1434] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:49.944082 26803 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
I20260709 13:06:49.956674 26802 tablet_bootstrap.cc:654] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.956674 26803 tablet_bootstrap.cc:654] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.966720 26972 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.967285 26972 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.968070 26801 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:49.968075 26803 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:49.968657 26801 ts_tablet_manager.cc:1403] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.006s
I20260709 13:06:49.968657 26803 ts_tablet_manager.cc:1403] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:06:49.969736 26972 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.971407 26803 raft_consensus.cc:359] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.971606 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:49.972098 26803 raft_consensus.cc:385] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.972385 26803 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.973120 26803 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.974849 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:49.975945 26803 ts_tablet_manager.cc:1434] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:49.976939 26803 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Bootstrap starting.
W20260709 13:06:49.977272 26650 leader_election.cc:343] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:49.978230 26651 leader_election.cc:343] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.978650 26651 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:49.979897 27094 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.971529 26801 raft_consensus.cc:359] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.981076 26801 raft_consensus.cc:385] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.981400 26801 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.982187 26801 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.983467 26803 tablet_bootstrap.cc:654] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.984663 26801 ts_tablet_manager.cc:1434] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:06:49.985667 26801 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:49.990284 27103 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.990953 27103 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.992549 26972 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.993053 26972 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:49.993718 27103 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:49.994393 26802 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:49.994797 26802 ts_tablet_manager.cc:1403] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 13:06:49.995714 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:49.996311 26683 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:49.997768 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:49.998464 27103 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.998787 27103 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.999001 26972 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:49.999090 27103 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.002966 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.004172 26802 raft_consensus.cc:359] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.000463 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.004868 26802 raft_consensus.cc:385] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.005165 26802 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
W20260709 13:06:50.005882 26650 leader_election.cc:343] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.005769 26802 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:50.008247 26724 leader_election.cc:343] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.009865 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.010629 26801 tablet_bootstrap.cc:654] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:50.011066 26651 leader_election.cc:343] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.011457 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.014986 26803 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: No bootstrap required, opened a new log
I20260709 13:06:50.015460 26803 ts_tablet_manager.cc:1403] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 13:06:50.017345 26802 ts_tablet_manager.cc:1434] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:06:50.018486 26802 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.024292 27094 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.024286 26802 tablet_bootstrap.cc:654] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.045596 27103 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.050518 26972 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.052358 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:50.062904 26802 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.063411 26802 ts_tablet_manager.cc:1403] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.012s
I20260709 13:06:50.069398 26803 raft_consensus.cc:359] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.077301 26803 raft_consensus.cc:385] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.075330 26802 raft_consensus.cc:359] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.076759 26972 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.080034 26802 raft_consensus.cc:385] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.080212 26972 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.079908 26803 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.080394 26802 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.081539 26803 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.081552 26802 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.082938 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.083487 26683 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.083808 26802 ts_tablet_manager.cc:1434] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:06:50.086659 26802 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.088732 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:50.090417 26650 leader_election.cc:343] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.092340 26650 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.092695 26801 tablet_bootstrap.cc:492] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
W20260709 13:06:50.070758 26724 leader_election.cc:343] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.093191 26801 ts_tablet_manager.cc:1403] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.027s
I20260709 13:06:50.102356 26683 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.080569 27103 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.095079 26803 ts_tablet_manager.cc:1434] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.002s
I20260709 13:06:50.096199 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.104948 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.094842 26972 leader_election.cc:290] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:06:50.106820 26651 leader_election.cc:343] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.107285 26651 leader_election.cc:304] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.110433 26802 tablet_bootstrap.cc:654] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.110850 26972 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.111923 27116 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.113312 26801 raft_consensus.cc:359] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.115005 26801 raft_consensus.cc:385] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.115324 26801 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.116822 27116 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.118287 27116 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.116839 26801 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.130926 26801 ts_tablet_manager.cc:1434] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:06:50.132041 26801 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.138228 26801 tablet_bootstrap.cc:654] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.144956 26802 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.146100 26802 ts_tablet_manager.cc:1403] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:06:50.152662 26801 tablet_bootstrap.cc:492] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.156040 26801 ts_tablet_manager.cc:1403] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 13:06:50.158509 26802 raft_consensus.cc:359] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.163527 26802 raft_consensus.cc:385] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.163925 26802 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.164196 27030 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.161552 26801 raft_consensus.cc:359] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.164805 26801 raft_consensus.cc:385] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.164664 27030 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.165104 26801 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.165777 26801 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.166658 27030 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.167833 26801 ts_tablet_manager.cc:1434] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:06:50.164659 26802 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.169606 26801 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.169854 27116 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.169492 26508 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.170296 27116 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.176563 26608 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.180007 27150 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.180506 27150 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.182446 27150 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.185380 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.186005 26683 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:50.186275 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.186028 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.186882 26684 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:50.187175 26759 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:50.188342 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:50.188916 26801 tablet_bootstrap.cc:654] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.191875 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.192276 26844 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.191906 27151 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.192687 26844 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.193008 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.193055 27151 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.193759 27151 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.194559 26844 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.200412 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:50.201174 27103 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.201313 26801 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.201565 27103 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.201805 26801 ts_tablet_manager.cc:1403] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.011s
I20260709 13:06:50.201915 27103 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:50.202662 26650 consensus_peers.cc:597] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.204735 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.206080 27116 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.206812 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.207381 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:50.204614 26801 raft_consensus.cc:359] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:50.207935 26724 leader_election.cc:343] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.208467 26801 raft_consensus.cc:385] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:50.209020 26724 leader_election.cc:343] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.209470 26801 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.209565 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.208206 27151 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.210127 26683 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
W20260709 13:06:50.210973 26724 leader_election.cc:343] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.212110 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.210875 26801 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.214002 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.214605 26801 ts_tablet_manager.cc:1434] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:06:50.214500 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:50.215730 26802 ts_tablet_manager.cc:1434] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:06:50.215865 26759 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.216773 27151 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.214566 26685 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.218858 27103 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.220875 27103 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.222721 26759 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:50.214002 27030 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.223286 27030 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.223639 27030 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.224448 26685 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:50.225781 26577 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:50.226147 26801 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.228410 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.228971 26683 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.229354 26802 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.232546 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.233870 26844 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.234373 26844 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.234697 26844 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.233925 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:50.235291 27057 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.239349 27098 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.239873 27098 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.240641 26844 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.241809 27098 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.242429 26844 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:50.243729 26724 leader_election.cc:343] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.245406 26801 tablet_bootstrap.cc:654] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.245882 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:50.246146 26610 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:50.252043 26724 leader_election.cc:343] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.255295 26683 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.258296 27098 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.245528 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:50.263533 26724 leader_election.cc:343] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.264931 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.265542 26683 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:50.267336 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.267861 26683 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.268059 26801 tablet_bootstrap.cc:492] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.268627 26801 ts_tablet_manager.cc:1403] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.010s
I20260709 13:06:50.261929 27151 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.270704 27151 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:06:50.271165 26801 raft_consensus.cc:359] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.271958 26801 raft_consensus.cc:385] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.272351 26801 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.272039 27151 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.273368 26801 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.275542 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.276605 27098 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.276803 26801 ts_tablet_manager.cc:1434] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:50.277082 27098 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.277799 26801 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.267916 27030 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.277896 27098 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.280723 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:50.282495 26724 leader_election.cc:343] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.284052 27030 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.284390 26801 tablet_bootstrap.cc:654] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.285383 26972 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.285923 26972 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.288079 26972 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.289212 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.289799 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:06:50.290877 26650 leader_election.cc:343] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.291458 27030 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.292078 27030 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.292593 27030 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.295368 26801 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.295872 26801 ts_tablet_manager.cc:1403] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:06:50.296211 26508 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.298568 26801 raft_consensus.cc:359] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.299223 26801 raft_consensus.cc:385] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.299540 26801 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.300405 26801 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.301481 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.302656 26801 ts_tablet_manager.cc:1434] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:50.303653 26801 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.310607 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.311251 26682 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.311643 26801 tablet_bootstrap.cc:654] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.313192 27030 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.318415 26802 tablet_bootstrap.cc:654] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.350760 26802 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.351512 26802 ts_tablet_manager.cc:1403] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.008s
I20260709 13:06:50.328421 26682 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.355362 26802 raft_consensus.cc:359] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.362684 26802 raft_consensus.cc:385] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.364099 26802 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.365345 26683 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.365196 26802 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.351130 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:50.370324 26724 leader_election.cc:343] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.375950 26802 ts_tablet_manager.cc:1434] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:06:50.377350 26802 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.385854 26802 tablet_bootstrap.cc:654] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.389673 27030 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.393379 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.395212 27116 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.397146 27116 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.398386 27116 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.406353 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.407467 27103 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.408144 27103 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.409323 27103 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.417003 26972 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.417822 26972 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.421583 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:06:50.423390 26650 leader_election.cc:343] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.427934 26651 leader_election.cc:343] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.422890 26972 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.443331 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.449028 26972 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.450140 26802 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.450605 26802 ts_tablet_manager.cc:1403] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.074s	user 0.035s	sys 0.021s
I20260709 13:06:50.452796 27094 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.474340 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.476222 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.482497 26685 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.474444 27151 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.488080 27151 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.490020 27151 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.491683 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.492473 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.493257 26682 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:50.495182 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.496214 26508 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:50.497848 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:50.500717 26651 leader_election.cc:343] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.502395 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.500785 27151 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.505016 26685 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.505861 26972 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.514303 26801 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.514842 26801 ts_tablet_manager.cc:1403] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.211s	user 0.061s	sys 0.026s
I20260709 13:06:50.517491 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.520243 27057 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.544142 26607 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.551432 26801 raft_consensus.cc:359] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.561234 26801 raft_consensus.cc:385] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.556265 26802 raft_consensus.cc:359] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.561970 26802 raft_consensus.cc:385] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.562242 26802 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.566743 26802 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.567505 26801 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.566598 27057 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.568326 26801 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.570528 26801 ts_tablet_manager.cc:1434] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 13:06:50.550947 27151 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.575521 26801 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.574409 26508 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.578128 27057 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.576959 26508 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.590406 26802 ts_tablet_manager.cc:1434] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.001s
I20260709 13:06:50.595151 26801 tablet_bootstrap.cc:654] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.594818 27103 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.606231 26802 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.600596 27196 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.606844 27196 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.611359 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.611544 27196 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.612228 26684 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:50.613632 26726 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:50.620769 26801 tablet_bootstrap.cc:492] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.621284 26801 ts_tablet_manager.cc:1403] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:06:50.623728 26801 raft_consensus.cc:359] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.624419 26801 raft_consensus.cc:385] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.624696 26801 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.624706 27195 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.637585 27195 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.638794 27195 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.632318 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:50.620788 26802 tablet_bootstrap.cc:654] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:50.643143 26724 leader_election.cc:343] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.634613 26844 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.632977 26801 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.656378 26801 ts_tablet_manager.cc:1434] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:50.657472 26801 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.662060 27195 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.662982 26801 tablet_bootstrap.cc:654] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.665082 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:06:50.666635 26724 leader_election.cc:343] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.667897 27195 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:50.671463 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:50.672181 26682 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.672704 27195 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.687006 26682 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:50.692880 26726 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:50.694880 27195 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.695425 27195 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:50.696388 27195 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.706278 27151 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.706985 27151 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.710553 27151 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.711655 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.723397 26510 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.724176 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.728381 26607 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.732096 26802 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.732631 26802 ts_tablet_manager.cc:1403] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.034s
I20260709 13:06:50.735323 26802 raft_consensus.cc:359] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.736074 26802 raft_consensus.cc:385] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.736361 26802 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.736248 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.737430 26802 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.738994 26802 ts_tablet_manager.cc:1434] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:50.739193 27092 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.739894 26802 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.749504 26603 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.784200 26802 tablet_bootstrap.cc:654] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.789430 26801 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.789917 26801 ts_tablet_manager.cc:1403] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.023s
I20260709 13:06:50.795821 26801 raft_consensus.cc:359] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.796487 27195 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.802145 26510 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.804210 26724 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.796525 26801 raft_consensus.cc:385] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.808075 26801 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.808758 26801 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.812947 26801 ts_tablet_manager.cc:1434] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:06:50.815407 26801 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.820742 26802 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.821328 26802 ts_tablet_manager.cc:1403] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.002s
I20260709 13:06:50.821412 26801 tablet_bootstrap.cc:654] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.834697 27151 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.830124 26802 raft_consensus.cc:359] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.836692 26802 raft_consensus.cc:385] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.852428 27150 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.853058 27150 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.854153 27092 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.855350 27150 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.856022 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.856796 26684 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:50.856962 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.858529 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.859546 27150 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.867364 27150 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.844228 26802 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.868692 26802 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.870875 26802 ts_tablet_manager.cc:1434] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.049s	user 0.001s	sys 0.003s
I20260709 13:06:50.871829 26802 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.875274 27103 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.886121 26802 tablet_bootstrap.cc:654] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.887455 26801 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.888540 26801 ts_tablet_manager.cc:1403] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.003s
I20260709 13:06:50.891453 26801 raft_consensus.cc:359] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.899712 26801 raft_consensus.cc:385] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.900082 26801 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.900610 27150 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.900799 26801 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.901120 27150 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.904991 27150 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:50.906517 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:50.906687 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:50.927539 26801 ts_tablet_manager.cc:1434] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.003s
I20260709 13:06:50.928076 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:50.928714 26801 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:50.929039 27150 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.943768 26610 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.945999 26802 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:50.946579 26802 ts_tablet_manager.cc:1403] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 13:06:50.949440 26801 tablet_bootstrap.cc:654] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.984797 26802 raft_consensus.cc:359] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.985678 26802 raft_consensus.cc:385] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.985984 26802 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.986716 26802 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:50.988919 26802 ts_tablet_manager.cc:1434] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 13:06:50.989894 26802 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Bootstrap starting.
I20260709 13:06:50.997426 26801 tablet_bootstrap.cc:492] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:50.997928 26801 ts_tablet_manager.cc:1403] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.008s
I20260709 13:06:51.003196 27195 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.003746 27195 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.004058 27196 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.005645 27195 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.012094 26802 tablet_bootstrap.cc:654] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.015374 26801 raft_consensus.cc:359] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.016119 26801 raft_consensus.cc:385] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.016398 26801 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.016852 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.017051 26801 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.017539 26686 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.019479 26801 ts_tablet_manager.cc:1434] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:06:51.020464 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:51.020807 26801 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:51.022756 26802 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: No bootstrap required, opened a new log
I20260709 13:06:51.026218 26802 ts_tablet_manager.cc:1403] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.001s
I20260709 13:06:51.028882 26802 raft_consensus.cc:359] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.029572 26802 raft_consensus.cc:385] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.035439 26801 tablet_bootstrap.cc:654] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.029846 26802 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.045648 26802 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.047243 26802 ts_tablet_manager.cc:1434] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:06:51.047327 26801 tablet_bootstrap.cc:492] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:51.047961 26801 ts_tablet_manager.cc:1403] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:06:51.050748 26801 raft_consensus.cc:359] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.051632 26801 raft_consensus.cc:385] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.052556 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.051996 26801 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.062569 26844 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.063143 26844 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.063539 26844 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.059595 26801 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.068105 26801 ts_tablet_manager.cc:1434] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:06:51.069478 26801 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:51.075937 26801 tablet_bootstrap.cc:654] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:51.087244 26724 leader_election.cc:343] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.088927 26801 tablet_bootstrap.cc:492] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:51.089541 26801 ts_tablet_manager.cc:1403] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
W20260709 13:06:51.090813 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47531.1us
I20260709 13:06:51.092612 26801 raft_consensus.cc:359] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.093523 26801 raft_consensus.cc:385] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.093861 26801 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.094661 26801 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.096498 26801 ts_tablet_manager.cc:1434] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:51.097481 26801 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:51.105957 26801 tablet_bootstrap.cc:654] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.118854 27103 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.126086 26801 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:51.128393 26801 ts_tablet_manager.cc:1403] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:06:51.131529 26801 raft_consensus.cc:359] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.132323 26801 raft_consensus.cc:385] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.132669 26801 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.133497 26801 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.135257 26801 ts_tablet_manager.cc:1434] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:51.136512 26801 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:51.143705 26801 tablet_bootstrap.cc:654] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.148952 26844 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.159955 26844 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:06:51.167495 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49682.2us
I20260709 13:06:51.175262 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:51.175908 26685 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.182358 26685 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:51.184610 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.185310 27116 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.185794 27116 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:51.186619 27116 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.195948 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:51.196599 26608 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.196944 26844 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.197365 26844 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.199002 26844 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.210345 27057 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.210850 27057 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.215952 26801 tablet_bootstrap.cc:492] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:51.216441 26801 ts_tablet_manager.cc:1403] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.041s
I20260709 13:06:51.216560 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:51.218068 26609 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.218981 26801 raft_consensus.cc:359] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.219697 26801 raft_consensus.cc:385] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.219981 26801 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.221302 27092 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.221086 26801 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.221891 27092 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.224558 26801 ts_tablet_manager.cc:1434] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:51.225687 26801 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Bootstrap starting.
I20260709 13:06:51.228298 26608 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:51.228720 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.229324 26685 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:51.230774 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:51.231519 27150 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.231880 27150 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.232220 27150 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.232672 26801 tablet_bootstrap.cc:654] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.237057 27196 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.260763 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:51.261437 26757 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:51.263628 27092 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.266530 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.267205 26685 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.268432 27057 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.269753 27092 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.277944 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:51.278949 26801 tablet_bootstrap.cc:492] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: No bootstrap required, opened a new log
I20260709 13:06:51.279692 26801 ts_tablet_manager.cc:1403] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.016s
W20260709 13:06:51.288334 26724 leader_election.cc:343] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.293994 27103 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.294760 27150 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.297981 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:51.298563 26757 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.300860 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:51.301425 26685 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.280936 27092 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.318054 26801 raft_consensus.cc:359] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.318851 26801 raft_consensus.cc:385] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.319114 26801 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.320665 26801 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:51.325212 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69329.7us
I20260709 13:06:51.311640 27150 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.347628 27151 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.327304 27224 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:06:51.340608 26603 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.347733 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.362308 27150 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.372023 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:06:51.362959 27151 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.382118 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.363849 26685 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:51.374958 26507 catalog_manager.cc:5697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.369544 26682 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.373057 26757 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:06:51.390662 27057 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.373934 27150 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.381408 27092 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.436328 27151 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.412057 26608 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.433794 27057 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.481541 27057 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.482684 26844 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.483421 26844 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.486771 26844 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.464607 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:51.459317 27103 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:06:51.498138 26759 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:51.510697 27229 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.511224 27229 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.510056 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.548902 27151 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.549465 27151 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:06:51.553922 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95562.6us
I20260709 13:06:51.566795 26801 ts_tablet_manager.cc:1434] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Time spent starting tablet: real 0.286s	user 0.007s	sys 0.012s
I20260709 13:06:51.560931 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.581233 27151 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.582710 27229 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.583968 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:06:51.589751 27150 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:51.585453 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:06:51.617399 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54000us
I20260709 13:06:51.620316 26726 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.631135 26844 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.631556 26844 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.631901 26844 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.613616 26607 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.615214 26685 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 0.
I20260709 13:06:51.689229 26844 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:06:51.711172 26558 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:51.716990 26844 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.732600 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.720723 27057 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.736894 27057 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.757333 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:51.758009 26606 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.763415 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:51.764147 26605 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.765450 26606 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:51.770612 26605 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:51.778918 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:06:51.780190 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47669.4us
I20260709 13:06:51.781692 27254 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.782138 27254 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.782196 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:51.782598 27254 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.782998 26758 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:51.797395 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:06:51.805500 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:51.806355 26686 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.808924 27092 raft_consensus.cc:2764] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:51.825906 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:06:51.802932 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:51.838816 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:51.839974 27229 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.836122 26682 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.850561 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54111.2us
I20260709 13:06:51.851261 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.852553 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:06:51.853073 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.853120 26684 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 0.
I20260709 13:06:51.861935 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:51.867852 27230 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.871321 27057 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.876839 27057 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:51.877729 27057 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.880695 27230 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:51.887955 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:51.891052 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:06:51.892997 27092 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.881588 27230 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.888386 27254 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:51.908628 26756 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:51.908812 26682 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:51.901736 27229 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.922048 26686 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
W20260709 13:06:51.924017 27258 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:06:51.928757 27254 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:51.916991 27229 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.925938 27235 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:51.958215 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52976us
I20260709 13:06:51.959764 26509 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.972532 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:06:51.978619 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:51.979278 26681 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.958091 27229 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.007130 27250 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:52.026499 26681 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:06:52.035882 27229 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:52.038069 27229 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:52.039485 26609 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 1: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:06:52.040979 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:06:52.041765 26761 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:52.044569 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:06:52.046419 27249 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.047465 27249 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:06:52.048388 27249 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:06:52.049718 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:06:52.050351 26686 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 1: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:06:52.051409 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:06:52.052361 27229 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.061241 26508 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.062726 26508 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.095348 27229 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.112922 27092 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.137233 26509 catalog_manager.cc:5697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.352977 27249 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.367543 27244 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.460711 27249 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.487540 27252 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.525879 27240 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.562279 27252 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.620709 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:53.650032 27275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:53.653473 27276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:53.669094 27279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:53.670643 25507 server_base.cc:1061] running on GCE node
I20260709 13:06:53.673341 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:53.673710 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:53.673951 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602413673931 us; error 0 us; skew 500 ppm
I20260709 13:06:53.675596 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:53.679977 25507 webserver.cc:533] Webserver started at http://127.24.232.196:42133/ using document root <none> and password file <none>
I20260709 13:06:53.680725 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:53.681095 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:53.681546 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:53.683321 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root/instance:
uuid: "77c617823f2e4a938ef247a8924e299b"
format_stamp: "Formatted at 2026-07-09 13:06:53 on dist-test-slave-sdg5"
I20260709 13:06:53.690364 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:06:53.695868 27283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:53.696904 25507 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:06:53.697247 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
uuid: "77c617823f2e4a938ef247a8924e299b"
format_stamp: "Formatted at 2026-07-09 13:06:53 on dist-test-slave-sdg5"
I20260709 13:06:53.697535 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:53.722460 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:53.724115 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:53.725911 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:53.730568 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:53.731763 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 13:06:53.732128 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:53.732402 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:53.821832 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.196:34653
I20260709 13:06:53.822415 27345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.196:34653 every 8 connection(s)
I20260709 13:06:53.870157 25507 auto_leader_rebalancer-test.cc:384] add a tserver: 77c617823f2e4a938ef247a8924e299b
I20260709 13:06:53.893298 27346 heartbeater.cc:344] Connected to a master server at 127.24.232.254:38345
I20260709 13:06:53.893818 27346 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:53.894657 27346 heartbeater.cc:507] Master 127.24.232.254:38345 requested a full tablet report, sending...
I20260709 13:06:53.898813 26509 ts_manager.cc:194] Registered new tserver with Master: 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:06:53.900691 26509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47192
I20260709 13:06:54.909252 27346 heartbeater.cc:499] Master 127.24.232.254:38345 was elected leader, sending a full tablet report...
I20260709 13:06:55.027197 26609 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:55.036165 26756 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.043212 27352 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:55.044576 26682 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.046008 27352 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:55.070039 27273 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.070513 26682 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.109835 26609 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:55.109988 26509 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.124060 26756 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:06:55.134980 26575 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48ed7d6e90f44f25b6d48f7d3fd0b857. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:55.135862 26575 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 589b7d1d64684da8b771d0b30a73579f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:55.138501 26761 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.139045 26681 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.140050 27366 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.142226 27365 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:55.198858 27366 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.201085 26761 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.201876 26681 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.245507 26507 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.287530 26682 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:55.297046 26761 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.302924 27148 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:55.315271 26609 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.320677 27148 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:55.330456 26650 consensus_peers.cc:597] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e42105a7b264fbeb08ebb417ed538f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:55.334213 27148 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.342901 26610 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.350216 26681 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:06:55.361553 26650 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c18e1296ad84de08dd646beec73c343. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:55.362001 26761 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.364725 26756 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.371331 27374 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.375695 26611 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:55.377861 27374 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:55.369792 26509 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.400081 27259 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.407763 26761 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.440773 26610 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.458179 26508 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:55.770030 27387 ts_tablet_manager.cc:933] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:55.783365 27386 ts_tablet_manager.cc:933] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:55.779547 27387 tablet_copy_client.cc:323] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.193:41483
I20260709 13:06:55.801299 27386 tablet_copy_client.cc:323] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.193:41483
I20260709 13:06:55.807490 27392 ts_tablet_manager.cc:933] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:55.829020 27391 ts_tablet_manager.cc:933] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:55.831754 27392 tablet_copy_client.cc:323] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:06:55.841121 27391 tablet_copy_client.cc:323] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
W20260709 13:06:55.902297 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53225.9us
I20260709 13:06:55.921515 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 4e42105a7b264fbeb08ebb417ed538f0 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:06:55.922186 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 4e42105a7b264fbeb08ebb417ed538f0 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-4e42105a7b264fbeb08ebb417ed538f0
I20260709 13:06:55.932360 26696 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 5c18e1296ad84de08dd646beec73c343 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:06:55.933032 26696 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 5c18e1296ad84de08dd646beec73c343 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-5c18e1296ad84de08dd646beec73c343
I20260709 13:06:55.971122 26696 tablet_copy_source_session.cc:215] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:55.980234 26622 tablet_copy_service.cc:140] P 687d192f79a044ce838f0bf292f0c09f: Received BeginTabletCopySession request for tablet 589b7d1d64684da8b771d0b30a73579f from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:35576)
I20260709 13:06:56.011365 26622 tablet_copy_service.cc:161] P 687d192f79a044ce838f0bf292f0c09f: Beginning new tablet copy session on tablet 589b7d1d64684da8b771d0b30a73579f from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:35576: session id = 77c617823f2e4a938ef247a8924e299b-589b7d1d64684da8b771d0b30a73579f
I20260709 13:06:55.980234 26621 tablet_copy_service.cc:140] P 687d192f79a044ce838f0bf292f0c09f: Received BeginTabletCopySession request for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:35576)
I20260709 13:06:56.015980 26621 tablet_copy_service.cc:161] P 687d192f79a044ce838f0bf292f0c09f: Beginning new tablet copy session on tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:35576: session id = 77c617823f2e4a938ef247a8924e299b-48ed7d6e90f44f25b6d48f7d3fd0b857
I20260709 13:06:56.031356 26622 tablet_copy_source_session.cc:215] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:56.035463 26621 tablet_copy_source_session.cc:215] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:56.045348 27391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18e1296ad84de08dd646beec73c343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.057714 27387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589b7d1d64684da8b771d0b30a73579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.076706 27386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.077687 27387 tablet_copy_client.cc:806] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:56.078547 27387 tablet_copy_client.cc:670] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:56.094833 27386 tablet_copy_client.cc:806] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:56.007167 26697 tablet_copy_source_session.cc:215] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:56.099812 27387 tablet_copy_client.cc:538] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:56.107016 27392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42105a7b264fbeb08ebb417ed538f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.102715 27391 tablet_copy_client.cc:806] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:56.124157 27391 tablet_copy_client.cc:670] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:56.126360 27386 tablet_copy_client.cc:670] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:56.131319 27391 tablet_copy_client.cc:538] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:56.135785 27386 tablet_copy_client.cc:538] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:56.142187 27391 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:06:56.150574 27387 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:06:56.159159 27386 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:06:56.177620 27392 tablet_copy_client.cc:806] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:56.178288 27392 tablet_copy_client.cc:670] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:56.182297 27392 tablet_copy_client.cc:538] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:56.201256 27392 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:06:56.208285 27386 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:56.209372 27386 tablet_bootstrap.cc:492] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:06:56.210093 27386 ts_tablet_manager.cc:1403] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.004s
I20260709 13:06:56.213634 27391 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:56.213192 27386 raft_consensus.cc:359] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.214190 27386 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:06:56.214630 27391 tablet_bootstrap.cc:492] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:06:56.215378 27391 ts_tablet_manager.cc:1403] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.004s
I20260709 13:06:56.214936 27386 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.218509 27391 raft_consensus.cc:359] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.219365 27391 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:06:56.220032 27391 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.225230 27386 ts_tablet_manager.cc:1434] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:06:56.234387 26621 tablet_copy_service.cc:342] P 687d192f79a044ce838f0bf292f0c09f: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-48ed7d6e90f44f25b6d48f7d3fd0b857 received from {username='slave'} at 127.0.0.1:35576
I20260709 13:06:56.234959 26621 tablet_copy_service.cc:434] P 687d192f79a044ce838f0bf292f0c09f: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-48ed7d6e90f44f25b6d48f7d3fd0b857 on tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:06:56.251576 27387 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:56.257510 27387 tablet_bootstrap.cc:492] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:06:56.271992 27387 ts_tablet_manager.cc:1403] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.009s
I20260709 13:06:56.275471 27391 ts_tablet_manager.cc:1434] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.060s	user 0.015s	sys 0.017s
I20260709 13:06:56.294449 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-5c18e1296ad84de08dd646beec73c343 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:06:56.294940 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-5c18e1296ad84de08dd646beec73c343 on tablet 5c18e1296ad84de08dd646beec73c343 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:06:56.296947 27387 raft_consensus.cc:359] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.297935 27387 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:06:56.298647 27387 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.300998 27387 ts_tablet_manager.cc:1434] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:06:56.302958 26621 tablet_copy_service.cc:342] P 687d192f79a044ce838f0bf292f0c09f: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-589b7d1d64684da8b771d0b30a73579f received from {username='slave'} at 127.0.0.1:35576
I20260709 13:06:56.303390 26621 tablet_copy_service.cc:434] P 687d192f79a044ce838f0bf292f0c09f: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-589b7d1d64684da8b771d0b30a73579f on tablet 589b7d1d64684da8b771d0b30a73579f with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:06:56.330796 27392 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:56.331882 27392 tablet_bootstrap.cc:492] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:06:56.332619 27392 ts_tablet_manager.cc:1403] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.132s	user 0.024s	sys 0.020s
I20260709 13:06:56.335698 27392 raft_consensus.cc:359] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.336512 27392 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:06:56.337159 27392 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:56.339426 27392 ts_tablet_manager.cc:1434] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:56.341178 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-4e42105a7b264fbeb08ebb417ed538f0 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:06:56.341600 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-4e42105a7b264fbeb08ebb417ed538f0 on tablet 4e42105a7b264fbeb08ebb417ed538f0 with peer 77c617823f2e4a938ef247a8924e299b
W20260709 13:06:56.694581 26708 debug-util.cc:398] Leaking SignalData structure 0x7b080017b540 after lost signal to thread 25510
W20260709 13:06:56.696475 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2ee0 after lost signal to thread 26544
W20260709 13:06:56.703542 26708 debug-util.cc:398] Leaking SignalData structure 0x7b080017b8a0 after lost signal to thread 26785
W20260709 13:06:56.706444 26708 debug-util.cc:398] Leaking SignalData structure 0x7b080013de20 after lost signal to thread 27345
W20260709 13:06:56.707077 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8300 after lost signal to thread 27358
I20260709 13:06:56.711187 27321 raft_consensus.cc:1217] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:56.726231 27321 raft_consensus.cc:1217] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:56.728179 27320 raft_consensus.cc:1217] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:56.804772 27321 raft_consensus.cc:1217] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:57.206754 27364 raft_consensus.cc:1064] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:06:57.210192 27364 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.244632 27374 raft_consensus.cc:1064] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:06:57.250206 27378 raft_consensus.cc:1064] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:06:57.253230 27378 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.263197 27374 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.299592 27321 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.301581 27383 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.304553 27365 raft_consensus.cc:1064] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:06:57.309213 26756 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.312754 27383 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.315075 27365 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.321871 26608 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.326504 27383 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.334504 26759 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.338961 27320 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.342355 26759 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.344529 27416 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.346076 27378 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.346560 27273 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:57.351025 26608 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.394018 26686 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.396850 27416 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.397372 27383 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.399343 27383 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.402172 26759 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.404933 27320 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.408916 27418 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:57.366868 27412 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:57.437358 27319 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.438130 26608 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.444998 26509 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.545286 27318 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.552636 26758 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.559584 27364 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:57.580483 26686 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:57.583525 27364 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.585845 27365 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.599809 27273 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.596639 27321 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.604353 26761 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.656500 27383 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.658337 26603 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:06:57.669353 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62750.2us
I20260709 13:06:57.697539 27421 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.701117 26761 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.702556 26680 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.720589 27321 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:06:57.761991 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68846.6us
I20260709 13:06:57.771464 26754 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.776360 26686 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.785837 27321 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:06:57.826380 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 60322.1us
I20260709 13:06:57.883985 26506 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.886875 26506 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.893489 26684 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.901716 26609 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:57.901727 27321 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:57.904026 27383 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:57.905056 27418 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:57.908470 26510 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.908936 26609 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.921598 27318 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:57.928493 26684 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:57.927963 27441 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.932639 27365 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:57.934574 27365 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:57.944609 27421 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.947947 26680 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.951412 27318 raft_consensus.cc:2955] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.954088 27321 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.959712 26603 raft_consensus.cc:2955] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:57.968056 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c18e1296ad84de08dd646beec73c343 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:57.971989 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 589b7d1d64684da8b771d0b30a73579f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:57.980495 26680 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:57.999809 27318 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:58.001473 26761 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:58.001587 27383 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:58.005229 27441 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:58.013797 27418 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.014966 27321 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.049365 26510 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.053505 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e42105a7b264fbeb08ebb417ed538f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:58.062191 26507 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.063239 26603 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:06:58.071511 27321 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:58.073344 27421 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:58.080950 27417 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.085690 26510 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.078370 26754 raft_consensus.cc:2955] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.096275 26761 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:58.098197 27421 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:58.098717 27321 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.102397 26761 raft_consensus.cc:2955] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.106837 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e42105a7b264fbeb08ebb417ed538f0 with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:06:58.132349 26510 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:06:58.141319 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:58.156481 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c18e1296ad84de08dd646beec73c343 with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:06:58.162253 27444 tablet_replica.cc:333] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:06:58.162629 26742 tablet_service.cc:1558] Processing DeleteTablet for tablet 589b7d1d64684da8b771d0b30a73579f with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:06:58.171285 27444 raft_consensus.cc:2243] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:58.178328 27444 raft_consensus.cc:2272] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:58.180909 27445 tablet_replica.cc:333] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:06:58.182107 27445 raft_consensus.cc:2243] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:58.182827 27445 raft_consensus.cc:2272] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:58.185016 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:06:58.188825 27444 ts_tablet_manager.cc:1916] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:58.208606 27446 tablet_replica.cc:333] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:06:58.209746 27446 raft_consensus.cc:2243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:58.210111 27445 ts_tablet_manager.cc:1916] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:58.210525 27446 raft_consensus.cc:2272] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:58.218154 27446 ts_tablet_manager.cc:1916] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:58.237911 27445 ts_tablet_manager.cc:1929] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:58.238664 27445 log.cc:1199] T 5c18e1296ad84de08dd646beec73c343 P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/5c18e1296ad84de08dd646beec73c343
I20260709 13:06:58.240602 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 5c18e1296ad84de08dd646beec73c343 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:06:58.240792 27445 tablet_replica.cc:333] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:06:58.242264 27445 raft_consensus.cc:2243] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:58.243219 27445 raft_consensus.cc:2272] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:58.248769 27445 ts_tablet_manager.cc:1916] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:58.256031 27446 ts_tablet_manager.cc:1929] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:58.256603 27446 log.cc:1199] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/48ed7d6e90f44f25b6d48f7d3fd0b857
I20260709 13:06:58.258394 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 48ed7d6e90f44f25b6d48f7d3fd0b857 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:06:58.266676 27444 ts_tablet_manager.cc:1929] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:58.267305 27444 log.cc:1199] T 4e42105a7b264fbeb08ebb417ed538f0 P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/4e42105a7b264fbeb08ebb417ed538f0
I20260709 13:06:58.269995 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet 4e42105a7b264fbeb08ebb417ed538f0 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:06:58.276180 27445 ts_tablet_manager.cc:1929] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:58.278239 27445 log.cc:1199] T 589b7d1d64684da8b771d0b30a73579f P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/589b7d1d64684da8b771d0b30a73579f
I20260709 13:06:58.285496 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 589b7d1d64684da8b771d0b30a73579f (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:06:59.251965 26761 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:59.260456 26686 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.262889 27429 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.269284 26610 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.273895 27429 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:59.286408 26724 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 403ab0598478421094af52431235a129. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:59.291021 27427 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.294353 26610 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.313097 26686 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.327029 26686 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:59.333619 26510 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.369127 26761 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:59.376559 26650 consensus_peers.cc:597] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7a03ebddf0c40ebb4879344f54f5d24. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:59.380897 26603 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.386957 27441 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:59.400408 27418 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.408850 27418 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.416356 26603 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.425607 26610 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:59.437989 26506 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.462200 26754 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.466516 26685 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.468667 27417 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.471719 26761 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.473383 27365 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:59.464100 26575 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d46fffe7ef44d4c95a01a5e1b261924. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:59.521656 27365 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.522920 26684 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.538964 26761 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.544224 26754 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:06:59.547401 26507 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:59.559783 26724 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c3f44630f03419aaf2afaa55030ded4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:59.563614 26609 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.563834 26684 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:59.566120 27429 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.567626 27456 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.587007 27429 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.587965 26609 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.590747 26684 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:06:59.608925 26510 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.848372 27474 ts_tablet_manager.cc:933] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:06:59.862569 27475 ts_tablet_manager.cc:933] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:06:59.863843 27477 ts_tablet_manager.cc:933] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:06:59.875816 27474 tablet_copy_client.cc:323] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:06:59.878648 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet d7a03ebddf0c40ebb4879344f54f5d24 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:06:59.879264 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet d7a03ebddf0c40ebb4879344f54f5d24 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-d7a03ebddf0c40ebb4879344f54f5d24
I20260709 13:06:59.880254 27475 tablet_copy_client.cc:323] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:06:59.881548 27477 tablet_copy_client.cc:323] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.193:41483
I20260709 13:06:59.885298 26621 tablet_copy_service.cc:140] P 687d192f79a044ce838f0bf292f0c09f: Received BeginTabletCopySession request for tablet 6d46fffe7ef44d4c95a01a5e1b261924 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:35576)
I20260709 13:06:59.885845 26621 tablet_copy_service.cc:161] P 687d192f79a044ce838f0bf292f0c09f: Beginning new tablet copy session on tablet 6d46fffe7ef44d4c95a01a5e1b261924 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:35576: session id = 77c617823f2e4a938ef247a8924e299b-6d46fffe7ef44d4c95a01a5e1b261924
I20260709 13:06:59.888314 26697 tablet_copy_source_session.cc:215] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:59.893898 27474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a03ebddf0c40ebb4879344f54f5d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:59.923856 26621 tablet_copy_source_session.cc:215] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:59.933525 27477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d46fffe7ef44d4c95a01a5e1b261924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:59.997009 27474 tablet_copy_client.cc:806] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:59.997991 27474 tablet_copy_client.cc:670] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:00.002115 27474 tablet_copy_client.cc:538] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:00.012184 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 403ab0598478421094af52431235a129 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:00.012835 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 403ab0598478421094af52431235a129 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-403ab0598478421094af52431235a129
I20260709 13:07:00.021247 26771 tablet_copy_source_session.cc:215] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:00.024717 27475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403ab0598478421094af52431235a129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:00.031181 27477 tablet_copy_client.cc:806] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:00.031831 27477 tablet_copy_client.cc:670] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:00.038426 27477 tablet_copy_client.cc:538] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:00.055411 27474 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:00.068185 27477 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:00.107132 27474 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:00.107904 27475 tablet_copy_client.cc:806] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:00.108865 27475 tablet_copy_client.cc:670] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:00.112563 27474 tablet_bootstrap.cc:492] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:00.112691 27475 tablet_copy_client.cc:538] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:00.113435 27474 ts_tablet_manager.cc:1403] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.008s
I20260709 13:07:00.117341 27474 raft_consensus.cc:359] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.118181 27474 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:00.118865 27474 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.124701 27477 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:00.137926 27474 ts_tablet_manager.cc:1434] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.010s
I20260709 13:07:00.141252 27477 tablet_bootstrap.cc:492] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:00.142077 27477 ts_tablet_manager.cc:1403] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.004s
I20260709 13:07:00.149222 27477 raft_consensus.cc:359] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.150601 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-d7a03ebddf0c40ebb4879344f54f5d24 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:00.150668 27477 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:00.151260 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-d7a03ebddf0c40ebb4879344f54f5d24 on tablet d7a03ebddf0c40ebb4879344f54f5d24 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:00.151809 27477 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.154553 27477 ts_tablet_manager.cc:1434] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:00.156316 26621 tablet_copy_service.cc:342] P 687d192f79a044ce838f0bf292f0c09f: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-6d46fffe7ef44d4c95a01a5e1b261924 received from {username='slave'} at 127.0.0.1:35576
I20260709 13:07:00.156713 26621 tablet_copy_service.cc:434] P 687d192f79a044ce838f0bf292f0c09f: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-6d46fffe7ef44d4c95a01a5e1b261924 on tablet 6d46fffe7ef44d4c95a01a5e1b261924 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:00.158890 27475 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:00.204928 27475 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:00.205840 27475 tablet_bootstrap.cc:492] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:00.206507 27475 ts_tablet_manager.cc:1403] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.015s
I20260709 13:07:00.207477 27477 ts_tablet_manager.cc:933] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:00.209470 27475 raft_consensus.cc:359] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.210063 27477 tablet_copy_client.cc:323] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:00.210356 27475 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:00.213548 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 7c3f44630f03419aaf2afaa55030ded4 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:00.214098 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 7c3f44630f03419aaf2afaa55030ded4 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-7c3f44630f03419aaf2afaa55030ded4
I20260709 13:07:00.230803 27321 raft_consensus.cc:1217] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:00.232848 26771 tablet_copy_source_session.cc:215] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:00.237986 27477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3f44630f03419aaf2afaa55030ded4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:00.211019 27475 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.241631 27475 ts_tablet_manager.cc:1434] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 13:07:00.255781 27477 tablet_copy_client.cc:806] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:00.256879 27477 tablet_copy_client.cc:670] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:00.258025 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-403ab0598478421094af52431235a129 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:00.258495 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-403ab0598478421094af52431235a129 on tablet 403ab0598478421094af52431235a129 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:00.271513 27477 tablet_copy_client.cc:538] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:00.332350 27477 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:00.370911 27477 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:00.374230 27477 tablet_bootstrap.cc:492] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:00.374961 27477 ts_tablet_manager.cc:1403] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.013s
I20260709 13:07:00.378409 27477 raft_consensus.cc:359] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.380702 27477 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:00.381408 27477 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:00.384286 27477 ts_tablet_manager.cc:1434] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:00.386036 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-7c3f44630f03419aaf2afaa55030ded4 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:00.386441 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-7c3f44630f03419aaf2afaa55030ded4 on tablet 7c3f44630f03419aaf2afaa55030ded4 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:00.404965 27321 raft_consensus.cc:1217] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:00.471753 27321 raft_consensus.cc:1217] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:07:00.504613 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67968.4us
I20260709 13:07:00.730232 27321 raft_consensus.cc:1217] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:00.848971 27460 raft_consensus.cc:1064] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:00.851477 27460 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:00.869488 27321 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:00.870954 27441 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.882185 26609 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:00.883074 26754 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:00.883836 27418 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.886086 27418 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.924731 27418 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:00.926167 26754 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:00.927350 26610 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:00.949443 26507 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:00.957326 27321 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:00.996963 27365 raft_consensus.cc:1064] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:01.011379 27365 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.022611 27321 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.024009 26680 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.024855 26754 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.030685 27470 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.032253 27365 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.035640 26761 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.037074 27491 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.045327 26680 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.047649 27429 raft_consensus.cc:1064] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:01.048460 27321 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.049935 27429 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.047081 27418 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.050941 26761 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.056957 27494 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.062891 27318 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.064746 26609 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.065230 27429 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.073451 27454 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:01.067525 27321 raft_consensus.cc:2955] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.069973 26510 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.071658 26680 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:07:01.081220 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57194.7us
I20260709 13:07:01.085203 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7a03ebddf0c40ebb4879344f54f5d24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:01.087370 27454 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:01.050904 27365 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:07:01.107005 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet d7a03ebddf0c40ebb4879344f54f5d24 with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:01.113014 27509 tablet_replica.cc:333] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:01.123381 27500 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.126210 27320 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.139444 26680 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.161954 27454 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.163789 27318 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.167841 27509 raft_consensus.cc:2243] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.168749 27509 raft_consensus.cc:2272] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.169847 26510 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.174500 27509 ts_tablet_manager.cc:1916] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:01.187428 26609 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.199075 26685 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.202461 26761 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.211530 26506 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.218999 27429 raft_consensus.cc:1064] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:01.221268 27429 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.229251 26610 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.240864 27509 ts_tablet_manager.cc:1929] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:01.241360 27509 log.cc:1199] T d7a03ebddf0c40ebb4879344f54f5d24 P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/d7a03ebddf0c40ebb4879344f54f5d24
I20260709 13:07:01.243062 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet d7a03ebddf0c40ebb4879344f54f5d24 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:01.245630 27318 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.247305 27505 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.248967 26685 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.250440 27505 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.258338 27470 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.297425 26685 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.306346 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d46fffe7ef44d4c95a01a5e1b261924 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:01.309605 26761 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.322295 27318 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.321764 26507 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.327165 26603 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.326740 27318 raft_consensus.cc:2955] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.327970 27428 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.334311 27428 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.337091 27321 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.342393 26684 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.347556 27454 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.352291 26610 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:01.355118 27456 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:01.361411 27429 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.364339 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d46fffe7ef44d4c95a01a5e1b261924 with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:07:01.378355 27428 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.379475 27318 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.397854 26507 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:07:01.421754 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43995us
I20260709 13:07:01.423786 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 403ab0598478421094af52431235a129 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:01.445003 27513 tablet_replica.cc:333] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:07:01.453917 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 403ab0598478421094af52431235a129 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:07:01.464545 27518 tablet_replica.cc:333] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:07:01.467032 27518 raft_consensus.cc:2243] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.469424 27429 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.477849 26608 raft_consensus.cc:2955] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.485502 27318 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.492341 27518 raft_consensus.cc:2272] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.491931 26684 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.518607 27518 ts_tablet_manager.cc:1916] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:01.519834 26507 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.528112 27513 raft_consensus.cc:2243] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.528955 27513 raft_consensus.cc:2272] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.532323 27513 ts_tablet_manager.cc:1916] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:01.557832 27513 ts_tablet_manager.cc:1929] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:01.558627 26603 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.565021 27513 log.cc:1199] T 6d46fffe7ef44d4c95a01a5e1b261924 P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/6d46fffe7ef44d4c95a01a5e1b261924
I20260709 13:07:01.569197 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 6d46fffe7ef44d4c95a01a5e1b261924 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:01.571798 26761 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:01.574581 27518 ts_tablet_manager.cc:1929] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:01.575062 27518 log.cc:1199] T 403ab0598478421094af52431235a129 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/403ab0598478421094af52431235a129
I20260709 13:07:01.577175 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 403ab0598478421094af52431235a129 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:01.582377 27318 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.583854 27429 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.586637 26608 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:01.595232 27488 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.597242 27429 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.599540 27318 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.603047 26608 raft_consensus.cc:2955] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:01.606868 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c3f44630f03419aaf2afaa55030ded4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:01.616303 26510 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.634735 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3f44630f03419aaf2afaa55030ded4 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:07:01.636003 27518 tablet_replica.cc:333] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:07:01.666532 27518 raft_consensus.cc:2243] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.667441 27518 raft_consensus.cc:2272] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.670651 27518 ts_tablet_manager.cc:1916] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:01.688751 27518 ts_tablet_manager.cc:1929] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:01.689248 27518 log.cc:1199] T 7c3f44630f03419aaf2afaa55030ded4 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/7c3f44630f03419aaf2afaa55030ded4
I20260709 13:07:01.691071 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 7c3f44630f03419aaf2afaa55030ded4 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:02.704408 26761 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:02.714815 26724 consensus_peers.cc:597] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d654edc77c345a4859c8e9dcbac7a2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.716271 26680 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.718221 27454 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.721776 26610 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.724604 27429 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.735548 27429 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.737210 26608 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.757187 26506 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.759236 26608 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:02.765057 26680 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.783838 26761 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.785343 27470 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.786269 26684 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.788972 27470 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:02.794713 26575 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4f65a3c62194ad385b5c3a9d0b22e2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.804946 27470 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.809862 26761 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.817286 26680 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.843089 26761 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:02.862571 26510 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.870554 26608 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:02.872808 26724 consensus_peers.cc:597] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e4cacedac354143ab8977803382d0af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.873008 27429 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.894704 26684 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.906565 27429 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.908236 27488 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.920545 26608 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:02.924141 26679 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:02.934335 26684 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:02.942967 26650 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c820b8b86e594946bfb5f18fbb98296d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.943531 26761 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.943517 26506 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.945333 27532 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.948046 26608 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:02.949542 27532 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:03.054804 27531 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:03.057585 26761 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:03.073444 26608 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:03.076131 26510 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.303135 27542 ts_tablet_manager.cc:933] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:03.305266 27542 tablet_copy_client.cc:323] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:03.306885 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 3d654edc77c345a4859c8e9dcbac7a2e from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:03.307363 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 3d654edc77c345a4859c8e9dcbac7a2e from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-3d654edc77c345a4859c8e9dcbac7a2e
I20260709 13:07:03.312419 26771 tablet_copy_source_session.cc:215] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:03.315052 27542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d654edc77c345a4859c8e9dcbac7a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:03.334318 27544 ts_tablet_manager.cc:933] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:03.341977 27542 tablet_copy_client.cc:806] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:03.342732 27542 tablet_copy_client.cc:670] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:03.342732 27544 tablet_copy_client.cc:323] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.193:41483
I20260709 13:07:03.344614 26621 tablet_copy_service.cc:140] P 687d192f79a044ce838f0bf292f0c09f: Received BeginTabletCopySession request for tablet c4f65a3c62194ad385b5c3a9d0b22e2b from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:35576)
I20260709 13:07:03.345144 26621 tablet_copy_service.cc:161] P 687d192f79a044ce838f0bf292f0c09f: Beginning new tablet copy session on tablet c4f65a3c62194ad385b5c3a9d0b22e2b from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:35576: session id = 77c617823f2e4a938ef247a8924e299b-c4f65a3c62194ad385b5c3a9d0b22e2b
I20260709 13:07:03.346787 27542 tablet_copy_client.cc:538] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:03.352437 26621 tablet_copy_source_session.cc:215] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:03.353675 27542 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:03.355937 27544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f65a3c62194ad385b5c3a9d0b22e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:03.372115 27544 tablet_copy_client.cc:806] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:03.372736 27544 tablet_copy_client.cc:670] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:03.375207 27542 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.376272 27542 tablet_bootstrap.cc:492] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:03.376654 27544 tablet_copy_client.cc:538] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:03.377043 27542 ts_tablet_manager.cc:1403] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.008s
I20260709 13:07:03.380084 27542 raft_consensus.cc:359] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.380990 27542 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:03.381851 27542 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.387069 27544 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:03.392570 27542 ts_tablet_manager.cc:1434] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 13:07:03.399400 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-3d654edc77c345a4859c8e9dcbac7a2e received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:03.399923 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-3d654edc77c345a4859c8e9dcbac7a2e on tablet 3d654edc77c345a4859c8e9dcbac7a2e with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:03.411965 27542 ts_tablet_manager.cc:933] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:03.424517 27542 tablet_copy_client.cc:323] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:03.439535 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 8e4cacedac354143ab8977803382d0af from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:03.440423 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 8e4cacedac354143ab8977803382d0af from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-8e4cacedac354143ab8977803382d0af
I20260709 13:07:03.464234 26771 tablet_copy_source_session.cc:215] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:03.530336 27542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4cacedac354143ab8977803382d0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:03.546072 27542 tablet_copy_client.cc:806] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:03.546666 27542 tablet_copy_client.cc:670] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:03.550999 27542 tablet_copy_client.cc:538] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:03.554785 27544 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.555800 27544 tablet_bootstrap.cc:492] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:03.556526 27544 ts_tablet_manager.cc:1403] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.170s	user 0.069s	sys 0.065s
I20260709 13:07:03.558804 27548 ts_tablet_manager.cc:933] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:03.559720 27544 raft_consensus.cc:359] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.560909 27544 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:03.561646 27544 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.564296 27544 ts_tablet_manager.cc:1434] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:03.567365 27548 tablet_copy_client.cc:323] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:03.568537 26621 tablet_copy_service.cc:342] P 687d192f79a044ce838f0bf292f0c09f: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-c4f65a3c62194ad385b5c3a9d0b22e2b received from {username='slave'} at 127.0.0.1:35576
I20260709 13:07:03.568883 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet c820b8b86e594946bfb5f18fbb98296d from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:03.568981 26621 tablet_copy_service.cc:434] P 687d192f79a044ce838f0bf292f0c09f: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-c4f65a3c62194ad385b5c3a9d0b22e2b on tablet c4f65a3c62194ad385b5c3a9d0b22e2b with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:03.569435 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet c820b8b86e594946bfb5f18fbb98296d from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-c820b8b86e594946bfb5f18fbb98296d
I20260709 13:07:03.576217 26697 tablet_copy_source_session.cc:215] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:03.578845 27542 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:03.581303 27548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c820b8b86e594946bfb5f18fbb98296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:03.602716 27548 tablet_copy_client.cc:806] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:03.603440 27548 tablet_copy_client.cc:670] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:03.610215 27548 tablet_copy_client.cc:538] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:03.618611 27542 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.619554 27542 tablet_bootstrap.cc:492] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:03.620223 27542 ts_tablet_manager.cc:1403] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.016s
I20260709 13:07:03.621747 27548 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:03.623169 27542 raft_consensus.cc:359] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.624058 27542 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:03.624737 27542 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.629810 27542 ts_tablet_manager.cc:1434] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:03.632826 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-8e4cacedac354143ab8977803382d0af received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:03.633250 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-8e4cacedac354143ab8977803382d0af on tablet 8e4cacedac354143ab8977803382d0af with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:03.661561 27548 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.662534 27548 tablet_bootstrap.cc:492] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:03.663178 27548 ts_tablet_manager.cc:1403] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.016s
I20260709 13:07:03.666251 27548 raft_consensus.cc:359] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.666880 27548 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:03.667497 27548 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:03.669727 27548 ts_tablet_manager.cc:1434] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:07:03.671308 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-c820b8b86e594946bfb5f18fbb98296d received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:03.671690 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-c820b8b86e594946bfb5f18fbb98296d on tablet c820b8b86e594946bfb5f18fbb98296d with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:03.801980 27318 raft_consensus.cc:1217] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:03.915398 27318 raft_consensus.cc:1217] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:03.974686 27318 raft_consensus.cc:1217] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:04.174871 27318 raft_consensus.cc:1217] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:04.281911 27551 raft_consensus.cc:1064] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:04.284672 27551 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.292763 27318 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.296272 26685 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.298331 26608 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.296691 27561 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:04.300266 27552 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.301222 27454 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.328075 27551 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.334110 27318 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.338871 26608 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.349874 26680 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.350932 26510 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.400360 26761 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.405128 26680 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.406467 27320 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.407162 27562 raft_consensus.cc:1064] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:04.407404 27454 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.411811 27561 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.409744 27562 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.418898 27552 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.423272 26685 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.430163 27320 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.431821 27454 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.435043 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d654edc77c345a4859c8e9dcbac7a2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:04.436510 26680 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.437990 27552 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:04.439473 27318 raft_consensus.cc:2955] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.447220 26506 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.442298 26610 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.456918 27454 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.461164 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d654edc77c345a4859c8e9dcbac7a2e with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:04.474493 27470 raft_consensus.cc:1064] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:04.476835 27470 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.476775 27454 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.482316 26680 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.509898 27320 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.522970 27573 tablet_replica.cc:333] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:04.524113 27573 raft_consensus.cc:2243] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:04.524822 27573 raft_consensus.cc:2272] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:04.526705 26506 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.530117 27573 ts_tablet_manager.cc:1916] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:04.537774 26610 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.548208 26761 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.553287 27573 ts_tablet_manager.cc:1929] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:04.553856 27573 log.cc:1199] T 3d654edc77c345a4859c8e9dcbac7a2e P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/3d654edc77c345a4859c8e9dcbac7a2e
I20260709 13:07:04.554924 27320 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.555490 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet 3d654edc77c345a4859c8e9dcbac7a2e (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:04.560425 27318 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.561610 27561 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.564050 26679 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.564587 27556 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.567277 27562 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:04.579721 27561 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.596019 26754 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.597093 27318 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.597971 26679 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.598744 27580 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.600683 27580 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.602108 26679 raft_consensus.cc:2955] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.610841 26506 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.613561 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e4cacedac354143ab8977803382d0af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:04.620282 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57696.5us
I20260709 13:07:04.650792 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e4cacedac354143ab8977803382d0af with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:04.651880 27573 tablet_replica.cc:333] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:04.662279 27573 raft_consensus.cc:2243] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:04.663283 27573 raft_consensus.cc:2272] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:04.671628 27573 ts_tablet_manager.cc:1916] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:04.682629 27579 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.684839 26754 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.702765 26506 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.708868 26679 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.723528 27559 raft_consensus.cc:1064] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:04.726256 27559 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.747591 27320 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.749266 27557 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.762378 26608 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.765381 27557 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.767015 26761 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:04.770175 27559 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.779201 27557 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.782579 26610 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.808200 27321 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.814374 26506 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.826655 27318 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.833361 27573 ts_tablet_manager.cc:1929] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:04.833865 27573 log.cc:1199] T 8e4cacedac354143ab8977803382d0af P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/8e4cacedac354143ab8977803382d0af
I20260709 13:07:04.832986 26680 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.835435 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet 8e4cacedac354143ab8977803382d0af (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:04.832265 26761 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.841792 27320 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.841890 26610 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.843577 27584 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.846726 27589 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.860813 27590 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.867805 26610 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.875946 26603 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:04.886863 26761 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.888710 27580 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.889060 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c820b8b86e594946bfb5f18fbb98296d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:04.868230 27318 raft_consensus.cc:2955] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.893332 27321 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:04.895042 27580 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.898665 27579 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.900094 26754 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.900159 26506 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.914711 27321 raft_consensus.cc:2955] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:04.939548 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4f65a3c62194ad385b5c3a9d0b22e2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:04.944092 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet c820b8b86e594946bfb5f18fbb98296d with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:07:04.950485 26507 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.972262 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f65a3c62194ad385b5c3a9d0b22e2b with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:07:04.985050 27591 tablet_replica.cc:333] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:07:04.988021 27592 tablet_replica.cc:333] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:07:04.990299 27591 raft_consensus.cc:2243] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:04.991086 27591 raft_consensus.cc:2272] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:04.992715 27592 raft_consensus.cc:2243] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:04.993506 27592 raft_consensus.cc:2272] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:04.997607 27591 ts_tablet_manager.cc:1916] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:04.998730 27592 ts_tablet_manager.cc:1916] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:05.010684 27591 ts_tablet_manager.cc:1929] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:05.011197 27591 log.cc:1199] T c820b8b86e594946bfb5f18fbb98296d P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/c820b8b86e594946bfb5f18fbb98296d
I20260709 13:07:05.012938 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet c820b8b86e594946bfb5f18fbb98296d (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:05.014873 27592 ts_tablet_manager.cc:1929] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:05.015352 27592 log.cc:1199] T c4f65a3c62194ad385b5c3a9d0b22e2b P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/c4f65a3c62194ad385b5c3a9d0b22e2b
I20260709 13:07:05.016901 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet c4f65a3c62194ad385b5c3a9d0b22e2b (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:06.061753 26754 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:06.067189 26724 consensus_peers.cc:597] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f607ad667e17480ca4cc0366f3f7ce3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.067368 26680 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.067767 26608 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.068842 27454 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.069511 27551 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.078545 27551 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.080843 26685 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.086374 26610 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.094331 26685 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.100513 26506 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:06.112496 26650 consensus_peers.cc:597] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87d025654eac4cceb374a7a730d59309. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.114969 26754 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.115406 26610 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.116461 27590 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.117329 27589 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.126197 27590 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.144371 26610 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.158879 26754 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.179412 26510 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.200362 26754 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:06.208743 26724 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34cdb199be824317848395c2d8402714. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.208811 26685 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.208994 26610 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.210633 27597 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.211787 27599 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.227314 27597 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.229069 26610 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.232823 26685 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.243259 26754 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.251374 26510 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:06.254285 26724 consensus_peers.cc:597] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8d2ac1df6a84a8eb9a6a4510b47b6e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.257915 26610 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.259403 27597 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.259394 26685 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.263511 27597 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.270833 27551 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.272049 26608 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.308279 26510 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.320490 26685 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:06.492741 27618 ts_tablet_manager.cc:933] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:06.494467 27618 tablet_copy_client.cc:323] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:06.495927 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet f607ad667e17480ca4cc0366f3f7ce3b from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:06.496465 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet f607ad667e17480ca4cc0366f3f7ce3b from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-f607ad667e17480ca4cc0366f3f7ce3b
I20260709 13:07:06.503284 26771 tablet_copy_source_session.cc:215] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:06.508404 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607ad667e17480ca4cc0366f3f7ce3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:06.520538 27618 tablet_copy_client.cc:806] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:06.521152 27618 tablet_copy_client.cc:670] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:06.524914 27618 tablet_copy_client.cc:538] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:06.532405 27618 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:06.551779 27618 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.552703 27618 tablet_bootstrap.cc:492] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:06.553337 27618 ts_tablet_manager.cc:1403] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:07:06.556161 27618 raft_consensus.cc:359] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.556970 27618 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:06.557598 27618 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.562721 27618 ts_tablet_manager.cc:1434] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:06.566260 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-f607ad667e17480ca4cc0366f3f7ce3b received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:06.566612 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-f607ad667e17480ca4cc0366f3f7ce3b on tablet f607ad667e17480ca4cc0366f3f7ce3b with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:06.584659 27618 ts_tablet_manager.cc:933] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:06.589708 27618 tablet_copy_client.cc:323] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:06.591475 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 87d025654eac4cceb374a7a730d59309 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:06.592130 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 87d025654eac4cceb374a7a730d59309 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-87d025654eac4cceb374a7a730d59309
I20260709 13:07:06.695261 26697 tablet_copy_source_session.cc:215] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:06.706629 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d025654eac4cceb374a7a730d59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:06.739502 27618 tablet_copy_client.cc:806] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:06.740196 27618 tablet_copy_client.cc:670] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:06.745873 27618 tablet_copy_client.cc:538] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:06.755079 27618 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:06.784722 27626 ts_tablet_manager.cc:933] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:06.790396 27618 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.791512 27618 tablet_bootstrap.cc:492] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:06.792302 27618 ts_tablet_manager.cc:1403] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.000s
I20260709 13:07:06.796454 27626 tablet_copy_client.cc:323] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:06.796202 27618 raft_consensus.cc:359] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.797478 27618 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:06.798300 27618 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.799115 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:06.800009 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-f8d2ac1df6a84a8eb9a6a4510b47b6e0
I20260709 13:07:06.804430 27618 ts_tablet_manager.cc:1434] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:07:06.809981 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-87d025654eac4cceb374a7a730d59309 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:06.810438 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-87d025654eac4cceb374a7a730d59309 on tablet 87d025654eac4cceb374a7a730d59309 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:06.811779 26771 tablet_copy_source_session.cc:215] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:06.815271 27618 ts_tablet_manager.cc:933] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:06.818607 27626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:06.819406 27618 tablet_copy_client.cc:323] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:06.826068 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 34cdb199be824317848395c2d8402714 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:06.826740 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 34cdb199be824317848395c2d8402714 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-34cdb199be824317848395c2d8402714
I20260709 13:07:06.836787 26771 tablet_copy_source_session.cc:215] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:06.841486 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdb199be824317848395c2d8402714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:06.864051 27618 tablet_copy_client.cc:806] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:06.864593 27618 tablet_copy_client.cc:670] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:06.871758 27626 tablet_copy_client.cc:806] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:06.872565 27626 tablet_copy_client.cc:670] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:06.880972 27626 tablet_copy_client.cc:538] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:06.882429 27618 tablet_copy_client.cc:538] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:06.894089 27618 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:06.900166 27626 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:06.916884 27321 raft_consensus.cc:1217] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:06.934067 27618 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.935005 27618 tablet_bootstrap.cc:492] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:06.935740 27618 ts_tablet_manager.cc:1403] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.003s
I20260709 13:07:06.938050 27618 raft_consensus.cc:359] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.938778 27618 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:06.946970 27626 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.948132 27626 tablet_bootstrap.cc:492] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:06.948800 27626 ts_tablet_manager.cc:1403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.019s
I20260709 13:07:06.952013 27626 raft_consensus.cc:359] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.952776 27626 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:06.953352 27626 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.939427 27618 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:06.955976 27618 ts_tablet_manager.cc:1434] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:07:06.958212 27626 ts_tablet_manager.cc:1434] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:07:06.960044 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-f8d2ac1df6a84a8eb9a6a4510b47b6e0 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:06.960494 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-f8d2ac1df6a84a8eb9a6a4510b47b6e0 on tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:06.963223 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-34cdb199be824317848395c2d8402714 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:06.963613 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-34cdb199be824317848395c2d8402714 on tablet 34cdb199be824317848395c2d8402714 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:07.058362 27321 raft_consensus.cc:1217] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:07.224407 27321 raft_consensus.cc:1217] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:07.364300 27321 raft_consensus.cc:1217] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:07.430634 27617 raft_consensus.cc:1064] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:07.433174 27617 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.441174 26680 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.441497 27321 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.445659 27597 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.447908 27617 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.451052 26603 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.454447 27617 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.474922 27632 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.481635 26680 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.481635 26603 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.495837 27321 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.502351 26510 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.504298 27589 raft_consensus.cc:1064] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:07.513653 27589 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.537238 27320 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.538723 26754 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.539458 27590 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.541520 27607 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:07.548878 26603 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.556180 27607 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:07.595631 27589 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.603981 27321 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.610831 26754 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.607575 26603 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.625276 27617 raft_consensus.cc:1064] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:07.627709 27617 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.648051 26754 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.649121 26509 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.653153 27321 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.659969 26679 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.659991 27617 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.661824 26609 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.660392 26680 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.667397 27617 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.667831 27632 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.676393 27632 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.684476 27321 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.680897 27551 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.680732 26679 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.685953 27646 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.691634 26685 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.694788 27321 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.696238 27589 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.703492 26603 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.705772 27589 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.708158 27321 raft_consensus.cc:2955] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.713047 27607 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.721138 27597 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.722505 26603 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.732046 26684 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.736912 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f607ad667e17480ca4cc0366f3f7ce3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:07.746740 26609 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.755585 26510 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.775259 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87d025654eac4cceb374a7a730d59309 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:07.780812 27321 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.782392 27320 raft_consensus.cc:2955] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.783227 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet f607ad667e17480ca4cc0366f3f7ce3b with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:07.790648 27597 raft_consensus.cc:1064] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:07.794492 27597 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.797454 27652 tablet_replica.cc:333] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:07.791180 26509 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.802740 27652 raft_consensus.cc:2243] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.803597 27652 raft_consensus.cc:2272] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.814219 27652 ts_tablet_manager.cc:1916] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:07.824304 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet 87d025654eac4cceb374a7a730d59309 with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:07:07.823230 26506 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.833495 27654 tablet_replica.cc:333] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:07:07.845983 27654 raft_consensus.cc:2243] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.846186 27652 ts_tablet_manager.cc:1929] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:07.846818 27652 log.cc:1199] T f607ad667e17480ca4cc0366f3f7ce3b P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/f607ad667e17480ca4cc0366f3f7ce3b
I20260709 13:07:07.847523 27654 raft_consensus.cc:2272] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.850615 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet f607ad667e17480ca4cc0366f3f7ce3b (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:07.857813 27654 ts_tablet_manager.cc:1916] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:07.858888 27320 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.862805 27651 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:07.872043 26684 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.872676 26609 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:07.873811 27646 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.876209 26761 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.879850 27646 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.881850 26685 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.882771 27320 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.884680 27646 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.888232 27646 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.898240 27654 ts_tablet_manager.cc:1929] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:07.901536 27654 log.cc:1199] T 87d025654eac4cceb374a7a730d59309 P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/87d025654eac4cceb374a7a730d59309
I20260709 13:07:07.901985 27597 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.902917 27617 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.908363 26685 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.925225 26506 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.925984 27320 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.931864 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 87d025654eac4cceb374a7a730d59309 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:07.932551 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:07.936580 26603 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.938572 27321 raft_consensus.cc:2955] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.945803 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:07.946715 27652 tablet_replica.cc:333] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:07.947804 27652 raft_consensus.cc:2243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.948496 27652 raft_consensus.cc:2272] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.949791 26685 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.952499 27652 ts_tablet_manager.cc:1916] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:07.968490 26509 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:07.978487 27652 ts_tablet_manager.cc:1929] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:07.979033 27652 log.cc:1199] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/f8d2ac1df6a84a8eb9a6a4510b47b6e0
I20260709 13:07:07.980854 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet f8d2ac1df6a84a8eb9a6a4510b47b6e0 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:07.990347 26754 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:07.995240 27320 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.995396 26603 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:07.996649 27597 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.997561 27658 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.003655 27617 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:08.005915 27320 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:08.006157 26603 raft_consensus.cc:2955] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:08.020114 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34cdb199be824317848395c2d8402714 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:08.027365 26506 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:08.037408 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cdb199be824317848395c2d8402714 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:07:08.041412 27659 tablet_replica.cc:333] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:07:08.051126 27659 raft_consensus.cc:2243] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.051908 27659 raft_consensus.cc:2272] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.054455 27659 ts_tablet_manager.cc:1916] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:08.065384 27659 ts_tablet_manager.cc:1929] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:08.065707 27659 log.cc:1199] T 34cdb199be824317848395c2d8402714 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/34cdb199be824317848395c2d8402714
I20260709 13:07:08.067420 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 34cdb199be824317848395c2d8402714 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:09.106056 26684 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:09.116498 26650 consensus_peers.cc:597] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a4ad5bc4dd54937a7e4f9b1604a7d22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:09.117425 26761 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.118119 26603 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.118685 27642 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.119371 27607 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.126631 27607 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.129048 26603 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.130867 26761 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.143966 26506 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.147300 26609 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.155586 26761 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.155805 26685 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.156916 27637 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.158558 27660 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:09.158568 26575 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b8af8f9b5044a94b8f38a96387fc68d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:09.178295 27660 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.179608 26685 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.212284 26761 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.220669 26685 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.225304 26510 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.243074 26761 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.244155 26609 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:09.244310 26650 consensus_peers.cc:597] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 823c00a7d4b44bbea4d06e2ad87901ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:09.244330 27642 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:09.245554 27664 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.253605 27607 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.256073 26609 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.255146 26761 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.267401 26754 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.271679 26509 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:09.280082 26724 consensus_peers.cc:597] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f64501a1194b4fc59c6dc2502e1b7c73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:09.280776 26685 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.282271 26609 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:09.282804 27658 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.288908 27617 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:09.303058 27678 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.307653 26685 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.312740 26609 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.332485 26506 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:09.598642 27681 ts_tablet_manager.cc:933] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:09.613245 27681 tablet_copy_client.cc:323] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.193:41483
I20260709 13:07:09.615492 26621 tablet_copy_service.cc:140] P 687d192f79a044ce838f0bf292f0c09f: Received BeginTabletCopySession request for tablet 4b8af8f9b5044a94b8f38a96387fc68d from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:35576)
I20260709 13:07:09.616160 26621 tablet_copy_service.cc:161] P 687d192f79a044ce838f0bf292f0c09f: Beginning new tablet copy session on tablet 4b8af8f9b5044a94b8f38a96387fc68d from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:35576: session id = 77c617823f2e4a938ef247a8924e299b-4b8af8f9b5044a94b8f38a96387fc68d
I20260709 13:07:09.626349 26621 tablet_copy_source_session.cc:215] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:09.629920 27681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8af8f9b5044a94b8f38a96387fc68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.638505 27683 ts_tablet_manager.cc:933] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:09.640398 27683 tablet_copy_client.cc:323] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:09.642580 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:09.643100 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-0a4ad5bc4dd54937a7e4f9b1604a7d22
I20260709 13:07:09.648929 27681 tablet_copy_client.cc:806] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:09.649664 27681 tablet_copy_client.cc:670] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:09.650617 26697 tablet_copy_source_session.cc:215] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:09.653605 27681 tablet_copy_client.cc:538] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:09.655627 27683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.663801 27681 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:09.670765 27683 tablet_copy_client.cc:806] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:09.671653 27683 tablet_copy_client.cc:670] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:09.674961 27683 tablet_copy_client.cc:538] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:09.683130 27683 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:09.693478 27681 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:09.694582 27681 tablet_bootstrap.cc:492] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:09.695400 27681 ts_tablet_manager.cc:1403] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.032s	user 0.029s	sys 0.004s
I20260709 13:07:09.699075 27681 raft_consensus.cc:359] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.704123 27681 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:09.704950 27681 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.709403 27686 ts_tablet_manager.cc:933] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:09.723987 27686 tablet_copy_client.cc:323] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:09.726018 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 823c00a7d4b44bbea4d06e2ad87901ca from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:09.726548 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 823c00a7d4b44bbea4d06e2ad87901ca from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-823c00a7d4b44bbea4d06e2ad87901ca
I20260709 13:07:09.713907 27681 ts_tablet_manager.cc:1434] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 13:07:09.736703 26697 tablet_copy_source_session.cc:215] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:09.737000 26621 tablet_copy_service.cc:342] P 687d192f79a044ce838f0bf292f0c09f: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-4b8af8f9b5044a94b8f38a96387fc68d received from {username='slave'} at 127.0.0.1:35576
I20260709 13:07:09.738276 26621 tablet_copy_service.cc:434] P 687d192f79a044ce838f0bf292f0c09f: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-4b8af8f9b5044a94b8f38a96387fc68d on tablet 4b8af8f9b5044a94b8f38a96387fc68d with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:09.742363 27686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823c00a7d4b44bbea4d06e2ad87901ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.756834 27686 tablet_copy_client.cc:806] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:09.757694 27683 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:09.758208 27686 tablet_copy_client.cc:670] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:09.758692 27683 tablet_bootstrap.cc:492] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:09.759397 27683 ts_tablet_manager.cc:1403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.011s
I20260709 13:07:09.763247 27686 tablet_copy_client.cc:538] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:09.762712 27683 raft_consensus.cc:359] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.763847 27683 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:09.764542 27683 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.781564 27683 ts_tablet_manager.cc:1434] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.006s
I20260709 13:07:09.784518 27686 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:09.785856 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-0a4ad5bc4dd54937a7e4f9b1604a7d22 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:09.786368 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-0a4ad5bc4dd54937a7e4f9b1604a7d22 on tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:09.802704 27686 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:09.803534 27686 tablet_bootstrap.cc:492] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:09.804122 27686 ts_tablet_manager.cc:1403] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 13:07:09.806757 27686 raft_consensus.cc:359] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.807377 27686 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:09.808063 27686 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.810729 27686 ts_tablet_manager.cc:1434] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:07:09.817166 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-823c00a7d4b44bbea4d06e2ad87901ca received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:09.817655 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-823c00a7d4b44bbea4d06e2ad87901ca on tablet 823c00a7d4b44bbea4d06e2ad87901ca with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:09.867267 27686 ts_tablet_manager.cc:933] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:09.869776 27686 tablet_copy_client.cc:323] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:09.871421 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet f64501a1194b4fc59c6dc2502e1b7c73 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:09.871968 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet f64501a1194b4fc59c6dc2502e1b7c73 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-f64501a1194b4fc59c6dc2502e1b7c73
I20260709 13:07:09.881937 26771 tablet_copy_source_session.cc:215] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:09.886585 27686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64501a1194b4fc59c6dc2502e1b7c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.904487 27686 tablet_copy_client.cc:806] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:09.905144 27686 tablet_copy_client.cc:670] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:09.908595 27686 tablet_copy_client.cc:538] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:09.918777 27686 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:09.949199 27686 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:09.949875 27686 tablet_bootstrap.cc:492] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:09.950453 27686 ts_tablet_manager.cc:1403] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.017s
I20260709 13:07:09.952592 27686 raft_consensus.cc:359] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.953186 27686 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:09.953663 27686 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:09.955411 27686 ts_tablet_manager.cc:1434] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:09.956900 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-f64501a1194b4fc59c6dc2502e1b7c73 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:09.957288 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-f64501a1194b4fc59c6dc2502e1b7c73 on tablet f64501a1194b4fc59c6dc2502e1b7c73 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:10.029575 27320 raft_consensus.cc:1217] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:10.077780 27321 raft_consensus.cc:1217] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:10.234357 27321 raft_consensus.cc:1217] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:10.322224 27321 raft_consensus.cc:1217] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:10.448696 27672 raft_consensus.cc:1064] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:10.450690 27672 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.458351 27321 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.458933 26754 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.460491 27637 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.462239 27637 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.473287 26685 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.474805 27672 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.479118 27672 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.482925 26761 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.491044 27321 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.498608 26506 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.511680 26685 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.527568 27607 raft_consensus.cc:1064] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:10.529827 27607 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.551266 26603 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.558187 26761 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.558454 27321 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.559913 27672 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.561388 27694 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.577493 27321 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.580091 27607 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.580627 26603 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.576690 27637 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.578409 26754 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.586216 27692 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.587424 27664 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.590785 26761 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:07:10.614188 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44725us
I20260709 13:07:10.615713 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b8af8f9b5044a94b8f38a96387fc68d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:10.616555 27320 raft_consensus.cc:2955] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.617250 27607 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.620839 26509 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 1 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.625588 26756 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.629961 27321 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.633882 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b8af8f9b5044a94b8f38a96387fc68d with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55242
I20260709 13:07:10.661158 27708 tablet_replica.cc:333] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:07:10.664687 27708 raft_consensus.cc:2243] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.670006 27708 raft_consensus.cc:2272] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.672470 26507 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.676082 27708 ts_tablet_manager.cc:1916] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:10.693176 27708 ts_tablet_manager.cc:1929] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:10.693602 27708 log.cc:1199] T 4b8af8f9b5044a94b8f38a96387fc68d P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/4b8af8f9b5044a94b8f38a96387fc68d
I20260709 13:07:10.693928 26609 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.706779 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 4b8af8f9b5044a94b8f38a96387fc68d (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:10.715464 26680 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.722061 27320 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.723379 27607 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.724545 26603 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.727088 27607 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:10.731907 27664 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.739521 27320 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.744360 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:10.749095 26510 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.756917 26609 raft_consensus.cc:2955] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.762593 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:07:10.776376 27692 raft_consensus.cc:1064] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:10.777426 27709 raft_consensus.cc:1064] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:10.781430 27692 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.796684 27709 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.798106 27321 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.799770 27711 tablet_replica.cc:333] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:07:10.803434 26756 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.803840 27664 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.808559 27710 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:10.834148 26609 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.840289 27711 raft_consensus.cc:2243] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.841141 27711 raft_consensus.cc:2272] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.845178 27711 ts_tablet_manager.cc:1916] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:10.844386 27692 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:07:10.875530 27607 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.886569 26609 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.892089 27711 ts_tablet_manager.cc:1929] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:10.893013 27711 log.cc:1199] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/0a4ad5bc4dd54937a7e4f9b1604a7d22
I20260709 13:07:10.894737 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 0a4ad5bc4dd54937a7e4f9b1604a7d22 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:10.900636 27320 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.912633 26680 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.913105 26609 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.916348 26507 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.919309 27320 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:10.918555 26756 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.924103 27658 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.926537 27658 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.931212 27709 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.950081 27658 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.958237 27321 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.962487 26680 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:10.964547 26685 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.968485 26609 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.970542 27607 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:10.976784 27664 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.976905 26603 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.978772 26609 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:10.982424 26509 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 3, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.990123 27320 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:10.993005 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 823c00a7d4b44bbea4d06e2ad87901ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:10.993080 27607 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.018302 26756 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:11.019912 26506 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 1 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.020766 27320 raft_consensus.cc:2955] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.024298 27321 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:11.025749 27658 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.032794 26684 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:11.037041 27673 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.040711 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet 823c00a7d4b44bbea4d06e2ad87901ca with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35536
I20260709 13:07:11.041785 27711 tablet_replica.cc:333] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:07:11.042829 27711 raft_consensus.cc:2243] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:11.043594 27711 raft_consensus.cc:2272] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:11.048884 27678 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.056044 27320 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.058027 26680 raft_consensus.cc:2955] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.062250 26495 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f64501a1194b4fc59c6dc2502e1b7c73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:11.067854 27711 ts_tablet_manager.cc:1916] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:11.074965 26506 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 3 to 4, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:11.089911 27711 ts_tablet_manager.cc:1929] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:11.090410 27711 log.cc:1199] T 823c00a7d4b44bbea4d06e2ad87901ca P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/823c00a7d4b44bbea4d06e2ad87901ca
I20260709 13:07:11.092967 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet 823c00a7d4b44bbea4d06e2ad87901ca (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:07:11.097414 26595 tablet_service.cc:1558] Processing DeleteTablet for tablet f64501a1194b4fc59c6dc2502e1b7c73 with delete_type TABLET_DATA_TOMBSTONED (TS 687d192f79a044ce838f0bf292f0c09f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49430
I20260709 13:07:11.099216 27720 tablet_replica.cc:333] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:07:11.100847 27720 raft_consensus.cc:2243] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:11.102615 27720 raft_consensus.cc:2272] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:11.106902 27720 ts_tablet_manager.cc:1916] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:11.120642 27720 ts_tablet_manager.cc:1929] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:11.120957 27720 log.cc:1199] T f64501a1194b4fc59c6dc2502e1b7c73 P 687d192f79a044ce838f0bf292f0c09f: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/wals/f64501a1194b4fc59c6dc2502e1b7c73
I20260709 13:07:11.122480 26494 catalog_manager.cc:5028] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): tablet f64501a1194b4fc59c6dc2502e1b7c73 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
W20260709 13:07:12.148241 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 84469.9us
I20260709 13:07:13.034391 27726 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:13.047250 27726 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.050079 27726 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.093037 27726 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.093729 27726 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.096808 27726 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.179888 27726 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:13.180608 27726 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.182754 27725 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.183102 27726 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.183312 27725 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.186321 27725 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.251962 27726 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.252882 27726 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.255586 27726 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.265247 27725 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.266127 27725 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.267508 27723 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.268244 27723 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.271095 27723 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.273257 27725 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.326188 27726 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.327131 27726 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.329877 27726 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:13.332690 27725 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.347432 27723 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.428424 27723 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.431227 27723 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.354759 27724 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.431932 27724 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.434381 27724 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.434969 27724 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.436007 27725 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.438531 27725 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.435513 27724 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.441377 27724 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.506477 27728 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.507372 27728 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.511559 27728 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:13.519615 25512 debug-util.cc:398] Leaking SignalData structure 0x7b080000f7a0 after lost signal to thread 26725
W20260709 13:07:13.732018 26541 debug-util.cc:398] Leaking SignalData structure 0x7b080003a880 after lost signal to thread 25510
W20260709 13:07:13.791523 25512 kernel_stack_watchdog.cc:198] Thread 26725 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 383ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:07:13.792212 26541 debug-util.cc:398] Leaking SignalData structure 0x7b0800034f20 after lost signal to thread 26544
I20260709 13:07:13.769693 27725 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.792964 27725 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.444140 27726 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.795756 27726 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.798036 27726 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:13.798501 27726 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.798985 27726 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.788587 27723 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.799973 27723 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.801492 27732 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.802083 27723 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.802004 27732 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.790661 27727 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.804167 27726 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:13.793668 27731 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.794982 27728 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.804821 27731 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.804888 27728 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.805514 27732 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.807020 27728 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.807374 27731 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.807772 27734 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.777894 27724 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.789901 27729 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.812038 27723 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.812119 27729 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.812747 27723 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.814314 27729 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.808739 27731 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:13.815105 27723 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.815009 27731 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.815743 27724 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.817692 27731 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.818092 27724 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.818419 27731 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.818743 27734 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.819141 27731 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.821286 27732 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:13.821769 27732 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.824980 27734 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.831873 27731 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.803910 27727 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.833693 27726 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.834182 27727 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.823581 27732 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.834317 27726 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.838826 27724 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.842046 27729 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.843113 27729 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.845925 27736 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.841223 27724 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.845181 27723 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.845031 27731 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.856226 27725 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.846407 27736 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.857125 27729 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.859776 27739 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.869966 27726 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.870620 27741 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.862372 27732 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.865473 27725 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.867302 27734 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.879907 27735 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.873241 27732 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.863919 27723 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.864281 27731 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.886118 27737 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.888816 27729 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.872960 27739 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.880627 27735 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.889925 27725 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.895609 27728 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.906153 27733 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.906293 27728 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.889752 27734 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.906647 27733 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:13.928717 27724 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.929797 27731 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:13.929695 27736 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:13.893435 27729 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:13.895610 27727 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:13.897624 27726 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:13.871276 27741 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.078146 27740 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.079015 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:13.932674 27730 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:14.087060 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.753s	user 0.018s	sys 0.022s
W20260709 13:07:14.089071 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.953s	user 0.019s	sys 0.022s
I20260709 13:07:14.095790 27735 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.079056 27728 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.078835 27732 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.005630 27727 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.005504 27726 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.078807 27740 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.068128 27746 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.083586 27725 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.078230 27744 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.295902 27742 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.296090 27748 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.102546 27735 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.099200 27743 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.150929 27728 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:13.907550 27737 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.397089 27745 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.397908 27745 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.296870 27748 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.328100 27723 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.296768 27742 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.480261 27734 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.399293 27750 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.315512 27746 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.400209 27735 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.481398 27739 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.501417 27742 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.398540 27728 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.431602 27745 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.302842 27730 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.505578 27726 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.489506 27734 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.507978 27750 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.503626 27749 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.514854 27747 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.509893 27729 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.329903 27744 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.582075 27733 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.582857 27726 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.512140 27745 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.593111 27740 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:14.594620 27750 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.578709 27739 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.580427 27723 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.432400 27743 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.589222 27725 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.513780 27734 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.589547 27729 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.595376 27742 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.604104 27742 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.599114 27748 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.599802 27738 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.595445 27726 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.609478 27724 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.597100 27745 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.535425 27747 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.609508 27746 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.600415 27723 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.601626 27739 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.606856 27740 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.609898 27735 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.603286 27725 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.615007 27734 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:14.607002 27750 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.611433 27741 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.613373 27724 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.627184 27742 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.627835 27724 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.618860 27737 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:14.619181 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.010s
W20260709 13:07:14.628814 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.007s	sys 0.010s
I20260709 13:07:14.603551 27729 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.618860 27730 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.588436 27749 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.617003 27738 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.611857 27748 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.630556 27750 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.625293 27735 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.638172 27741 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.630266 27726 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.629042 27734 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.610507 27753 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:14.644007 26727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.377s	user 0.012s	sys 0.035s
I20260709 13:07:14.624431 27740 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.645823 27728 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.636976 27739 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.645269 27745 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:14.656654 26727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.395s	user 0.013s	sys 0.035s
I20260709 13:07:14.647781 27730 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.657630 27724 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.658495 27751 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.653251 27742 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.660107 27724 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.638849 27748 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.671886 27727 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.672389 27730 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.673866 27743 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:14.674220 26541 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7200 after lost signal to thread 26636
I20260709 13:07:14.675014 27732 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.675261 27737 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.668103 27744 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.660424 27742 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.653131 27741 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.677326 27729 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.649149 27735 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.678270 27723 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.654084 27734 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.661298 27745 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.713064 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.660303 27751 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.666774 27739 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.737989 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.706787 27731 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.710942 27721 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.749648 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.750262 27320 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:14.752876 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.753901 26603 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:14.727933 27738 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.755136 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.743392 27744 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.736570 27732 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.737031 27737 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.711568 27752 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.743292 27745 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:14.747539 27739 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.758791 27747 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.759984 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.884393 27760 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.886595 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:14.887431 26609 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:14.751025 27754 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.665123 27753 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.886744 27760 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.888654 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.889793 27658 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.892728 27320 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:14.892880 27658 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.751142 27736 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.792294 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.793021 27756 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.792768 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.792047 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.899299 27318 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:14.906000 26608 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:14.839826 27757 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.907137 26610 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:14.907392 27757 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.909227 27673 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:14.909729 27757 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.909684 27673 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.911751 27753 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.912575 27673 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.872149 27724 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.830858 27740 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.913208 27658 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.889413 27725 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:14.912330 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:14.916085 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.918030 27318 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:14.918856 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.751897 27731 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.795287 27721 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.924111 27751 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.924965 27731 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.925041 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.926017 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.926607 27318 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:14.840899 27744 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.914508 27736 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.930979 27721 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.931912 27736 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.932192 27758 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.932549 27734 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.913753 27754 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.915005 27753 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.919206 27749 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.793233 27755 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.962034 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:14.962709 26754 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:14.962869 27760 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:14.963127 27732 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.927989 27748 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.964673 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.965296 26609 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:14.926174 27740 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.940593 27731 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:14.956599 27736 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:14.971616 27741 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.971547 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:14.956526 27730 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.932948 27758 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.977893 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:14.978621 26685 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:14.975193 27318 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:14.976526 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:14.976938 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.009632 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.974736 27748 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.029501 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.037784 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.038105 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.037815 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.039402 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.969911 27753 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.975960 27735 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.046075 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.047006 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.056161 26603 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.056742 26608 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.009773 27742 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.032279 27739 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.915782 27752 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.049573 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.050091 27744 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.050570 27750 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.045481 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:14.977626 27754 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.975294 27740 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.047222 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.073052 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.058245 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.059041 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.059211 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.059849 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:15.042915 26541 debug-util.cc:398] Leaking SignalData structure 0x7b0800280060 after lost signal to thread 26711
I20260709 13:07:15.062587 27737 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.063359 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.064178 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.065026 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.065095 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.066659 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.087500 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.087764 27753 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:14.978792 27731 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.984290 27736 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:14.919911 27756 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.075495 27318 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.073920 26682 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
W20260709 13:07:15.074033 27286 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.645s (SENT) [suppressed 3 similar messages]
I20260709 13:07:15.041177 27748 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.076861 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.091360 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.098388 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:14.976871 27755 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.110766 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.112036 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.112586 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.112672 26685 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.112402 26683 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.114060 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.115238 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.115797 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.116147 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.116379 26609 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.074478 27735 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.117600 27673 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.117846 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.118005 27658 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.120560 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.108798 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.110627 27736 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.148345 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.122710 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.150326 27735 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.122769 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.150571 26682 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.154875 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.150890 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.149935 27673 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.151213 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.149035 26604 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.114786 27742 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.117251 27753 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.159248 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.166258 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.153797 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.157253 26685 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.157632 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.117419 27721 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.160733 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.153487 27658 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.151567 26683 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.151734 27735 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.161782 27673 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:15.108695 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:15.166273 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.153855 27758 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.167497 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.152609 27752 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.169107 27755 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.120697 27737 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.170440 26684 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.172307 26686 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.152280 26679 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
W20260709 13:07:15.177297 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 251510us
I20260709 13:07:15.166328 27753 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.180299 27658 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:15.171578 26541 debug-util.cc:398] Leaking SignalData structure 0x7b080020a3c0 after lost signal to thread 27345
I20260709 13:07:15.180469 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.181036 26687 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.188558 26685 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.166539 27742 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.174290 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.176348 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.176508 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.189046 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.189553 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.174855 26605 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.190598 27748 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.191738 27764 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.187299 27753 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.193572 27731 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.183965 27737 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.176605 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.184217 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.196619 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.198431 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.216171 26683 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.216408 27756 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.199599 27740 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.197263 27747 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.200644 26684 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.175009 27721 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.206705 27673 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.207481 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.203897 27763 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.216364 27318 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.198127 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.225106 27673 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.218317 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.220472 26680 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.221135 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.227301 26686 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.221822 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.221987 27745 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.204594 26681 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.214933 26604 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:07:15.196874 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90065.1us
I20260709 13:07:15.241632 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.242226 27673 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:15.225571 26611 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.235651 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.236364 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.237752 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.218981 27737 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.240293 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.243837 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.243953 26608 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.244704 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.245221 26686 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.243238 26679 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.248199 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.248728 26687 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:15.249066 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.249631 26686 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:15.250524 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.250639 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.251418 26682 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
W20260709 13:07:15.256060 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 144597us
I20260709 13:07:15.260056 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.260752 26756 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.233676 27747 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.261286 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.261876 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.233985 27764 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.263770 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.274060 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:15.275053 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67683.4us
I20260709 13:07:15.278041 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.268935 27747 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.280121 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.268853 27764 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.260368 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.260955 27763 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.294646 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.279745 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.264618 27753 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.300272 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.302031 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:15.286721 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.264822 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:15.302743 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.368278 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.363261 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.316833 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:15.412686 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 110737us
I20260709 13:07:15.317641 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.388447 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.416109 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:15.305392 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.308529 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.308988 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.414675 26759 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.313612 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.308043 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.419775 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.362515 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.348572 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.384317 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.416740 27756 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.421665 27756 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.397939 27747 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.422091 27756 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.316963 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.423887 26607 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:15.424130 27748 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.295560 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.427016 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.428143 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.425565 27753 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.425956 27764 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.426319 27748 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.436677 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.437088 27748 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.437865 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.438470 26756 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.426244 27735 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.426833 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.309417 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.420424 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.430162 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:15.428143 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.431281 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.318470 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.454996 26686 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:15.434329 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.455551 26610 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.455957 26678 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:15.435536 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.424782 27763 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.303488 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.367151 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.460227 26755 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.461056 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.461143 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.462074 26755 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.310470 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.311959 27742 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:15.468463 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.384886 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.373318 27721 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:15.431427 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.444006 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.444238 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.474226 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.475085 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.444485 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.443269 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:15.476212 26608 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.476475 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.447407 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.447620 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.448017 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.448153 27725 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.480508 27725 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.480693 27741 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.480983 27725 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.481091 27741 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.481488 27741 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.449086 27737 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.449349 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:15.450963 27735 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.488794 27742 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.488606 26755 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:15.489221 27742 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.489641 27742 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.489955 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.388970 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.303418 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.454572 27764 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.458928 26687 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:15.491626 26683 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:15.376048 27771 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.463572 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.475203 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.475320 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.476390 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.302428 27772 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.487393 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.487659 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.480531 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.506012 27771 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.506067 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.506578 27771 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.486828 27745 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.508283 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:15.510561 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90198us
I20260709 13:07:15.512944 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:15.514132 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:15.514873 27321 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.520612 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.520612 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.523964 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.517117 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:15.529040 27321 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:15.508570 27772 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.527632 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:15.530229 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:15.489655 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.532925 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.536645 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.537622 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.534543 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:15.541320 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.544190 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.495462 27748 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.542263 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.548026 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.550163 27774 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.532438 27772 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.550669 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.515967 26758 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:15.535051 27678 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:15.530815 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 274881us
I20260709 13:07:15.534873 27758 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.534570 27736 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.550658 26681 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:15.550971 27775 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:15.542512 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67532.1us
I20260709 13:07:15.558534 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:15.542276 27731 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.603590 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.604400 26612 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:15.607926 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.609917 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.611514 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.557844 27678 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.556238 27774 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.618587 27318 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:15.617858 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:15.575565 27777 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.631460 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.578262 27736 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.606087 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.636010 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.636269 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.634068 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:15.638091 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.603945 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:15.577608 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.645653 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:15.576225 27758 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:15.577306 27775 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.671193 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:15.632817 27678 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.680796 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.686518 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.635329 27774 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.670130 27736 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.690374 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:15.691555 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:15.694238 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.694308 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.694828 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:15.695101 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.695889 27732 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.696174 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.696357 27732 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.696784 27732 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.696997 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.694419 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.697805 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:15.698393 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:15.693444 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.680269 27775 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.686618 27759 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.687453 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.708564 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.691418 27777 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.692229 27731 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.711444 27731 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.711890 27731 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.715049 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:15.698367 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 88218.3us
I20260709 13:07:15.707782 27753 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.724224 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:15.712670 27777 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.724761 27753 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:15.740288 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 113401us
I20260709 13:07:15.741374 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:15.727394 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 148788us
I20260709 13:07:15.748674 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:15.718664 27725 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.752146 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:15.737151 27740 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.756299 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:15.732493 27777 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.739094 27745 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.740658 27753 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.724443 27767 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:07:15.810842 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86679.4us
W20260709 13:07:15.811779 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 101384us
I20260709 13:07:15.752779 27770 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.734362 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:15.757258 27768 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.727617 27758 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.809048 27740 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.752103 27756 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.832741 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.810704 27745 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:15.821031 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.810611 27782 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.853276 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:15.843798 27740 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.861847 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:15.864137 27735 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:15.846451 27745 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.846189 27770 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.851889 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.884757 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.860483 27782 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.879379 27735 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.892028 27747 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:15.883543 27764 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.902261 27747 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.904819 27747 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:15.905260 27747 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.904810 27737 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.913403 27759 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.913827 27759 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:15.910487 27748 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:15.892117 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.890460 27782 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.897643 27735 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.901829 27764 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:15.929587 27742 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.914721 27747 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.936550 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.936865 27764 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.957942 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:15.914598 27759 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.936740 27771 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:15.953109 27725 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:15.997749 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 241527us
I20260709 13:07:15.967069 27736 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.983063 27732 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:15.988785 27756 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:16.011152 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.008581 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:16.013453 27658 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:15.976917 27742 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:16.005245 27741 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.521s	user 0.016s	sys 0.003s
I20260709 13:07:16.003284 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.038707 26612 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.012907 27317 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.017016 27759 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.046706 27658 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:16.014146 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 260913us
I20260709 13:07:16.047250 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.030392 27780 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.027417 27772 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.056550 26607 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:16.041317 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.059825 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.061563 27732 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.062301 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:16.063653 27678 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.066517 27658 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.068965 27673 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.067813 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.082669 27658 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:16.083232 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53624.8us
W20260709 13:07:16.074965 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 346979us
I20260709 13:07:16.074429 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.089799 27673 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.030117 27761 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:16.080440 27747 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.087601 27742 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.091684 27742 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.092093 27742 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.096167 27761 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.096644 27761 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.097522 27761 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.086112 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.098865 27761 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.102566 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.037799 27741 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.108039 27789 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.108690 27789 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:16.109140 27789 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.110888 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.114631 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.112687 27725 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.108075 27747 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.119226 27747 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.119778 27731 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.121872 27736 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.122213 27731 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.115113 27756 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.119796 27747 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.123104 27756 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.123733 27756 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.129194 26753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:16.130225 26753 raft_consensus.cc:606] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:16.087081 26724 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a6cdf3163c8419d9d0c3ee399cc76d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:16.084666 27658 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.110574 27745 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.160769 27658 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.136979 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.162606 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.119030 27678 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.109688 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:16.131453 27782 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.188788 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.113981 27772 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:16.151233 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 64304.4us
I20260709 13:07:16.202579 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.188009 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.203133 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.303766 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.202126 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:16.327557 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 164987us
I20260709 13:07:16.331696 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.188401 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.332541 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.333420 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.334614 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.138067 27725 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:16.205724 27774 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.005s
I20260709 13:07:16.337190 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.342715 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.343050 26610 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.180135 27748 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.136344 27740 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.344599 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:16.349783 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 496570us
I20260709 13:07:16.208014 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.290930 27793 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.343555 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.163746 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.163465 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.287029 27771 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.301061 27745 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.361801 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.345038 27752 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.292021 27742 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.364053 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.362262 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.355330 27791 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.367132 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.368824 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.138474 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.369455 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34cdb199be824317848395c2d8402714"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "77c617823f2e4a938ef247a8924e299b"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:16.360744 27748 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.207499 27735 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.350521 27755 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.204699 27777 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.365216 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:16.383411 27791 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.356072 27774 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.360505 27741 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.355702 27772 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.385440 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.388456 26754 raft_consensus.cc:606] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:16.365690 27775 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.650s	user 0.000s	sys 0.012s
I20260709 13:07:16.390200 27748 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.395725 27791 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.397400 27735 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.390425 27755 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.410355 27673 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:16.410876 27673 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.409643 27775 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.418118 27775 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.420028 27782 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.401346 27771 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.399088 27787 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:16.379969 27725 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.431056 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e4cacedac354143ab8977803382d0af"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "77c617823f2e4a938ef247a8924e299b"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:16.404973 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.362406 27763 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:16.364078 27793 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:16.404160 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:16.433293 27793 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:16.433487 27753 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.002s
I20260709 13:07:16.386752 27745 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.373840 27752 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.437772 27752 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.433887 27753 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.416124 27755 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.425091 27319 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:16.412441 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 278962us
I20260709 13:07:16.411839 27794 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.427628 27722 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:16.429205 27777 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.432534 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.389817 27747 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.436348 27673 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:16.431874 27725 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.447359 27753 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.426822 27764 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.435629 27735 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.436101 27745 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.459461 27740 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.464367 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.480242 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.481737 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.483101 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.466849 26604 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.470669 27318 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.465795 27731 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.488652 27786 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.489082 27786 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.471249 27725 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.486312 27736 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.486335 27794 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.465272 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.466779 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.485854 27784 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.477048 27745 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.493147 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.487380 27732 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:16.497160 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 285746us
I20260709 13:07:16.491276 26510 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.505267 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.497401 27740 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.512770 27777 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.492590 27742 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:16.515450 26653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.014s	sys 0.060s
W20260709 13:07:16.515849 26653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.060s
I20260709 13:07:16.491627 27786 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.517668 27786 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:16.526554 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 139382us
W20260709 13:07:16.530815 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 193685us
I20260709 13:07:16.530774 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.487537 27789 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.534180 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.505079 27732 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.531988 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.501552 27784 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.552858 27784 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.552893 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.504721 27758 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.538612 26759 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:16.552142 27673 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:16.554322 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:16.538964 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.560304 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:16.520341 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62161.6us
I20260709 13:07:16.551493 27732 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.539983 27777 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.556597 27742 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.557314 27774 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.581506 26687 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.582242 26686 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:16.583848 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81773.3us
I20260709 13:07:16.584823 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.559213 27764 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:16.590857 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.593263 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:16.599696 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.568753 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.607179 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:16.579394 27742 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.579708 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.579942 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.609405 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:16.614640 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 108607us
W20260709 13:07:16.614965 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 505344us
I20260709 13:07:16.616107 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:16.616933 27777 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.617399 27777 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.617859 27777 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.621645 27784 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.624310 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.625216 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.626135 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.626911 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.629495 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.636250 27795 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.605245 27747 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.611155 27721 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.609268 27742 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.614059 27753 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.628504 27740 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.605197 27756 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.668015 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.671149 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.681192 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.637607 27764 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.644058 27758 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.694861 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:16.644632 27317 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.701128 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:16.666143 27759 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.003s
I20260709 13:07:16.702956 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:16.703616 27785 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.704100 27790 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.658361 27721 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.761443 26609 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.765738 27752 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.767527 26608 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.769533 27768 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.693998 27740 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.696467 27792 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.700589 27758 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.637117 27806 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.749823 27673 raft_consensus.cc:993] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower 687d192f79a044ce838f0bf292f0c09f to start an election
W20260709 13:07:16.697664 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56770.9us
I20260709 13:07:16.699245 27795 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.724790 27753 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.663344 27784 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.803102 27789 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.808696 27756 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.843400 27766 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:16.843961 27766 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.844414 27748 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.846421 27766 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.846338 27755 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.692844 27731 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.696427 26678 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.770785 27768 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.811293 27799 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.812312 26681 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.758441 26754 raft_consensus.cc:606] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Received request to transfer leadership to TS 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:16.865175 26754 raft_consensus.cc:614] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.776511 27764 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.838680 27779 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:16.840642 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:16.841487 27725 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.751119 27760 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:07:16.776223 27790 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.824955 27758 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.770864 27791 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.887894 27725 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.849517 27780 raft_consensus.cc:1081] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Signalling peer 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:07:16.849228 27752 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.854928 27806 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:16.881834 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:16.896077 27806 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.885859 27788 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:16.861528 27768 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.891709 27791 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.849519 27748 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.900588 27789 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.906013 27790 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.908893 27790 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.897806 27745 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.911865 27788 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.900326 27768 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.936471 27773 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.937759 27768 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.937920 27773 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:16.942416 27788 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.942168 27745 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:16.934547 27777 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.945575 27777 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:16.953550 27793 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:07:16.954195 27793 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:16.957669 27793 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:16.956072 27773 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:16.963184 27773 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.994719 26603 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:16.996457 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 372150us
W20260709 13:07:16.996883 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 295697us
I20260709 13:07:16.998620 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:17.000350 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 445926us
I20260709 13:07:17.003368 26607 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.004603 26606 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.008737 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.014214 26684 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.051743 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.017000 26686 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.017671 26679 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:17.016913 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.018846 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:17.021677 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 180981us
W20260709 13:07:17.024153 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.028563 27317 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.029767 27313 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.030110 27318 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.031128 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:17.031294 27314 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.918467 27721 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.032989 27315 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.959619 27742 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.034674 27316 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.057498 27748 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.084252 27748 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.084851 27721 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.058331 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.053215 27752 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.061327 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.087002 26684 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.095939 26607 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.084913 27748 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.055164 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.102087 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:07:17.045332 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.937104 27755 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.047968 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.103258 26752 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:17.046906 27732 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.103943 26608 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:17.105332 26687 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.106321 27732 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:17.104084 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.055895 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.108806 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.090790 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.103971 27752 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.110358 26687 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.110845 27752 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.107180 27742 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.111481 27752 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.112979 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 114748us
I20260709 13:07:17.114768 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.115156 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:17.053325 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.115850 26754 raft_consensus.cc:606] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:17.116283 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63212.8us
I20260709 13:07:17.117144 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.117481 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:17.110352 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.122535 27760 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.124644 27760 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:17.127923 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.125998 27766 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.131686 26684 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.133816 27786 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.134735 27786 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.135982 27742 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.136673 27742 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.137678 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:17.138134 27768 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.138614 27806 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.139106 27774 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:17.140808 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.059172 27758 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.139537 27742 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.147070 27787 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.148636 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:17.148841 26683 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.148721 27778 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.141248 27806 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.142714 27786 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:17.154948 27802 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:17.156456 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.156584 26606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:49434
I20260709 13:07:17.156410 27811 ts_tablet_manager.cc:933] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.156759 27770 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.162915 27770 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.163153 27802 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.163594 27802 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.157873 27810 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:17.160480 27808 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.161564 27790 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.149742 27787 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.153631 27778 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.162467 26603 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.172513 27795 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.173087 27795 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.176908 27790 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.177562 27787 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.181078 27810 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.181331 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.181574 27778 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.184078 27794 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.183000 27774 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.184523 27794 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.184711 27774 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.185166 27774 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.179502 27787 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.185830 27794 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.189155 27794 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.170918 27808 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.191705 27808 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.174911 27795 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.182413 27806 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.184103 27778 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.195634 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63501us
I20260709 13:07:17.165899 27802 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.200443 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.204645 26603 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:17.204566 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:17.205487 27810 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.202693 27790 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:17.206615 27758 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.195480 27770 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.209618 27770 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.206604 27313 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:17.212569 26752 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:17.217973 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.220144 27760 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.220607 27760 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.221802 27760 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.223191 27760 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.225385 27774 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:17.235865 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.226205 26754 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.226315 27785 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.230947 27313 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.242746 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.238332 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.238723 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.239244 27785 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.240209 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:17.241029 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.208969 27795 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.235399 27748 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:17.244047 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61325.4us
I20260709 13:07:17.245301 27806 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.244686 26758 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.249446 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93161.8us
I20260709 13:07:17.249176 27806 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.252920 27806 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.253307 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.256295 26608 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.256040 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.257903 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.259282 27811 tablet_copy_client.cc:323] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:17.259831 27801 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.263391 27758 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.264528 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.263319 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.264811 27313 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.263487 26608 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.260895 27748 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.264348 27801 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.267814 27807 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.261257 27802 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.271231 27807 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.262693 27752 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.272818 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.250506 27810 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:17.273622 27807 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.276345 27758 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.276777 27758 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.277947 27758 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.279438 27758 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.281643 26753 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.282791 26761 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.260457 27785 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.284425 27785 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.287503 27764 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.289481 27764 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.289860 27764 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.291059 27764 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.293870 26761 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.292423 27764 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.299564 26610 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.287458 27313 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.299072 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.302114 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:17.308889 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:17.308843 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.309755 27320 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:17.299952 27801 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:17.310940 27317 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:17.316857 27791 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.317365 27791 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.317809 27791 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.318768 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.316934 27766 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:17.327400 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46247.9us
I20260709 13:07:17.327936 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.331483 27788 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.331898 27788 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:17.338678 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:17.334970 27788 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.345057 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.344656 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.339875 27766 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.347314 26608 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.338955 27774 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.349260 27766 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.357715 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.351779 27752 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.361071 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:17.361820 27799 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:17.362038 27779 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:17.362319 27799 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.362376 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.362864 27799 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.363528 27725 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.363961 27725 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:17.354807 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:17.367102 27721 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.367202 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.367911 27320 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:17.368002 27317 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:17.369156 27721 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.368227 27779 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.370086 27768 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.370121 27779 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.364378 27725 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.371330 27779 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.371906 27768 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.373278 27790 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.373725 27790 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.372951 27779 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.378190 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.364102 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.366952 27763 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.376650 27317 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:17.379371 27763 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:17.379807 27763 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.377345 27721 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:17.382927 27810 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:17.385761 27748 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.386138 27752 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.389005 27803 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.388111 27678 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:17.389402 27803 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.390374 27803 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.392179 27803 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.378468 27808 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.384369 27778 raft_consensus.cc:993] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:07:17.400313 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.403894 26605 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.407859 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.390360 27721 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:07:17.403664 27778 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.411572 27766 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:17.411733 27761 raft_consensus.cc:1081] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Signalling peer 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:07:17.402009 27748 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:07:17.414391 27773 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.408609 26606 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.416078 27748 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.416109 26606 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.416602 27748 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.417598 27748 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.418413 27755 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.419344 27748 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.419782 27767 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.420149 27767 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.420917 27767 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.421864 27767 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.423054 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59051us
I20260709 13:07:17.428071 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.432907 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:17.433811 27742 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.435060 26607 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.435657 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.436368 27791 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:17.436900 26610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:49434
I20260709 13:07:17.438233 26604 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.438422 26610 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.438623 27791 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.438905 26610 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.438542 27773 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.441026 27761 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.441424 27761 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.442608 27761 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.374636 27790 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.443889 27761 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.444620 27790 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.414567 26755 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
W20260709 13:07:17.445851 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.434717 27806 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.451725 27807 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.452992 26603 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.408063 27752 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.455890 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.454110 27807 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.454524 26606 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.448438 27808 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:17.460085 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 75504.6us
I20260709 13:07:17.407650 27760 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:07:17.461278 26683 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:17.441210 27742 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.456398 26610 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.467872 27760 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.462070 27801 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:17.483299 26610 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.506728 26754 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.473166 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.474632 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.475767 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.476794 26681 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.477344 26687 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.508993 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.509835 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.510219 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.511037 26678 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.510941 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.477923 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.511941 26684 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.483815 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.512234 27774 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.512732 27774 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:17.509021 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.513667 27774 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.484138 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.484483 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.515064 27788 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.517832 26761 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.518821 27788 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:17.485452 27773 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:17.519865 27721 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.520299 27721 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:17.521054 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48130.1us
I20260709 13:07:17.521207 27721 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.522436 27768 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.522169 27721 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.523458 27678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47576 (request call id 8) took 2081 ms. Trace:
I20260709 13:07:17.483887 27764 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.492447 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.493080 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.495700 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.500168 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.461760 27725 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.501202 27787 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.514178 26687 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.520007 27773 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:17.491719 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45143.6us
I20260709 13:07:17.492307 26606 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.535300 27773 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:17.536124 27725 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.536279 27786 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.537046 27786 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.538556 27763 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.524061 27678 rpcz_store.cc:276] 0709 13:07:15.442368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.463830 (+ 21462us) service_pool.cc:224] Handling call
0709 13:07:15.572053 (+108223us) log.cc:844] Serialized 513 byte log entry
0709 13:07:15.906404 (+334351us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b18000f83e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3557 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:17.523305 (+1616901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40558,"raft.queue_time_us":49113,"raft.run_cpu_time_us":2352,"raft.run_wall_time_us":102357,"spinlock_wait_cycles":17048320,"thread_start_us":92864,"threads_started":1,"wal-append.queue_time_us":140571,"wal-append.run_cpu_time_us":2289,"wal-append.run_wall_time_us":1027219}
I20260709 13:07:17.539572 27786 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:17.481845 27760 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.541471 27788 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.541883 27788 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.542044 27763 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:17.542671 27763 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.542779 27788 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:17.543704 27778 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.527796 26683 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:17.534054 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.544178 27787 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.545625 27313 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.545869 27787 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.544080 27778 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.546825 27787 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.548031 27787 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.533329 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.553407 26680 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.556165 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:17.556308 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.556948 26605 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.556941 27778 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.561458 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.563483 27778 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.563947 26603 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.564580 27806 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.544375 27760 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.565487 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.566154 26753 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.566416 27760 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.544278 27788 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.562292 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:17.571002 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-3a6cdf3163c8419d9d0c3ee399cc76d1
I20260709 13:07:17.573812 27764 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.574103 26605 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:17.569192 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.570391 27791 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.574893 27764 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.588719 27764 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.589746 27764 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.575188 27786 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.590091 26510 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.592206 27766 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.592595 27766 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.593412 27678 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.594604 27773 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.594969 27773 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.595973 27773 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.597345 27773 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.593474 27766 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.598819 27766 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.586289 27799 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.599722 26606 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:17.600764 27799 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:17.584815 27791 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.598001 26506 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.601518 26771 tablet_copy_source_session.cc:215] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:17.601976 27791 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.603605 27791 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.603880 27803 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.608943 26604 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.567993 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.612675 27787 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.544394 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.615306 26754 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:17.616086 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.617828 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.629751 26607 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:17.630102 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.618117 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.618249 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.631496 26606 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.618652 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.619563 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.620008 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.618144 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.591163 27764 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.621243 26603 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
W20260709 13:07:17.623001 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 89721.8us
W20260709 13:07:17.628695 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.634469 26611 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.633383 26609 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:17.632834 26605 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.642129 27760 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.643944 27774 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.644623 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.644681 27774 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:17.645512 27791 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.645833 26603 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.646040 27774 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.646934 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.647040 27760 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:17.643857 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 99572.9us
I20260709 13:07:17.653995 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.649458 27786 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.646623 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.652343 27760 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.652338 26605 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.656889 27793 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.657212 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.658478 27791 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.654753 27786 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.661314 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:17.664249 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.661193 27773 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:17.660181 27787 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.664070 27803 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.666344 27810 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.667250 27773 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.656420 26753 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:17.675529 27810 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.676569 27810 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.674666 27773 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.679735 27785 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.680805 27785 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.681126 27785 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.681313 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.682034 27785 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.683192 27785 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.683517 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.684625 26680 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.684638 26687 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:17.685977 26724 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2da4a43c4ca64471b27b22ea1a167d13. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.687351 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.689010 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.689659 26683 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.690290 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.695037 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.695156 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.695852 26685 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.696133 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.696427 27801 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.695164 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.697463 27801 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.697916 27801 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:17.698308 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.698669 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.698746 27801 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.699329 27791 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.700534 26755 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:17.699302 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.693044 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:17.661229 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.692194 27787 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.703708 27803 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.707087 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.711033 26683 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:17.706524 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:17.721089 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.707818 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.706131 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.714612 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.723219 26684 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.715207 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.704941 26680 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:17.724681 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.704969 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:17.725828 26610 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:17.716116 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.704093 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:17.709836 26603 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:17.728453 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.712080 27773 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.714042 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:17.729843 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.730167 27773 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.730769 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.706421 27801 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.732225 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.731405 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.735054 26682 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.729228 26681 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.738163 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.740091 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.742691 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:17.743327 26685 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:17.743387 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.745349 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.747190 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:17.748375 27678 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.748205 26679 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.751324 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52245.5us
I20260709 13:07:17.720435 27793 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:17.761575 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.747887 27766 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:17.765728 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59276.6us
I20260709 13:07:17.765368 27768 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:17.766973 27768 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.767375 27768 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.767539 27799 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.763947 27779 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.768788 27806 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.769156 27806 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.766453 27731 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.770103 27806 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.773051 27755 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.774217 27748 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.774600 27748 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.737876 27764 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:17.775439 27748 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.777371 26612 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.778980 27778 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.742036 27770 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:17.779910 27806 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.751184 27791 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.749971 27803 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.779978 27778 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.780483 27763 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.789534 27791 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.752072 27761 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.792421 27678 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.790968 27778 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:17.794759 27791 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.795392 27778 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.796880 27778 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.794395 27793 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.792164 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.705374 27786 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.803337 27786 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.711129 27787 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.807561 27799 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.808444 27748 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.820598 26754 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:17.826253 26679 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:17.851341 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59256.6us
W20260709 13:07:17.884231 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58603.8us
I20260709 13:07:17.885396 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:17.886197 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:17.899458 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:17.896528 26510 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.852622 27779 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:17.902915 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 150021us
W20260709 13:07:17.907104 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.896842 27755 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.907569 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.910372 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.901214 27810 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.902894 27803 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:17.914631 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.919082 27829 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:17.919615 27836 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.057s	user 0.002s	sys 0.007s
I20260709 13:07:17.919749 27829 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:17.920812 27829 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.914728 27731 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.924028 27755 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.925800 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.925925 27826 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.926474 27725 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:17.926898 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.927000 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:17.927448 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.927876 27832 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.928139 27803 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.917181 27810 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.928627 27832 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:17.928872 27825 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:17.929169 27803 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.929340 27810 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.929848 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.930665 27832 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.931862 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.932575 27832 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.932819 27779 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:17.934715 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.935470 27832 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.902722 27799 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:07:17.937613 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.960479 26681 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:17.960264 27795 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.961675 27832 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.962086 27832 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:17.963217 27832 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.963959 26679 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:17.914530 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 253376us
I20260709 13:07:17.964776 26506 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.960353 27731 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.926541 27826 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:17.965776 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.971438 27768 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.973929 27768 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:17.975775 27799 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.981927 26686 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:17.965143 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:17.985296 27799 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:17.985112 27819 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:07:17.986790 27755 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:17.987977 27819 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.988481 27819 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:17.984504 27832 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.986604 27807 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.992354 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.001377 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.002170 27731 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.000182 27807 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.008867 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:18.006953 27795 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.017582 27807 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:17.989614 27819 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.015144 27748 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:18.015583 27799 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.006150 27778 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:18.025702 27778 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.027870 27778 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:18.010322 27826 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:18.029978 27833 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:18.025792 27748 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.014335 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.023357 27317 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.035043 27748 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.035635 26686 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.038558 27806 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.039868 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.041034 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.041152 27819 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.000824 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.037181 27807 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.048652 26686 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.053054 27806 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.060875 27837 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:18.037643 27748 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.064638 26679 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:18.069360 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.073900 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.077049 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.077310 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.081768 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:18.082680 26685 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.084637 27828 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.085156 27828 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:18.079463 26680 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:18.086047 27828 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.088313 27731 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.088482 27785 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.089012 27785 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.089629 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:18.092844 27785 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.099912 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.116735 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.117604 26754 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:18.117695 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.078876 27832 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.080466 27807 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:18.076404 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93642.1us
I20260709 13:07:18.108808 27778 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:18.126710 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.119633 27810 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.143054 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.122308 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:18.143527 27841 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 13:07:18.121893 26610 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:18.147015 26685 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:18.148974 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.105680 27819 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.149526 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.169868 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.187342 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.163077 27832 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.196383 26611 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.171330 27785 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:18.174620 26506 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.180693 26510 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.202172 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.203402 26758 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.203584 26506 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.186338 27801 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.200353 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.195098 27826 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:18.189498 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46611.8us
I20260709 13:07:18.209657 26510 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.202421 27731 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.171922 27810 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.200966 27785 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.214854 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.224936 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.225579 26761 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.219930 26510 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.222074 27801 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:18.233572 26758 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:18.221172 27844 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:18.226555 27826 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:18.247038 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56577.9us
I20260709 13:07:18.214287 26506 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.243754 27766 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.227700 27785 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.221817 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.230952 27768 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.251004 26686 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.261900 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.263257 27811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:18.264195 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.265656 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.271531 26758 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.254400 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.278568 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.245662 27731 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:18.284436 26754 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.287724 27732 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.288002 27779 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:18.289461 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.281384 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.282392 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:18.292667 27843 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:18.297709 26758 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.301982 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:18.304607 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.309520 26761 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.312465 26759 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:18.271423 27768 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.315743 26611 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.317306 26760 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:18.317502 27768 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:18.319516 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:18.319649 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.320241 26611 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:18.320335 27773 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.320242 26686 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:18.323240 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.324378 26756 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:18.324838 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.325593 26758 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:18.327977 26610 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.328418 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.331709 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.332993 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.335199 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.331863 26755 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.285226 27801 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.280370 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.355397 26610 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.365605 26756 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.354754 27828 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.367072 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.367215 27828 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.367743 27829 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.369889 27829 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:18.370209 27842 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:07:18.370822 27829 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.372531 27810 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.373365 27317 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:18.369419 27828 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.367228 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.378515 26612 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.345515 27768 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:18.384891 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.387920 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.292701 27826 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.392400 26761 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.395562 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.390823 26758 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:18.376132 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 103508us
I20260709 13:07:18.399909 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.399127 26610 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.408699 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.412577 26756 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.412935 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.413774 26612 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.414943 26753 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:18.415362 26752 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.416237 27819 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:18.417317 27819 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:18.417673 27819 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.418445 27819 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:18.424642 27320 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.426476 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.427088 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.427676 26754 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.427721 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.431160 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.431975 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.434085 26760 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.434631 26753 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.436578 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.436983 26757 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:18.437526 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.439965 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.439616 26761 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.442329 26754 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:18.452026 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:18.459430 26758 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.461088 26606 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.462369 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.464908 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.467558 26606 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.468688 27758 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.469213 27758 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.469815 27748 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:18.471179 27758 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:18.471763 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 144870us
I20260709 13:07:18.472744 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.474906 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.405676 27785 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.476725 26756 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:18.478000 27785 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.481468 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.482441 27807 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.419528 27819 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:18.490823 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.494910 26609 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.496232 26685 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.497535 26606 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:18.497829 26611 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.499105 26684 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.501760 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.502548 26604 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.504583 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.505299 26603 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.504452 27773 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.506356 26680 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:18.508769 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.483448 27748 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.517490 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.520852 26756 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.511523 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.476758 27731 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:07:18.518333 27755 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.493181 27779 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:18.530869 26605 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.531775 27810 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.533875 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.510954 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:18.540726 27806 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.541368 26752 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
W20260709 13:07:18.540484 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 94892.8us
I20260709 13:07:18.547535 26611 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.528766 27828 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:18.570449 27768 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.570973 27768 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.550680 27806 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.577126 27807 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.546032 27779 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.538882 27810 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.579815 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.594722 27806 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.600735 27766 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:18.603157 27810 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.595149 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.603998 26752 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.601126 27779 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:18.603237 27794 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.604743 27807 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.588469 26761 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.605216 27794 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:18.607231 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.587633 26754 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:18.604405 26650 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c04d1d6cb7c54df78a1746de67ce6198. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:18.610133 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 104958us
I20260709 13:07:18.605724 27807 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.581669 27768 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.628769 27764 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.628942 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.629397 27768 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:18.635342 27811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46926 (request call id 196) took 1917 ms. Trace:
I20260709 13:07:18.635474 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.636518 26754 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.636879 27826 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.639261 27313 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:18.640862 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61134.5us
I20260709 13:07:18.642256 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.645622 27794 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:18.645711 26754 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.646440 27826 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.647506 27785 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:18.653558 27858 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 13:07:18.635841 27811 rpcz_store.cc:276] 0709 13:07:16.717666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.724505 (+  6839us) service_pool.cc:224] Handling call
0709 13:07:17.126025 (+401520us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b18003138a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:17.170207 (+ 44182us) ts_tablet_manager.cc:934] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
0709 13:07:18.257907 (+1087700us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:18.420825 (+162918us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:18.420949 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:18.576284 (+155335us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:18.576591 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:18.631762 (+ 55171us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:18.635245 (+  3483us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10485,"spinlock_wait_cycles":435501312,"tablet-copy.queue_time_us":169339,"thread_start_us":196427,"threads_started":2}
I20260709 13:07:18.659358 27811 tablet_copy_client.cc:806] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:18.660149 27811 tablet_copy_client.cc:670] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:18.665416 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:18.666534 26681 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:18.669880 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.634897 27857 ts_tablet_manager.cc:933] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.672439 27764 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.672966 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.674750 27793 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:18.676241 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:18.675182 27793 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.676573 27794 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.676872 26685 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.677294 27828 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:18.677659 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.678598 27826 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:18.676913 27793 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.686372 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.693341 26756 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:18.697674 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:18.705500 26685 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:18.705545 26612 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:18.707515 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:18.701006 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.716957 26757 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.696115 27810 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.722100 27318 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:18.664497 27819 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:18.723827 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.737744 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:18.725172 27811 tablet_copy_client.cc:538] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:18.730543 27788 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.761266 27832 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:18.760383 27794 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.736963 27826 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:18.795462 27832 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.786927 27806 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.783000 27731 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.787957 27788 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:18.852007 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 318224us
I20260709 13:07:18.840865 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:18.855873 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:18.841486 27748 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.844844 27832 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.859500 26608 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.843544 27755 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.875849 27748 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.883111 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.884101 26760 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.861210 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:18.887547 27788 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.865914 26607 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:18.852102 27806 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:18.894970 27859 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:07:18.911303 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.857436 27731 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.945528 27731 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.948007 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:18.951840 27732 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.946154 27731 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.958551 26509 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.959288 27731 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.961282 27731 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.966418 27732 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:18.977499 27819 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.978307 27819 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:18.979393 27819 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.980962 27806 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:18.934084 27866 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:07:18.982869 27866 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.968255 26608 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:18.943316 27785 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:18.908531 27755 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.971218 26679 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:18.976862 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.989030 26760 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.989614 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:18.990434 26752 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.986188 27785 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:18.993476 27785 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:18.996030 27768 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:18.999615 27832 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.003311 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:19.004197 26752 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:18.983428 27866 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:19.008914 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 147785us
I20260709 13:07:19.009950 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:19.012390 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.019342 26509 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.044696 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.046311 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.048708 27806 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:19.048849 27793 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.051496 27872 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.052032 27872 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.052960 27794 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:19.054105 27872 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.054626 27872 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.055480 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:19.056193 26681 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:19.057439 27801 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:19.057835 27801 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:19.058211 27801 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.060467 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:19.016310 27810 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:19.063639 27806 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.061823 27811 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:19.065608 27806 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.066020 27806 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.063925 27778 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.070343 27778 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.070868 27793 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.076772 27778 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.079084 27866 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.079754 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:19.080595 26682 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:19.081822 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:19.085845 27832 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.085904 27801 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.111209 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:19.112210 26607 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:19.113162 27801 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:19.113854 27778 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.114377 27778 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.116813 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:19.059935 27872 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.119381 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:19.119932 27778 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.121850 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:19.122649 26682 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:19.122640 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:19.123974 26608 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:19.124955 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:19.125749 27778 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.126132 27778 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.126468 27778 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.118742 27801 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.129776 27801 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.130138 27801 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.130219 26607 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:19.131814 27794 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:19.140424 27872 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.144112 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:19.147696 27779 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.148205 27779 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:19.149049 27779 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:19.154338 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72588.2us
W20260709 13:07:19.155200 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.156050 27862 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.156425 27862 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.156749 27862 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.163848 27807 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:19.164430 27807 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.167289 27807 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.167496 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:19.168222 26679 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:19.173152 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 126935us
I20260709 13:07:19.174088 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.171907 26759 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:19.186836 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:19.188167 27862 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.188802 27865 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:19.189222 27865 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:19.189602 27865 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.189932 26682 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:19.190984 27862 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.191536 27862 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.169899 27806 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.196827 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:19.197571 26682 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.197682 27806 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.198324 27794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47694 (request call id 7) took 1143 ms. Trace:
I20260709 13:07:19.199620 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:19.200209 26681 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.187031 27807 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.200842 27807 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.201987 27807 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.204273 27768 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.215248 26682 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:19.227768 26754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.043s
W20260709 13:07:19.228232 26754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.005s	sys 0.043s
I20260709 13:07:19.223702 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:19.159123 27778 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.262295 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.288228 27320 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:19.191991 27862 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.214561 27866 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:07:19.268453 27806 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.223481 27768 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.311141 27773 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.198695 27794 rpcz_store.cc:276] 0709 13:07:18.031782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.032300 (+   518us) service_pool.cc:224] Handling call
0709 13:07:18.063064 (+ 30764us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b58001271d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f328b70a 00007f40f328c76a 00007f40f328b91b 00007f40f329703c 00007f40f32966b3 00007f40f8256d29 00007f40f17d51d4 00007f40f17d5162
0709 13:07:18.075596 (+ 12532us) log.cc:844] Serialized 513 byte log entry
0709 13:07:18.461801 (+386205us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800408a00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f31e9b0b 00007f40f326eb63 00007f40f3296752 00007f40f8256d29
0709 13:07:18.466768 (+  4967us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b1800408a00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:19.175468 (+708700us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185617,"raft.queue_time_us":175828,"raft.run_cpu_time_us":2008,"raft.run_wall_time_us":2008,"spinlock_wait_cycles":24635648,"thread_start_us":213096,"threads_started":1,"wal-append.queue_time_us":262181}
I20260709 13:07:19.343024 26759 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:19.343055 26758 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:19.326730 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:19.317883 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48589us
I20260709 13:07:19.353133 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:19.325712 27806 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.370313 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:19.371110 27320 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:19.346195 27773 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.380777 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:19.361677 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:19.363654 27801 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.394660 27865 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.401924 27865 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.402573 27865 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.403040 27865 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.404371 26761 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:19.405217 27880 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:19.392627 26752 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:19.414003 26682 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:19.425405 27880 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.527396 26759 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:19.433585 26752 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:19.533823 27873 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:07:19.527581 26506 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.535465 26506 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.537734 26506 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.456274 27778 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.534286 27795 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.556881 27862 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.444494 27806 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.455910 27865 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:19.601169 26603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.026s	sys 0.008s
W20260709 13:07:19.601784 26603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.026s	sys 0.008s
W20260709 13:07:19.620395 27766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.023s	sys 0.027s
W20260709 13:07:19.621793 27766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.023s	sys 0.027s
I20260709 13:07:19.622314 27766 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.622633 26680 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:19.619213 26684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.013s	sys 0.038s
W20260709 13:07:19.625123 26684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.013s	sys 0.038s
W20260709 13:07:19.690761 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65920.8us
W20260709 13:07:19.623268 26652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.017s	sys 0.034s
I20260709 13:07:19.619351 27731 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.699219 26652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.017s	sys 0.034s
W20260709 13:07:19.620430 27857 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.018s	sys 0.015s
I20260709 13:07:19.700176 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 1883) took 1034 ms. Trace:
I20260709 13:07:19.622771 27766 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:19.700728 26509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.025s
W20260709 13:07:19.729666 26509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.014s	sys 0.025s
W20260709 13:07:19.705992 27779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.031s
W20260709 13:07:19.730436 27779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.011s	sys 0.031s
W20260709 13:07:19.715370 26686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.030s	sys 0.049s
I20260709 13:07:19.602185 27828 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:07:19.733319 27828 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.590204 27795 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:19.736606 26686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.030s	sys 0.050s
I20260709 13:07:19.621204 27773 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:19.627542 27801 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:19.740706 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 524105us
I20260709 13:07:19.746833 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:19.726699 26685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.012s	sys 0.019s
I20260709 13:07:19.601562 27882 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:07:19.719029 26684 rpcz_store.cc:276] 0709 13:07:18.665599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.667322 (+  1723us) service_pool.cc:224] Handling call
0709 13:07:18.667752 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.668168 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.668206 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.668755 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.923382 (+254627us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.939520 (+ 16138us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.690658 (+751138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.690736 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.696762 (+  6026us) raft_consensus.cc:1685] finished
0709 13:07:19.696780 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.700104 (+  3324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5932,"prepare.queue_time_us":16476,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":12485,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":350,"thread_start_us":939704,"threads_started":2,"wal-append.queue_time_us":663355}
W20260709 13:07:19.726450 27755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.013s	sys 0.026s
I20260709 13:07:19.764668 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:19.718974 27857 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.019s	sys 0.015s
W20260709 13:07:19.728806 27850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.007s	sys 0.024s
W20260709 13:07:19.699769 27748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.021s	sys 0.047s
W20260709 13:07:19.762025 26685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.019s
W20260709 13:07:19.741282 26609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.023s	sys 0.073s
W20260709 13:07:19.778060 26609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.024s	sys 0.073s
W20260709 13:07:19.768646 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.718206 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 386250us
I20260709 13:07:19.782989 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:19.777849 27755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.014s	sys 0.026s
I20260709 13:07:19.833449 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1899) took 1050 ms. Trace:
W20260709 13:07:19.844579 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.016s	sys 0.014s
I20260709 13:07:19.774678 27900 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.777805 27748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.021s	sys 0.047s
I20260709 13:07:19.856362 26678 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:19.856824 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:19.856925 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:19.738310 27731 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:19.777570 27850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.007s	sys 0.025s
I20260709 13:07:19.784379 27857 tablet_copy_client.cc:323] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:07:19.847198 26603 rpcz_store.cc:276] 0709 13:07:18.785457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.788671 (+  3214us) service_pool.cc:224] Handling call
0709 13:07:18.834929 (+ 46258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.835163 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.602309 (+767146us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.833096 (+230787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.833156 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.833197 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.833265 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.833393 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":980782,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"thread_start_us":977087,"threads_started":2,"wal-append.queue_time_us":221383}
W20260709 13:07:19.820991 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.037s
W20260709 13:07:19.880344 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.057s
W20260709 13:07:19.880998 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 706976us
I20260709 13:07:19.881842 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:19.789003 27872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.026s
W20260709 13:07:19.844847 27819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.016s	sys 0.018s
W20260709 13:07:19.861925 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.861464 26680 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:19.860905 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:19.896657 26685 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
W20260709 13:07:19.848476 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.016s	sys 0.014s
I20260709 13:07:19.868780 26687 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:19.796605 27880 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:19.819504 27904 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.840078 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:19.821327 27902 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.821733 27890 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.822463 27879 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.840585 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:07:19.882980 27872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.002s	sys 0.027s
W20260709 13:07:19.844937 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.016s	sys 0.021s
I20260709 13:07:19.886157 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.890273 27731 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:19.874989 26752 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:19.898780 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:19.911747 27819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.017s	sys 0.019s
W20260709 13:07:19.929405 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.016s	sys 0.021s
W20260709 13:07:19.945073 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.15812e+06us
W20260709 13:07:19.921995 27793 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.018s
W20260709 13:07:19.929949 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 43889.6us
I20260709 13:07:19.952484 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.953444 27748 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.953948 27748 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.953928 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:19.955189 27748 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.916849 27768 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:19.956431 27899 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.915174 27904 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.957127 27899 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:19.958348 27899 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.907961 27794 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.947595 27793 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.011s	sys 0.019s
I20260709 13:07:19.947750 27887 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.929934 27890 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:19.948591 27755 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.929070 27902 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.930039 27879 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:19.951336 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:19.913996 27807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.009s	sys 0.022s
I20260709 13:07:19.873030 27900 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:19.935024 26681 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.002s
I20260709 13:07:20.011242 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:19.911321 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 353876us
I20260709 13:07:20.101166 26681 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:19.988296 27901 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.017978 27768 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.017006 27810 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.017541 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:20.030293 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:20.016825 27881 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:19.988912 27794 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.031482 27773 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.046456 27888 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:20.046898 27788 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.118585 27917 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:20.119155 27788 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.035717 27755 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:20.040285 27912 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:20.044725 27766 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.016847 27887 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.043406 27904 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.067226 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:20.125949 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62177.4us
W20260709 13:07:20.124184 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 225488us
I20260709 13:07:20.127198 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:20.077968 27866 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.080442 27890 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.080804 27918 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.084208 27828 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:20.097851 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 146612us
I20260709 13:07:20.116775 27872 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.104866 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:20.103608 27901 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:20.099311 27807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.009s	sys 0.022s
W20260709 13:07:20.113375 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 102247us
I20260709 13:07:20.150950 26681 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.151054 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:20.116472 27881 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.102795 27915 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:20.120899 27921 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.111575 27768 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.117725 27317 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.135532 27788 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.117228 27909 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.090695 27811 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:20.144017 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:20.111709 27826 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:20.146327 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:20.173128 26611 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.147132 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:20.112934 27829 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:20.151820 26687 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.152765 26685 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.153223 27872 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:20.143121 27766 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.117592 27810 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.157965 26682 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:20.145004 27828 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:20.158708 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:20.193917 26680 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:20.121393 27773 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.146908 27918 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.162694 27748 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:20.168056 26684 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:20.174290 26761 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:20.153851 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:20.154460 27915 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.158653 27768 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.119465 27917 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.159482 27801 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:20.159250 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.195567 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.222383 26759 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:20.161425 27921 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:20.206638 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52881.9us
I20260709 13:07:20.171785 27788 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.189195 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.165463 27793 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.177193 27807 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.221093 26611 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:20.208464 27915 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.191524 27862 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.228567 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:20.214725 27880 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:20.232239 26685 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.238361 26683 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.215956 27801 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.130690 27912 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.247874 27919 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:20.248348 27920 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:20.207245 27766 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:20.223956 27284 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.651s (SENT)
I20260709 13:07:20.231187 27866 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:20.263610 26576 leader_election.cc:400] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
W20260709 13:07:20.240746 27885 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.308s	user 0.005s	sys 0.000s
I20260709 13:07:20.265301 26687 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.242906 27793 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:20.284783 26576 leader_election.cc:403] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.171715 27909 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.205807 27755 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.264635 27801 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.261354 27778 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.291006 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46063.7us
I20260709 13:07:20.274042 27811 tablet_bootstrap.cc:492] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:20.305869 26756 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.300865 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.308432 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:20.308888 26759 raft_consensus.cc:2368] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
I20260709 13:07:20.308984 26756 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.301252 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.243157 26605 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:20.303236 27923 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.303681 27316 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:20.303517 27793 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.240231 27788 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.250917 27828 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.305464 27887 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.261289 27880 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.289253 27794 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.312124 27912 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.313670 26755 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.314961 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.323755 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.274454 27919 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:20.252614 27862 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.246965 27807 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.290282 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:20.394748 26754 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.290522 27866 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:20.405889 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.405553 27900 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.433897 27900 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.434492 27900 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:20.435570 27900 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.440058 27807 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.394553 27811 ts_tablet_manager.cc:1403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 1.389s	user 0.028s	sys 0.038s
I20260709 13:07:20.445127 27811 raft_consensus.cc:359] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:20.446287 27811 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:20.355713 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:20.448380 26757 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.453557 27880 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.316213 27901 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.345192 27923 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:20.457842 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.458360 27923 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.459436 26756 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:20.286409 27872 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:20.320366 27778 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.466854 27918 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.466899 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.324436 27806 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:20.357384 27924 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:07:20.472283 27731 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.352377 27879 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.475652 27731 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.476374 27879 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.476812 27879 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.477730 27731 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.478222 27731 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.469945 27785 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.370566 27902 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.479254 27785 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.356379 27828 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.470018 27850 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.478619 27731 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.394310 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:20.472196 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:20.468482 27890 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.503259 27912 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:20.503290 27935 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:07:20.474494 27773 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.481931 27810 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.480602 27919 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.487164 27850 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.503919 27917 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.388082 27921 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.760598 27773 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.507133 27862 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.761132 27773 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.488219 27806 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:20.447100 27811 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:20.625379 27901 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.622448 27928 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:20.548532 27890 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.804127 27901 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.804216 27928 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.806198 27890 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:20.779026 27819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.044s	sys 0.055s
W20260709 13:07:20.799965 27787 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.011s	sys 0.027s
W20260709 13:07:20.802239 27285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.015s	sys 0.041s
I20260709 13:07:20.509004 27795 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:20.807482 27285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.015s	sys 0.041s
I20260709 13:07:20.715552 27794 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:20.505012 27881 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:20.807992 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 703183us
I20260709 13:07:20.504390 27731 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.808254 27794 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:20.621739 27913 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.737s	user 0.004s	sys 0.004s
I20260709 13:07:20.808907 27882 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:20.631986 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 415968us
W20260709 13:07:20.811794 27883 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.955s	user 0.000s	sys 0.008s
I20260709 13:07:20.812593 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.813199 26610 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:20.813294 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 934) took 2136 ms. Trace:
I20260709 13:07:20.629092 27778 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.492116 27918 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:20.814426 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.809197 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:20.807006 27819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.046s	sys 0.056s
I20260709 13:07:20.737165 27879 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.500799 26753 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:20.813216 27882 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.770902 27779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.020s	sys 0.033s
I20260709 13:07:20.504042 26752 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.737491 27785 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.622720 27866 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.814198 26609 rpcz_store.cc:276] 0709 13:07:18.676856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.681091 (+  4235us) service_pool.cc:224] Handling call
0709 13:07:18.681582 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.681880 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.681906 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.682809 (+   903us) log.cc:844] Serialized 513 byte log entry
0709 13:07:19.782785 (+1099976us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:19.782827 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.782897 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.810899 (+1028002us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:20.812991 (+  2092us) raft_consensus.cc:1685] finished
0709 13:07:20.813012 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.813218 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11851648,"thread_start_us":1095278,"threads_started":1,"wal-append.queue_time_us":1173086}
I20260709 13:07:20.820749 27882 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:20.816743 27779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.020s	sys 0.033s
I20260709 13:07:20.823521 27882 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.823588 27880 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.807327 27787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.027s
W20260709 13:07:20.762943 27899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.029s	sys 0.033s
I20260709 13:07:20.806306 27901 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.810559 27794 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.879755 27912 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:20.881769 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:20.882728 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.013s	sys 0.031s
I20260709 13:07:20.624655 27317 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:20.815048 27918 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:20.896668 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.888275 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.031s
I20260709 13:07:20.907053 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.907908 26610 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:20.909706 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:20.910367 26610 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.913077 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:20.906108 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:20.839521 27899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.031s	sys 0.035s
I20260709 13:07:20.922580 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:20.871587 27806 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.937173 26682 raft_consensus.cc:2410] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:20.907956 27879 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:20.943033 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:20.943552 27819 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.943800 27925 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.288s	user 0.000s	sys 0.007s
I20260709 13:07:20.943903 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:20.944525 26608 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.944250 27819 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.945415 26612 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:20.830307 27909 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.949592 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:20.951599 26683 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:20.824265 27880 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.921469 26757 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:20.914740 27832 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:20.806975 27928 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.921458 27902 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.921759 27882 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:20.945307 27862 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:20.966925 27766 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.970871 27788 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:20.971014 27914 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.010s	user 0.001s	sys 0.012s
I20260709 13:07:20.949600 27917 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:20.958235 27832 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.977520 27316 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:20.960279 27880 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.977682 27917 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:20.992741 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 51) took 1257 ms. Trace:
I20260709 13:07:20.993315 26679 rpcz_store.cc:276] 0709 13:07:19.735704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.735817 (+   113us) service_pool.cc:224] Handling call
0709 13:07:19.736116 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.736431 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.736460 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.736944 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.822780 (+ 85836us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:19.822837 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.822942 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.816689 (+993747us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:20.985422 (+168733us) raft_consensus.cc:1685] finished
0709 13:07:20.985462 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.992620 (+  7158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49104,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":50665,"spinlock_wait_cycles":110841600,"thread_start_us":85421,"threads_started":1,"wal-append.queue_time_us":85663}
I20260709 13:07:20.994803 27917 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:20.995762 27930 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.374s	user 0.000s	sys 0.007s
I20260709 13:07:20.997160 27850 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.982614 27773 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:20.949728 27918 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:20.976975 27849 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.915830 27912 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.975798 27882 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:20.981251 27832 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.979856 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.016999 27849 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.021411 26682 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:20.969108 27902 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.029307 27912 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:21.029422 27882 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:20.975274 27862 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.034475 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:21.037032 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.026s	sys 0.047s
W20260709 13:07:21.108402 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.026s	sys 0.047s
W20260709 13:07:21.108711 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 935086us
W20260709 13:07:21.039458 27905 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.009s	sys 0.000s
W20260709 13:07:21.050493 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.020s	sys 0.011s
W20260709 13:07:21.110458 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.021s	sys 0.011s
W20260709 13:07:21.107879 26758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.017s	sys 0.042s
W20260709 13:07:21.111090 26758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.017s	sys 0.042s
I20260709 13:07:21.032035 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:21.011324 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.676s (SENT) [suppressed 15 similar messages]
W20260709 13:07:21.124411 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92471.7us
W20260709 13:07:21.135070 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.131191 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:21.142961 26608 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:21.031175 27915 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.788s	user 0.005s	sys 0.006s
I20260709 13:07:21.144255 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.027499 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:21.163003 26727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.003s	sys 0.009s
W20260709 13:07:21.163349 26727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.003s	sys 0.009s
W20260709 13:07:21.164345 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.016s	sys 0.026s
W20260709 13:07:21.164723 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.016s	sys 0.026s
W20260709 13:07:21.164964 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 955776us
W20260709 13:07:21.168030 26575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.025s	sys 0.046s
I20260709 13:07:21.168684 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:21.168887 26575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.025s	sys 0.046s
I20260709 13:07:21.147280 26683 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
W20260709 13:07:21.134415 27768 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.000s
I20260709 13:07:21.174739 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:21.177595 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46490.8us
W20260709 13:07:21.144454 27905 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.009s	sys 0.000s
I20260709 13:07:21.177035 26684 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:21.166923 27811 ts_tablet_manager.cc:1434] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.726s	user 0.007s	sys 0.003s
I20260709 13:07:21.186174 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.241340 26681 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.173056 26608 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:21.189685 27941 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:21.193212 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.185164 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:21.162588 27931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.006s	sys 0.004s
I20260709 13:07:21.146133 27882 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:21.230963 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:21.249713 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.250326 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.250339 26684 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.251277 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.251437 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.253355 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.254141 26681 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.011065 27880 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:07:21.244319 26756 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:21.233892 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.256067 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:21.245872 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.164013 27766 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.248404 26685 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:21.248467 27938 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.256958 26687 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.257580 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.285702 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.258505 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:21.261047 27896 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.209s	user 0.016s	sys 0.012s
I20260709 13:07:21.173518 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.135720 27918 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:07:21.286439 26685 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:21.173914 27866 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:21.191558 27795 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.192910 27901 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:21.168093 27826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.009s	sys 0.032s
W20260709 13:07:21.229907 27287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.020s	sys 0.023s
I20260709 13:07:21.316846 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:21.250512 27931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.007s	sys 0.004s
I20260709 13:07:21.322960 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.320109 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.168020 27915 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.247812 27917 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:21.330755 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:21.252034 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 2da4a43c4ca64471b27b22ea1a167d13 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:07:21.333693 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.245652 27778 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.331491 27938 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.304435 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.259125 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.178071 27909 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:07:21.303699 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:21.258910 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:21.247788 27811 ts_tablet_manager.cc:1467] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Tablet startup took 801ms
I20260709 13:07:21.193477 27768 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.285214 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:21.368870 27748 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.050s	sys 0.078s
W20260709 13:07:21.448668 27828 consensus_meta.cc:287] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.960s	user 0.004s	sys 0.006s
W20260709 13:07:21.628731 27748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.058s	sys 0.082s
I20260709 13:07:21.629132 27748 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:21.457377 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.630075 27748 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.258147 27882 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.631028 27882 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.631421 27768 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:21.380077 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.009s	sys 0.017s
W20260709 13:07:21.633677 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.016s	sys 0.020s
I20260709 13:07:21.635473 26683 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.306350 27766 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:21.562340 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.000s	sys 0.030s
W20260709 13:07:21.508873 27801 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.188s	user 0.011s	sys 0.000s
W20260709 13:07:21.638828 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.003s	sys 0.032s
W20260709 13:07:21.371034 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.392257 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.063s	sys 0.113s
W20260709 13:07:21.640502 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.063s	sys 0.135s
W20260709 13:07:21.627384 26603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.450s	user 0.010s	sys 0.040s
W20260709 13:07:21.641156 26603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.010s	sys 0.040s
I20260709 13:07:21.389662 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.642302 26761 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:21.644505 26612 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.318174 27819 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:21.654799 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 338010us
W20260709 13:07:21.619271 27895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.548s	user 0.009s	sys 0.020s
W20260709 13:07:21.645444 27287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.020s	sys 0.026s
I20260709 13:07:21.652091 27850 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:21.669703 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.318740 27779 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.669847 27850 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.670488 27947 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.670564 27779 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.671165 27947 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.672333 27850 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:21.672766 27779 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:21.672988 27850 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.673185 27947 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:21.673528 26756 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:21.342907 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:21.639344 27872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.002s	sys 0.009s
W20260709 13:07:21.674186 27872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.003s	sys 0.009s
W20260709 13:07:21.430418 27900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.016s	sys 0.012s
I20260709 13:07:21.673601 27850 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.666386 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.318990 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.368621 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:21.654552 27826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.011s	sys 0.034s
W20260709 13:07:21.681211 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.681159 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.703521 26754 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:21.612816 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:21.593149 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.331519 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:21.330788 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:21.562101 27939 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.688146 26608 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:21.619077 27945 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.656867 27940 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.658280 27921 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.653491 27901 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.713773 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:21.680042 27900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.019s	sys 0.019s
W20260709 13:07:21.684849 27895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.914s	user 0.010s	sys 0.022s
I20260709 13:07:21.670589 27819 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.676297 27849 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:21.680579 26679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.016s
I20260709 13:07:21.662740 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 2da4a43c4ca64471b27b22ea1a167d13 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-2da4a43c4ca64471b27b22ea1a167d13
I20260709 13:07:21.654181 27866 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:21.750064 26679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.016s
W20260709 13:07:21.717959 27937 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.460s	user 0.001s	sys 0.000s
I20260709 13:07:21.654066 27795 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.707381 27947 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.742707 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:21.656903 27778 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.656770 27801 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.663059 27917 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.718247 27766 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:21.712229 27779 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:21.722112 27901 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.799029 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:21.729156 27862 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:21.352458 27926 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.799690 26608 raft_consensus.cc:2376] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2. Re-sending same reply.
W20260709 13:07:21.750484 27284 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.010s
W20260709 13:07:21.801136 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 140227us
I20260709 13:07:21.833156 27905 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.843997 27778 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:21.715781 26753 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:21.674934 27933 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.855134 27801 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:21.854998 27940 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.855789 26752 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:21.849324 27939 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.887300 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:21.845077 27962 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.512s	user 0.001s	sys 0.000s
I20260709 13:07:21.749977 27921 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:21.972750 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:21.750955 27951 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:21.975999 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 350673us
W20260709 13:07:21.897908 27284 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.015s	sys 0.010s
I20260709 13:07:21.745615 27819 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.977053 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:21.982983 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 233728us
I20260709 13:07:21.983501 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:21.887244 27862 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:21.744423 27945 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.883915 27779 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:21.844458 27947 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.100792 27940 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:22.026623 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.01526e+06us
I20260709 13:07:22.193241 26608 raft_consensus.cc:2376] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2. Re-sending same reply.
W20260709 13:07:22.292184 27284 leader_election.cc:336] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.701s (SENT)
I20260709 13:07:22.292748 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:22.294091 27284 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.787s (SENT)
I20260709 13:07:22.294492 26608 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:22.295006 27284 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.804s (SENT)
I20260709 13:07:22.295465 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:22.296173 26608 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:22.296548 27793 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.297559 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:22.297884 27284 connection.cc:256] RPC call timeout handler was delayed by -1.2809516679999433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:07:22.298622 27284 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.079s (SENT)
I20260709 13:07:22.299162 26608 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:22.099561 27938 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:22.103093 27915 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:22.300665 26608 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:21.632069 27811 ts_tablet_manager.cc:1469] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Trace:
0709 13:07:16.717666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.724505 (+  6839us) service_pool.cc:224] Handling call
0709 13:07:17.126025 (+401520us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b18003138a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:17.170207 (+ 44182us) ts_tablet_manager.cc:934] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
0709 13:07:18.257907 (+1087700us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:18.420825 (+162918us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:18.420949 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:18.576284 (+155335us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:18.576591 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:18.631762 (+ 55171us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:18.635245 (+  3483us) inbound_call.cc:177] Queueing success response
0709 13:07:19.001758 (+366513us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:20.441309 (+1439551us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:20.442066 (+   757us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:20.442833 (+   767us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10485,"raft.queue_time_us":29431,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":28612,"spinlock_wait_cycles":435501312,"tablet-copy.queue_time_us":169339,"tablet-download-pool.queue_time_us":185,"tablet-download-pool.run_cpu_time_us":1601,"tablet-download-pool.run_wall_time_us":38029,"thread_start_us":196427,"threads_started":2}
I20260709 13:07:22.028627 27951 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:22.301932 27882 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.670s	user 0.004s	sys 0.008s
I20260709 13:07:22.302315 27882 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:22.303506 27951 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:21.980209 27914 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:22.087227 27918 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.305074 27918 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:22.305850 27882 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:22.196687 26611 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:22.308297 27918 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:22.129060 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.308758 27940 raft_consensus.cc:1027] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: attempt to promote peer 77c617823f2e4a938ef247a8924e299b: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:07:22.108096 27957 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:07:21.985507 27828 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.311097 27828 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:22.311655 27828 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.141734 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:22.098102 27959 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:07:22.118644 27850 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:21.985956 27933 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.320114 27901 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.321069 27933 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:22.086772 27980 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.071779 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.321796 27980 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:22.070451 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:22.108573 27964 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:07:22.099928 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:22.035772 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:22.361421 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 333321us
I20260709 13:07:22.027209 26754 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
I20260709 13:07:22.201299 27941 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:22.202798 27945 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:22.203498 27939 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:22.203915 27862 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.204730 27819 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:22.205839 27779 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:22.206971 27921 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:22.208463 27832 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.102s	user 0.014s	sys 0.001s
I20260709 13:07:22.208623 27947 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:22.102986 26576 leader_election.cc:400] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
W20260709 13:07:22.208770 27972 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:07:22.083177 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:22.394011 26576 leader_election.cc:403] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.967072 27926 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.054211 27778 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.070178 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:22.365150 27980 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:22.097321 27900 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:07:22.095862 27923 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.203918 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.212643 27917 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:22.213429 26771 tablet_copy_source_session.cc:215] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:22.218611 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:22.220220 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:22.224582 27966 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.340s	user 0.002s	sys 0.002s
I20260709 13:07:22.225386 27866 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:22.225845 26603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.004s
I20260709 13:07:22.227272 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:22.231146 27829 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:22.245714 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 58) took 1056 ms. Trace:
I20260709 13:07:22.249508 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:22.254557 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:22.256950 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:22.267959 27960 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.286s	user 0.004s	sys 0.000s
W20260709 13:07:22.107440 27958 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:22.080111 27979 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.086827 27801 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.317481 26609 raft_consensus.cc:2376] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2. Re-sending same reply.
I20260709 13:07:22.321245 26759 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3.
I20260709 13:07:22.080646 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:21.979766 27902 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:21.988298 27766 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:21.984592 27953 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:22.363624 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:21.982179 27934 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Leader election lost for term 2. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
I20260709 13:07:22.394587 26610 raft_consensus.cc:2368] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:22.209067 27795 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:22.394819 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 291956us
I20260709 13:07:22.395352 27921 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3.
I20260709 13:07:22.395285 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:22.397392 27862 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:21.984090 27905 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:22.397989 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 57) took 1210 ms. Trace:
I20260709 13:07:22.399857 26606 raft_consensus.cc:2368] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:22.028235 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:22.402247 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 332162us
I20260709 13:07:22.402333 27819 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.415308 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.401695 27978 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.393719 27832 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:22.419122 26603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.000s	sys 0.005s
I20260709 13:07:22.608702 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.674314 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:22.446631 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 475896us
W20260709 13:07:22.610421 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.012s
W20260709 13:07:22.612939 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.007s
W20260709 13:07:22.675287 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.675136 26682 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:22.609210 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:22.623173 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 594982us
I20260709 13:07:22.676180 26687 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:22.404054 27923 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.413446 27975 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:22.420276 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.477962 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.394343 27941 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:22.793170 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.010s	sys 0.048s
W20260709 13:07:22.793689 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.012s	sys 0.042s
I20260709 13:07:22.609459 26758 rpcz_store.cc:276] 0709 13:07:21.187758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.187911 (+   153us) service_pool.cc:224] Handling call
0709 13:07:21.188296 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.230666 (+ 42370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.230700 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.249690 (+ 18990us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.561284 (+311594us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.561340 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.561435 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.397751 (+836316us) raft_consensus.cc:1685] finished
0709 13:07:22.397772 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.397906 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41913,"raft.queue_time_us":114975,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":15736,"thread_start_us":230108,"threads_started":1,"wal-append.queue_time_us":740077}
I20260709 13:07:22.794318 26679 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:22.681356 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 317789us
I20260709 13:07:22.795601 26686 raft_consensus.cc:2410] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:22.816082 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 839043us
I20260709 13:07:22.608243 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.611903 27829 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:22.611045 27284 leader_election.cc:336] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.045s (SENT)
W20260709 13:07:22.622267 27807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.037s	sys 0.054s
I20260709 13:07:22.817534 26680 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:22.821913 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:22.822857 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.799595 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.471165 26604 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:22.621385 27819 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.404557 27778 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.823022 26681 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.796003 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:22.825295 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 938) took 2696 ms. Trace:
I20260709 13:07:22.470559 27917 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:22.673751 27314 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:22.820835 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.824491 26678 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:22.830090 27865 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.830853 27977 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:22.796669 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 52) took 1015 ms. Trace:
I20260709 13:07:22.854632 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:22.622176 27953 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.416757 26753 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:22.833606 26687 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.680897 27779 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.674006 27313 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:22.836007 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:22.844259 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48332.2us
I20260709 13:07:22.885867 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:22.796903 27923 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.610221 26752 rpcz_store.cc:276] 0709 13:07:21.188944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.192202 (+  3258us) service_pool.cc:224] Handling call
0709 13:07:22.245418 (+1053216us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400138b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:22.245590 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470180224}
I20260709 13:07:22.680763 27766 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:22.681138 27795 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:22.845041 26603 rpcz_store.cc:276] 0709 13:07:20.129212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.129385 (+   173us) service_pool.cc:224] Handling call
0709 13:07:20.166233 (+ 36848us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:20.166413 (+   180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.641530 (+1475117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.641559 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.657741 (+ 16182us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.792867 (+1135126us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:22.792924 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.793058 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.793108 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:22.793118 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.825154 (+ 32036us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14057,"raft.queue_time_us":70475,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":11434,"spinlock_wait_cycles":2864512,"thread_start_us":2543690,"threads_started":2,"wal-append.queue_time_us":592998}
I20260709 13:07:22.824119 26682 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:22.849893 26684 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.765074 27978 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.851044 26758 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:22.816635 27927 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:22.832741 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.793437 27985 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.871995 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:22.908653 26754 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:22.871743 26771 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:47588 (request call id 60) took 1658 ms. Trace:
I20260709 13:07:22.725489 27862 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:07:22.794592 27866 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:07:22.871181 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:22.620874 27801 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.797150 27919 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:07:22.887426 27988 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:22.854290 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 591) took 1681 ms. Trace:
I20260709 13:07:22.830092 26607 raft_consensus.cc:2368] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
W20260709 13:07:22.821816 27807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.038s	sys 0.064s
W20260709 13:07:22.856571 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 247419us
W20260709 13:07:22.853622 27314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 177) took 1608 ms (client timeout 1859 ms). Trace:
I20260709 13:07:22.846139 27940 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:22.880095 27938 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.880738 27829 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:22.882045 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.846429 27901 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:22.821902 27915 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:22.838390 27819 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.855121 26686 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.621145 27979 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.963832 27918 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.819653 27806 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:07:22.819895 27755 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:07:22.897439 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:22.993636 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 319401us
I20260709 13:07:22.993908 26761 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:22.907158 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.821751 27975 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.834614 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 978) took 1234 ms. Trace:
I20260709 13:07:22.910761 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:22.951400 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80309.2us
I20260709 13:07:22.896212 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 979) took 1297 ms. Trace:
I20260709 13:07:22.952479 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:23.005086 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52696.5us
I20260709 13:07:23.006137 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:22.926380 26687 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.950842 26680 rpcz_store.cc:276] 0709 13:07:21.173360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.173663 (+   303us) service_pool.cc:224] Handling call
0709 13:07:21.231686 (+ 58023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.822084 (+1590398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.854018 (+ 31934us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540025ce54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:22.854224 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3646669568}
I20260709 13:07:22.875128 27945 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:07:22.888334 27947 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.874923 27977 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:22.963764 26681 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.884804 27917 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:22.941920 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.900207 27779 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:22.901029 27926 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:22.909614 27984 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.944269 27951 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.909957 27985 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.951126 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.911110 27978 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:22.887131 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54669.7us
I20260709 13:07:22.871932 26605 rpcz_store.cc:276] 0709 13:07:21.781548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.226898 (+445350us) service_pool.cc:224] Handling call
0709 13:07:22.796607 (+569709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.997308 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:22.985939 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:22.950515 27795 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.001519 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:23.060717 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59286.9us
I20260709 13:07:23.034475 27850 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.909804 26771 rpcz_store.cc:276] 0709 13:07:21.192454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.192963 (+   509us) service_pool.cc:224] Handling call
0709 13:07:22.850929 (+1657966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.962914 27988 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:23.010797 27832 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:22.993122 27829 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.011394 27953 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.077762 28010 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.077800 27953 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:23.078403 28010 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.078497 27953 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.010847 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.013701 27975 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.079870 27978 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.079960 26678 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:23.016883 27989 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.081566 27989 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.081962 27989 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.018534 27778 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.018709 27901 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.995852 27766 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.019474 26682 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:22.942292 27927 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.026566 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:22.991266 28003 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:23.032878 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 147105us
I20260709 13:07:23.040640 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.097002 26686 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:23.020169 27947 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.993286 27915 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.054311 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:23.053566 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 972) took 1802 ms (client timeout 2244 ms). Trace:
I20260709 13:07:23.008749 27980 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:23.046888 27923 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:22.999003 26757 rpcz_store.cc:276] 0709 13:07:21.591775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.238295 (+646520us) service_pool.cc:224] Handling call
0709 13:07:22.239063 (+   768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.239504 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.239551 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.280880 (+ 41329us) log.cc:844] Serialized 513 byte log entry
0709 13:07:22.611891 (+331011us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:22.617317 (+  5426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.792686 (+175369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.797448 (+  4762us) raft_consensus.cc:1685] finished
0709 13:07:22.797462 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.825795 (+ 28333us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":193753,"threads_started":1,"wal-append.queue_time_us":300651}
W20260709 13:07:23.060945 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63714.8us
I20260709 13:07:23.004421 26753 rpcz_store.cc:276] 0709 13:07:21.592108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.065689 (+473581us) service_pool.cc:224] Handling call
0709 13:07:22.889080 (+823391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.061841 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:23.116729 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54953.4us
W20260709 13:07:22.991276 27284 leader_election.cc:336] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.228s (SENT)
I20260709 13:07:23.061761 27779 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:23.062916 27828 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.001s
I20260709 13:07:23.063541 26755 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.068480 28001 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.070091 26683 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
W20260709 13:07:22.965739 27314 rpcz_store.cc:269] 0709 13:07:21.245570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.261558 (+ 15988us) service_pool.cc:224] Handling call
0709 13:07:22.249346 (+987788us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:22.853522 (+604176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28501248}
I20260709 13:07:23.053150 27951 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.074144 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.017452 27905 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.139981 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.140990 27979 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.141386 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.142063 26605 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.141979 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.143006 26604 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:23.143481 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.144930 26758 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.053891 27941 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.085273 27977 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.083010 27755 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.057333 27985 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:23.088647 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 82586.7us
I20260709 13:07:23.158987 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.081573 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.131237 27778 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:23.162180 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88154.9us
I20260709 13:07:23.103685 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:23.101922 26759 rpcz_store.cc:269] 0709 13:07:21.250820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.250971 (+   151us) service_pool.cc:224] Handling call
0709 13:07:23.039324 (+1788353us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540010fed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:23.053488 (+ 14164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458810624}
I20260709 13:07:23.088071 27901 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.121505 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.162914 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.122092 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:23.163417 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59875.4us
I20260709 13:07:23.125299 27945 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:23.146592 27990 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:23.126883 27998 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:07:23.128480 27923 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.129174 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.102447 27947 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.053328 27984 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.130492 26761 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:23.130944 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.172258 26611 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.132637 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.173077 26608 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:23.173997 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.115345 28003 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:23.130244 27801 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.131340 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.089973 27795 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.143638 26605 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.163769 26610 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.214367 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:23.123071 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.138525 28001 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.145970 27951 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.164788 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.164152 27862 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.165145 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:23.119302 27921 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:23.166908 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.156796 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:23.133579 27828 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.195958 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.235997 26608 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:23.175077 27766 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.237285 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.238848 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:23.202696 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 63615us
I20260709 13:07:23.215937 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:23.164211 27901 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.166014 27919 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:23.219767 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 55042.1us
I20260709 13:07:23.247524 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.125963 27917 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.166549 27977 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.249621 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.177574 27865 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.164171 27778 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:23.136356 27989 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.161965 27872 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.230485 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63695.7us
W20260709 13:07:23.228241 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63214.5us
I20260709 13:07:23.227782 26610 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:23.162992 27988 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.168133 27900 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.228680 27795 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.219442 28001 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.224442 27905 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.230296 27806 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.223269 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.279430 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.280066 26679 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.171103 27949 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.169144 27945 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.169423 26678 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
W20260709 13:07:23.300419 28013 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:23.300760 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:23.254731 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 265200us
I20260709 13:07:23.302037 26678 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:23.222574 26757 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:23.163154 27755 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.312427 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.272104 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:23.272694 27318 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.221277 26753 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.274712 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:23.180219 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.251262 27921 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.232074 27915 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.251127 27919 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.251607 27778 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.253113 27977 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.252130 26606 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.293103 27900 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.307403 27998 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:23.293702 27927 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.303277 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.270390 27980 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:07:23.245886 27862 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:23.319429 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.279825 27806 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.320973 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.315122 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.359900 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.316076 27801 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.359607 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.360023 26686 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.320537 28009 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.360577 26758 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.316658 27921 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:23.361918 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45439.6us
I20260709 13:07:23.366882 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.354795 26679 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:23.360520 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45472us
I20260709 13:07:23.284511 27917 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:07:23.276839 27872 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.316408 27923 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.324512 27919 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.283456 28000 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:23.323628 27977 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.268805 27865 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:23.322896 27849 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.368814 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.371611 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.376075 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.376756 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 64) took 1660 ms. Trace:
I20260709 13:07:23.322249 27866 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:07:23.361994 27806 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.381573 26686 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:23.368273 27921 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.314078 28003 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.389181 26756 rpcz_store.cc:276] 0709 13:07:21.716901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.322206 (+605305us) service_pool.cc:224] Handling call
0709 13:07:22.322520 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.323157 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.323187 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.325521 (+  2334us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.680620 (+355099us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:22.972345 (+291725us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.994681 (+ 22336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.994771 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.064781 (+ 70010us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18004133e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:23.369976 (+305195us) raft_consensus.cc:1685] finished
0709 13:07:23.376560 (+  6584us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.376698 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341342,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":445,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":182,"spinlock_wait_cycles":7187200,"thread_start_us":494995,"threads_started":2,"wal-append.queue_time_us":667331}
I20260709 13:07:23.388622 26761 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.391628 26679 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.393591 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.400476 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.341066 27985 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.310894 27949 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.391973 27779 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.407151 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.407810 26756 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:23.381114 28018 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.412503 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.386680 27984 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.386919 27945 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.381995 28010 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.417239 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.365715 27801 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.388872 27900 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.386209 28019 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.425055 26686 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:23.436034 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.436316 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 980) took 1806 ms. Trace:
I20260709 13:07:23.436630 26686 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.436663 26760 rpcz_store.cc:276] 0709 13:07:21.629706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.278150 (+648444us) service_pool.cc:224] Handling call
0709 13:07:22.278725 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.834280 (+555555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.834313 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.834354 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:22.834380 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.436100 (+601720us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400225954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:23.436142 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.436254 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277159296}
I20260709 13:07:23.425227 26679 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:23.438395 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.440114 27978 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.427258 26685 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.427976 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.443013 26683 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.431344 26609 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:23.402642 28000 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:23.408951 27941 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.439399 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.437522 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.415555 27779 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.459649 27779 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.460281 27872 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:23.460587 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.447466 26679 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.465653 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.447932 26686 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.412839 28018 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:23.469082 26758 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:23.450845 27865 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.452411 27951 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.453811 27989 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.454324 27828 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.443470 26755 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.434016 27900 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.454516 27819 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.455195 27755 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.456822 27990 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:23.458462 27947 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.469713 26679 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:23.428290 27862 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.428637 26757 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.480469 27865 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.481223 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:23.478000 26650 connection.cc:256] RPC call timeout handler was delayed by -1.9601466279999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:07:23.479571 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.463018 26752 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.438562 27748 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.499919 27748 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.502108 27748 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.462324 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.446872 27941 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.447575 28000 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:23.446143 28019 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.483186 26686 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:23.489463 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 120753us
I20260709 13:07:23.491796 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:23.486158 28020 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:23.480149 27978 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:23.423257 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.474252 26681 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.480677 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.485087 27900 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:23.498327 26650 connection.cc:256] RPC call timeout handler was delayed by -1.481346627999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:07:23.489758 27866 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:23.498992 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.503053 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:23.491555 28015 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:07:23.528453 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:23.528622 27985 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.470917 28018 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.529047 26754 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.529349 28018 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.489516 27990 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.476135 27905 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:07:23.506615 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:23.515425 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.534751 27320 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:23.519409 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.498001 27989 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.497218 28016 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.520632 28019 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.498407 27865 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.517005 27941 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.502698 28001 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.517287 27828 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:07:23.494619 27755 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:23.519595 27923 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.529721 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.535878 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.498778 26683 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.519615 27313 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:23.541049 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.541435 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:23.525592 27978 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.545303 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.525393 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-3a6cdf3163c8419d9d0c3ee399cc76d1 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:23.543560 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.567721 26611 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
W20260709 13:07:23.557049 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49066.1us
I20260709 13:07:23.559787 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.559791 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.544409 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.555065 26754 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:23.543781 27865 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.571126 26683 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.544910 27748 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.571177 26761 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:23.571758 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:23.572299 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.573906 26683 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.542375 28022 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.555068 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.564141 27317 raft_consensus.cc:2410] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.576839 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:23.553750 27989 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:23.575042 27945 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.543871 28016 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.604225 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.557497 28000 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:23.610266 28014 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.386s	user 0.000s	sys 0.002s
I20260709 13:07:23.624261 27918 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:23.577088 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-3a6cdf3163c8419d9d0c3ee399cc76d1 on tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:23.566794 28023 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.612290 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.625741 28023 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.626152 28023 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.626688 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.614337 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.614482 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.564253 27923 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.567404 28024 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.586812 27829 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:23.620159 26683 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:23.577025 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52811.8us
I20260709 13:07:23.577931 28022 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:23.631512 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.577201 27901 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.635638 26681 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:23.611424 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.638821 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.640867 26754 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.616660 27945 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.642299 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.643841 26683 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.644923 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.636178 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.628932 27828 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.618649 27951 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.630060 27926 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.651799 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:23.652961 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.656378 26761 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.634552 27819 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:23.658366 26650 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 272d473e821e4c15a9f3fa0471adfdc6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.658946 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.663463 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.664750 26754 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:23.637012 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.661959 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.673959 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.655036 27313 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.650102 28000 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:23.677842 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72290.9us
I20260709 13:07:23.650595 27945 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.641953 28022 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.636413 28024 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.680518 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 183) took 1366 ms. Trace:
I20260709 13:07:23.682763 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.683091 27318 rpcz_store.cc:276] 0709 13:07:22.307601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.307774 (+   173us) service_pool.cc:224] Handling call
0709 13:07:22.308051 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.323335 (+1015284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.674105 (+350770us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54004b78d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:23.674360 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217896704}
I20260709 13:07:23.666097 27755 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.655287 27947 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.672821 27862 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.678633 27917 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.696082 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.654832 27748 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:23.695633 27766 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.678061 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.681015 27795 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.680965 28003 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.681282 27951 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.686836 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.704417 28032 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.686573 28024 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.660073 27919 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.699950 27795 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.748881 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.686180 27819 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:07:23.678938 27872 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:23.697024 27862 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.697212 27917 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.752324 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.753875 27857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da4a43c4ca64471b27b22ea1a167d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.739095 28003 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.744117 27829 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.759009 26680 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:23.745108 28032 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:23.764616 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74016.9us
I20260709 13:07:23.744370 28001 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.748690 27795 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.755017 27862 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.751225 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.757077 27917 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.754547 26607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 51) took 2025 ms (client timeout 2045 ms). Trace:
I20260709 13:07:23.759493 27978 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:23.768915 28003 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.746477 27951 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:23.757560 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58819.3us
W20260709 13:07:23.792678 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 109962us
I20260709 13:07:23.768513 27829 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:23.740968 27766 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:23.774435 26753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:23.771126 28032 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.815613 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.820391 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.822036 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:23.825544 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.836822 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.836721 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.837843 27320 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.837863 27318 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:23.834014 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.840329 26679 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:23.843521 28045 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.844442 28045 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.845037 28045 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:23.846261 28045 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.848985 28024 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.853156 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:23.860711 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:23.861946 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:23.860483 27748 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:23.863029 28001 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.865070 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.830768 27829 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.814831 27977 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:23.830652 27926 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:23.793730 26607 rpcz_store.cc:269] 0709 13:07:21.722816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.219903 (+497087us) service_pool.cc:224] Handling call
0709 13:07:23.740095 (+1520192us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540037a0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:23.746693 (+  6598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874426624}
I20260709 13:07:23.874451 27766 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.874018 27926 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.875325 26757 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.863062 27748 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.839342 26753 raft_consensus.cc:606] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:23.863529 28001 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.857499 27923 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.840126 27828 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.883875 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.887187 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.871034 27901 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.871605 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:23.895277 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:23.898030 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:23.872812 27978 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.901933 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:23.878765 27748 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:23.886044 28001 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.892364 28024 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:23.884543 27755 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.894743 27984 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.884655 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:23.876346 27921 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.916425 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:23.892369 28016 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:23.904155 27978 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:23.921866 27919 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.893468 28036 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.913793 27915 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.912456 27828 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:23.909981 27317 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:23.943329 28049 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.938949 27978 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.918699 27984 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:23.947811 28049 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:23.948000 27984 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:23.949417 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 283689us
I20260709 13:07:23.952765 26761 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.958810 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:23.948256 28049 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.992913 28034 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:07:23.948179 28053 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.944381 28036 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:23.997632 28036 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.007467 26761 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:23.920951 27755 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.019493 26756 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:24.020817 26756 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:24.026193 26687 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.952354 27915 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:24.044214 26681 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:24.027554 26756 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:24.033452 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.942545 27945 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:23.981637 27919 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.996995 28053 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:24.047283 26686 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:23.997076 27951 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.052486 28027 ts_tablet_manager.cc:933] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:24.052948 28030 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:07:24.060269 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 109392us
I20260709 13:07:24.062853 26756 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:24.059991 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 158080us
I20260709 13:07:24.054778 27977 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:23.946604 27748 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.333962 27748 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.007288 27828 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.060758 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:24.339041 27317 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:07:24.266191 28018 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.007s
I20260709 13:07:24.169858 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:24.058877 28053 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.056537 27919 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:24.267700 27806 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.865s	user 0.017s	sys 0.002s
W20260709 13:07:24.264290 28050 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:24.330732 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:24.331974 26758 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:24.391315 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.002s	sys 0.009s
W20260709 13:07:24.393460 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.002s	sys 0.009s
I20260709 13:07:24.394557 26758 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:24.084494 26756 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:24.225874 26576 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items
W20260709 13:07:24.402544 27829 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.533s	user 0.015s	sys 0.006s
W20260709 13:07:24.283360 28019 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.007s
I20260709 13:07:24.381973 26761 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:07:24.391033 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 537934us
W20260709 13:07:24.396087 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65587.3us
I20260709 13:07:24.406631 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:24.387560 27779 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.927s	user 0.015s	sys 0.016s
I20260709 13:07:24.407497 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:24.402963 27829 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.340528 27755 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.411741 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:24.396577 28054 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:24.413290 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:24.390825 27919 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.394912 27938 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.410007 26606 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.053s	user 0.000s	sys 0.024s
I20260709 13:07:24.407697 28018 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:24.402235 26576 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
I20260709 13:07:24.429499 27945 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.429895 26606 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:24.430732 27917 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 13:07:24.256522 27915 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:24.415239 27778 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.024s
I20260709 13:07:24.433192 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:24.407902 28027 tablet_copy_client.cc:323] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:24.427759 26604 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:24.413039 27926 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:24.432049 27938 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.438771 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 63) took 1386 ms. Trace:
I20260709 13:07:24.435936 28056 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:24.394999 27806 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.431596 27829 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.421016 28016 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:24.408617 28052 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:24.432768 27951 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.410411 28019 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.420066 26607 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:24.467331 26612 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:24.446542 26682 rpcz_store.cc:276] 0709 13:07:23.051935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.457737 (+405802us) service_pool.cc:224] Handling call
0709 13:07:23.464966 (+  7229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.465133 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.465159 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.465198 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.465226 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.465279 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.438603 (+973324us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b54001257d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.438722 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15934336}
I20260709 13:07:24.414712 27779 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.460456 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 1930) took 1375 ms. Trace:
I20260709 13:07:24.468036 26683 rpcz_store.cc:276] 0709 13:07:23.085078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.858257 (+773179us) service_pool.cc:224] Handling call
0709 13:07:23.858677 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.866553 (+  7876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.866598 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.868542 (+  1944us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.946343 (+ 77801us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:23.946400 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.946492 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.460238 (+513746us) raft_consensus.cc:1685] finished
0709 13:07:24.460257 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.460399 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":363,"raft.queue_time_us":451,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4359,"thread_start_us":45835,"threads_started":1,"wal-append.queue_time_us":173310}
I20260709 13:07:24.471361 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 1929) took 1387 ms. Trace:
W20260709 13:07:24.460927 27865 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.012s
W20260709 13:07:24.442417 27284 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.676s (SENT)
I20260709 13:07:24.444353 27945 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.446185 27926 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.466964 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 991) took 1067 ms. Trace:
I20260709 13:07:24.434926 28018 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:24.445279 27990 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.901s	user 0.015s	sys 0.018s
I20260709 13:07:24.471750 26684 rpcz_store.cc:276] 0709 13:07:23.083939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.760575 (+676636us) service_pool.cc:224] Handling call
0709 13:07:23.760943 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.761316 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.761357 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.775757 (+ 14400us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.987740 (+211983us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:23.987807 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.987903 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.471141 (+483238us) raft_consensus.cc:1685] finished
0709 13:07:24.471165 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.471305 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7842,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4680,"thread_start_us":173779,"threads_started":1,"wal-append.queue_time_us":378591}
I20260709 13:07:24.458946 26576 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
I20260709 13:07:24.473744 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1942) took 1351 ms. Trace:
I20260709 13:07:24.442584 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1937) took 1320 ms. Trace:
I20260709 13:07:24.439997 27917 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.466378 28056 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:24.441823 27778 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:24.490859 28026 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.843s	user 0.022s	sys 0.020s
I20260709 13:07:24.491204 28056 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.492156 27778 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:24.492393 28000 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.810s	user 0.016s	sys 0.006s
W20260709 13:07:24.481977 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48884.8us
I20260709 13:07:24.481441 26754 rpcz_store.cc:276] 0709 13:07:23.399231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.576560 (+177329us) service_pool.cc:224] Handling call
0709 13:07:24.466804 (+890244us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b5400081954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.466912 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121419520}
W20260709 13:07:24.474891 27978 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.022s
I20260709 13:07:24.487035 26609 rpcz_store.cc:276] 0709 13:07:23.122033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.122857 (+   824us) service_pool.cc:224] Handling call
0709 13:07:24.473589 (+1350732us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001135d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.473688 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488686848}
I20260709 13:07:24.458278 28016 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.493695 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:24.489249 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:24.490064 27949 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.494338 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:24.498232 27779 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.479928 27865 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:24.498831 28022 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.809s	user 0.004s	sys 0.018s
I20260709 13:07:24.501967 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 602) took 1682 ms. Trace:
I20260709 13:07:24.502566 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 995) took 1091 ms. Trace:
I20260709 13:07:24.502843 28016 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.502101 27979 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:24.505144 27945 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:24.505708 27317 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
W20260709 13:07:24.505967 28036 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.508s	user 0.018s	sys 0.000s
I20260709 13:07:24.507337 27917 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:24.495893 27795 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
W20260709 13:07:24.508917 28003 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.009s
I20260709 13:07:24.494477 26576 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 65)
I20260709 13:07:24.509469 28019 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.512342 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:24.480054 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 952) took 1012 ms. Trace:
I20260709 13:07:24.482873 27926 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.533229 26759 rpcz_store.cc:276] 0709 13:07:23.411216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.638591 (+227375us) service_pool.cc:224] Handling call
0709 13:07:24.502402 (+863811us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540011cbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.502514 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673767168}
W20260709 13:07:24.575878 27900 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.044s	user 0.017s	sys 0.017s
I20260709 13:07:24.571477 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:24.571651 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:24.572207 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59609.4us
W20260709 13:07:24.573338 28055 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:07:24.485450 28018 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.532389 26685 rpcz_store.cc:276] 0709 13:07:22.819974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.820166 (+   192us) service_pool.cc:224] Handling call
0709 13:07:22.820444 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.446519 (+626075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.501773 (+1055254us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54001ea5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:24.501915 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395015936}
W20260709 13:07:24.494359 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53874.1us
I20260709 13:07:24.596268 27806 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.490084 27953 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:24.584062 27941 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.016s	user 0.015s	sys 0.004s
I20260709 13:07:24.614627 27941 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.607108 27865 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.494689 27990 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.616536 26755 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:24.616886 27941 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.593012 27945 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:24.617710 27945 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.617776 27990 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:24.576361 28023 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.950s	user 0.019s	sys 0.015s
I20260709 13:07:24.583920 28045 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:24.605053 27778 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.605334 27862 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.798s	user 0.008s	sys 0.019s
I20260709 13:07:24.601421 28003 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.606848 27779 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:24.630057 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 125436us
I20260709 13:07:24.607156 27900 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.599515 27949 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.567615 27938 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.604066 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:24.633522 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:24.573796 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 948) took 1129 ms. Trace:
I20260709 13:07:24.902451 26604 rpcz_store.cc:276] 0709 13:07:23.444150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.446881 (+  2731us) service_pool.cc:224] Handling call
0709 13:07:24.514856 (+1067975us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400162954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.573703 (+ 58847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021531008}
I20260709 13:07:24.903916 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:24.904742 26604 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:24.905176 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 979) took 1207 ms. Trace:
I20260709 13:07:24.905501 26604 rpcz_store.cc:276] 0709 13:07:23.697571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.903549 (+1205978us) service_pool.cc:224] Handling call
0709 13:07:24.905119 (+  1570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.906435 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:24.907021 26604 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:07:24.629009 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 58) took 1459 ms (client timeout 1676 ms). Trace:
I20260709 13:07:24.907940 26506 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 111) took 5553 ms. Trace:
W20260709 13:07:24.907927 26611 rpcz_store.cc:269] 0709 13:07:23.169334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.185491 (+ 16157us) service_pool.cc:224] Handling call
0709 13:07:24.628829 (+1443338us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:24.628953 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750562048}
I20260709 13:07:24.909121 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:24.909966 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 984) took 1070 ms. Trace:
I20260709 13:07:24.910372 26611 rpcz_store.cc:276] 0709 13:07:23.839444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.908887 (+1069443us) service_pool.cc:224] Handling call
0709 13:07:24.909914 (+  1027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.910919 26509 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 208) took 6750 ms. Trace:
I20260709 13:07:24.908393 26506 rpcz_store.cc:276] 0709 13:07:19.354184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.354345 (+   161us) service_pool.cc:224] Handling call
0709 13:07:24.907856 (+5553511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:21.919396 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:22.096510 (+177114us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:22.119841 (+ 23331us) write_op.cc:435] Acquired schema lock
0709 13:07:22.119873 (+    32us) tablet.cc:662] Decoding operations
0709 13:07:22.205947 (+ 86074us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:22.206014 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:22.206116 (+   102us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:22.206573 (+   457us) tablet.cc:701] Row locks acquired
0709 13:07:22.206594 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:22.206778 (+   184us) write_op.cc:270] Start()
0709 13:07:22.206917 (+   139us) write_op.cc:276] Timestamp: P: 1783602442206722 usec, L: 0
0709 13:07:22.206941 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.207792 (+   851us) log.cc:844] Serialized 1310 byte log entry
0709 13:07:22.413491 (+205699us) op_driver.cc:464] REPLICATION: finished
0709 13:07:22.892300 (+478809us) write_op.cc:301] APPLY: starting
0709 13:07:22.892397 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:22.892563 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:22.892672 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:22.893175 (+   503us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:22.893385 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:07:22.893449 (+    64us) write_op.cc:312] APPLY: finished
0709 13:07:22.893686 (+   237us) log.cc:844] Serialized 34 byte log entry
0709 13:07:22.893835 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.893938 (+   103us) write_op.cc:454] Released schema lock
0709 13:07:22.893983 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":473851,"apply.run_cpu_time_us":2022,"apply.run_wall_time_us":2022,"num_ops":3,"prepare.queue_time_us":2240804,"prepare.run_cpu_time_us":7873,"prepare.run_wall_time_us":322608,"replication_time_us":193890,"thread_start_us":365217,"threads_started":1}]]}
I20260709 13:07:24.753005 26578 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67)
I20260709 13:07:24.753660 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.163177 26687 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.753051 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.165495 26685 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.166504 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:24.716724 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet c04d1d6cb7c54df78a1746de67ce6198 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:24.754397 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:24.715842 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:24.753973 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.188082 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.189002 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.189059 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.189705 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.190606 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.190490 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.191329 26686 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.194267 27819 raft_consensus.cc:476] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:25.194823 27819 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.753330 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:25.196439 28061 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.593s	user 0.004s	sys 0.003s
I20260709 13:07:25.197091 26682 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:24.754818 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:24.752593 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.204551 26678 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.205974 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:24.613168 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 589) took 1778 ms. Trace:
I20260709 13:07:24.630883 26758 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.210659 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:24.688855 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.209182 26686 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:24.623972 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 606) took 1159 ms. Trace:
I20260709 13:07:24.718950 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 608) took 1254 ms. Trace:
I20260709 13:07:24.620679 26754 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.212872 26757 rpcz_store.cc:276] 0709 13:07:23.464236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.876150 (+411914us) service_pool.cc:224] Handling call
0709 13:07:23.893295 (+ 17145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.917904 (+ 24609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.919620 (+  1716us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.924175 (+  4555us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.417907 (+493732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:24.423513 (+  5606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.435091 (+ 11578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.623652 (+188561us) raft_consensus.cc:1685] finished
0709 13:07:24.623709 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.623895 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3160,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5912,"thread_start_us":485967,"threads_started":1,"wal-append.queue_time_us":543516}
I20260709 13:07:25.214756 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.213537 26753 rpcz_store.cc:276] 0709 13:07:23.464721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.941178 (+476457us) service_pool.cc:224] Handling call
0709 13:07:23.951014 (+  9836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.951404 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.951436 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.978313 (+ 26877us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.677644 (+699331us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18002d82c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:07:24.691440 (+ 13796us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:24.717339 (+ 25899us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.718497 (+  1158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.718593 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.718637 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:24.718752 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.718887 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6494,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":211,"raft.queue_time_us":28639,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":27945,"spinlock_wait_cycles":2934144,"thread_start_us":38892,"threads_started":2,"wal-append.queue_time_us":714008}
I20260709 13:07:25.215507 26754 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.215895 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.216099 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.216317 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:24.709102 27314 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:25.218065 27314 pending_rounds.cc:85] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 4
I20260709 13:07:25.218470 27314 pending_rounds.cc:107] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:24.663272 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:24.663156 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:24.660524 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:24.630827 27778 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.638790 27779 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:24.601729 27795 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.225096 26679 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.225975 27795 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:24.701617 27857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46926 (request call id 207) took 6398 ms. Trace:
I20260709 13:07:24.629994 27862 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.749828 27801 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.636215 27900 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.717525 27921 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.702520 27926 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:24.638396 27919 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:24.636720 27938 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.627362 27945 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.237493 27919 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.510409 27978 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.646526 27989 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:24.717826 27979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47694 (request call id 8) took 5311 ms. Trace:
I20260709 13:07:24.640533 27949 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:24.647432 27984 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.004s
W20260709 13:07:24.642907 28001 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.724s	user 0.017s	sys 0.012s
I20260709 13:07:25.244014 27984 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.244342 27949 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:24.635689 28003 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:24.664417 28016 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.674245 28018 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:24.587837 28022 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:24.628290 28023 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.247885 28016 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.248431 28018 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:24.592407 28029 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.679096 28032 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.013s
I20260709 13:07:25.249775 28029 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.250433 28032 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.251155 27320 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:24.600337 28036 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.252104 28029 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.252766 26761 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.253808 28036 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.254617 26756 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.255008 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.256026 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.256665 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.257100 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.257807 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.258422 26756 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:25.259320 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:24.673580 28053 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.262511 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.263262 26756 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.263517 28053 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:24.644079 28059 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:07:24.598526 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.265481 26605 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:24.881525 27902 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.601384 26607 rpcz_store.cc:276] 0709 13:07:23.465082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.024590 (+559508us) service_pool.cc:224] Handling call
0709 13:07:24.477435 (+452845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.265869 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 623) took 2181 ms. Trace:
I20260709 13:07:24.896977 26610 raft_consensus.cc:2410] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:25.265882 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 955) took 1800 ms (client timeout 1718 ms). Trace:
W20260709 13:07:25.267071 26605 rpcz_store.cc:269] 0709 13:07:23.465772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.515579 (+1049807us) service_pool.cc:224] Handling call
0709 13:07:25.265833 (+750254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.267453 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 956) took 1801 ms (client timeout 1723 ms). Trace:
W20260709 13:07:25.267822 26610 rpcz_store.cc:269] 0709 13:07:23.466011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.571364 (+1105353us) service_pool.cc:224] Handling call
0709 13:07:25.267326 (+695962us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400249354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:25.267410 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676984576}
I20260709 13:07:25.268159 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.268699 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:25.269017 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965) took 1635 ms (client timeout 1829 ms). Trace:
W20260709 13:07:25.269200 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964) took 1794 ms (client timeout 2061 ms). Trace:
I20260709 13:07:24.488001 26606 rpcz_store.cc:276] 0709 13:07:23.120468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.130420 (+  9952us) service_pool.cc:224] Handling call
0709 13:07:24.440501 (+1310081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.911337 26509 rpcz_store.cc:276] 0709 13:07:18.160254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.188858 (+ 28604us) service_pool.cc:224] Handling call
0709 13:07:24.910856 (+6721998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:19.701142 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:19.701864 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:19.701909 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:07:19.701936 (+    27us) tablet.cc:662] Decoding operations
0709 13:07:19.702437 (+   501us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:19.702527 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:19.702566 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:07:19.702946 (+   380us) tablet.cc:701] Row locks acquired
0709 13:07:19.702971 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:07:19.703146 (+   175us) write_op.cc:270] Start()
0709 13:07:19.703276 (+   130us) write_op.cc:276] Timestamp: P: 1783602439703094 usec, L: 0
0709 13:07:19.703303 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:19.770759 (+ 67456us) log.cc:844] Serialized 934 byte log entry
0709 13:07:20.811503 (+1040744us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:07:22.290885 (+1479382us) op_driver.cc:464] REPLICATION: finished
0709 13:07:22.674291 (+383406us) write_op.cc:301] APPLY: starting
0709 13:07:22.782502 (+108211us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:22.820366 (+ 37864us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:22.822384 (+  2018us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:22.890480 (+ 68096us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:22.890687 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:07:22.890748 (+    61us) write_op.cc:312] APPLY: finished
0709 13:07:22.890994 (+   246us) log.cc:844] Serialized 28 byte log entry
0709 13:07:22.891224 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.891325 (+   101us) write_op.cc:454] Released schema lock
0709 13:07:22.891376 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:22.891832 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.891872 (+    40us) write_op.cc:454] Released schema lock
0709 13:07:22.895262 (+  3390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.895295 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2495163,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":295268,"apply.run_cpu_time_us":2509,"apply.run_wall_time_us":280125,"num_ops":2,"prepare.queue_time_us":607239,"prepare.run_cpu_time_us":35796,"prepare.run_wall_time_us":2045895,"raft.queue_time_us":91616,"raft.run_cpu_time_us":39007,"raft.run_wall_time_us":576561,"replication_time_us":2587437,"spinlock_wait_cycles":8742656,"thread_start_us":2639501,"threads_started":4,"wal-append.queue_time_us":2504988,"wal-append.run_cpu_time_us":4047,"wal-append.run_wall_time_us":1625488}]]}
I20260709 13:07:24.907526 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 978) took 1218 ms. Trace:
I20260709 13:07:25.270049 26604 rpcz_store.cc:276] 0709 13:07:23.689207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.906144 (+1216937us) service_pool.cc:224] Handling call
0709 13:07:24.907478 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.270275 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.266525 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:24.913700 26578 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49434 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1973)
W20260709 13:07:25.271117 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971) took 1694 ms (client timeout 1990 ms). Trace:
W20260709 13:07:25.272011 26606 rpcz_store.cc:269] 0709 13:07:23.576289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.270031 (+1693742us) service_pool.cc:224] Handling call
0709 13:07:25.271069 (+  1038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.272851 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:25.273537 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968) took 1757 ms (client timeout 2066 ms). Trace:
W20260709 13:07:25.273872 26606 rpcz_store.cc:269] 0709 13:07:23.515935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.272632 (+1756697us) service_pool.cc:224] Handling call
0709 13:07:25.273486 (+   854us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.274317 26578 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49434 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 13:07:25.274761 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.275533 26606 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:25.266338 26680 rpcz_store.cc:276] 0709 13:07:23.088128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.769088 (+680960us) service_pool.cc:224] Handling call
0709 13:07:23.790773 (+ 21685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.794620 (+  3847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.794649 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.795113 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.393820 (+598707us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:24.393858 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.393915 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.265647 (+871732us) raft_consensus.cc:1685] finished
0709 13:07:25.265670 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.265813 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":17140,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3317,"thread_start_us":561572,"threads_started":1,"wal-append.queue_time_us":624285}
W20260709 13:07:25.276023 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973) took 1639 ms (client timeout 1964 ms). Trace:
W20260709 13:07:25.269438 26605 rpcz_store.cc:269] 0709 13:07:23.633608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.267885 (+1634277us) service_pool.cc:224] Handling call
0709 13:07:25.268961 (+  1076us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.276388 26606 rpcz_store.cc:269] 0709 13:07:23.636982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.274547 (+1637565us) service_pool.cc:224] Handling call
0709 13:07:25.275974 (+  1427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.274580 26578 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49434 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1979)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1984)
I20260709 13:07:25.278112 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.279003 26605 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:24.931917 26608 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:25.279498 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951) took 1814 ms (client timeout 2145 ms). Trace:
W20260709 13:07:25.280109 26605 rpcz_store.cc:269] 0709 13:07:23.464847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.277779 (+1812932us) service_pool.cc:224] Handling call
0709 13:07:25.279440 (+  1661us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:24.960232 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.281126 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 59) took 2111 ms. Trace:
I20260709 13:07:25.281425 26608 rpcz_store.cc:276] 0709 13:07:23.169596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.325372 (+155776us) service_pool.cc:224] Handling call
0709 13:07:24.931683 (+1606311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.279891 (+348208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.280932 (+  1041us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540010ead0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:25.281083 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3693172480}
I20260709 13:07:24.945360 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.282565 26603 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:25.282660 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.282943 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 976) took 1613 ms (client timeout 1776 ms). Trace:
I20260709 13:07:25.081401 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.091490 27849 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:25.283401 28053 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.283576 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:24.750620 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:25.105022 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.285871 28029 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:25.286020 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 535424us
I20260709 13:07:25.287817 28003 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.288383 28003 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.291491 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.292223 27321 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.107740 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 990) took 1719 ms. Trace:
I20260709 13:07:25.292914 26755 rpcz_store.cc:276] 0709 13:07:23.388280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.835485 (+447205us) service_pool.cc:224] Handling call
0709 13:07:24.479217 (+643732us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:24.487871 (+  8654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.616920 (+129049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.107421 (+490501us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540011c1d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:25.107637 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301998208}
I20260709 13:07:25.294446 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.296288 27316 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.296566 27949 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:25.297536 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.298875 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.300045 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:25.122433 27284 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35576 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:25.124194 28009 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.128763 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 185) took 1315 ms. Trace:
I20260709 13:07:25.134963 26577 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49440 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1973)
I20260709 13:07:25.141255 27941 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:25.145571 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:25.305060 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:25.305441 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 159924us
I20260709 13:07:25.148326 28076 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:25.169544 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet c04d1d6cb7c54df78a1746de67ce6198 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-c04d1d6cb7c54df78a1746de67ce6198
I20260709 13:07:25.170334 26684 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:25.172381 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1954) took 1950 ms. Trace:
I20260709 13:07:25.312608 26680 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:25.173588 26687 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.314000 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.314913 26687 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:25.167513 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:25.187731 27915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.010s	sys 0.006s
I20260709 13:07:25.195252 27819 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.318068 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.318298 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.319013 27313 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:25.203649 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.319924 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:25.319855 28076 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.208647 26752 rpcz_store.cc:276] 0709 13:07:22.824242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.086142 (+261900us) service_pool.cc:224] Handling call
0709 13:07:23.086455 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.499505 (+413050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.515328 (+1015823us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400227254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:24.602659 (+ 87331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753196800}
I20260709 13:07:25.320916 27819 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.212812 26678 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.321905 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.322096 28076 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.218802 27314 raft_consensus.cc:2889] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.315018 27795 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:25.322599 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.315181 28077 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.323415 27317 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:25.323503 28077 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.324012 27314 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.221756 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.324561 28003 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.222795 26758 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.315363 27941 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.223402 27779 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.223975 27778 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.226691 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 1936) took 1824 ms. Trace:
I20260709 13:07:25.328766 26679 rpcz_store.cc:276] 0709 13:07:23.402025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.908136 (+506111us) service_pool.cc:224] Handling call
0709 13:07:23.908389 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.225464 (+1317075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.226467 (+  1003us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001e91d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:25.226636 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027701120}
I20260709 13:07:25.330250 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.229542 27862 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.230556 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.237205 27926 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.239521 27945 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.241396 27978 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.242033 27979 rpcz_store.cc:276] 0709 13:07:19.406386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.406520 (+   134us) service_pool.cc:224] Handling call
0709 13:07:19.525694 (+119174us) log.cc:844] Serialized 513 byte log entry
0709 13:07:24.717740 (+5192046us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58378,"raft.queue_time_us":101523,"raft.run_cpu_time_us":1925,"raft.run_wall_time_us":113063,"spinlock_wait_cycles":41728,"thread_start_us":544794,"threads_started":2,"wal-append.queue_time_us":514591,"wal-append.run_cpu_time_us":2049,"wal-append.run_wall_time_us":1080067}
I20260709 13:07:25.244586 28001 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.338624 26697 tablet_copy_source_session.cc:215] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:25.338675 26758 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:25.339372 27779 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.340294 28001 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.340428 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.246121 27984 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.248783 28022 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.249245 26760 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.249398 28023 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.251523 27320 pending_rounds.cc:85] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 4
I20260709 13:07:25.341521 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.341756 27320 pending_rounds.cc:107] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:25.342058 27320 raft_consensus.cc:2889] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.342108 26754 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:25.342942 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.343084 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.344190 26753 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.344959 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.345542 26752 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.345283 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.312829 26612 rpcz_store.cc:276] 0709 13:07:23.221984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.367452 (+145468us) service_pool.cc:224] Handling call
0709 13:07:23.367958 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.467915 (+1099957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.172008 (+704093us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540003e8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:25.172277 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527539968}
I20260709 13:07:25.347605 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.348148 26612 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:07:25.348567 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962) took 1880 ms (client timeout 2223 ms). Trace:
I20260709 13:07:25.348721 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:25.348920 26612 rpcz_store.cc:269] 0709 13:07:23.467922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.347389 (+1879467us) service_pool.cc:224] Handling call
0709 13:07:25.348523 (+  1134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.349663 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.349826 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:25.350451 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949) took 1901 ms (client timeout 2246 ms). Trace:
I20260709 13:07:25.341768 26759 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 1.
W20260709 13:07:25.350978 26612 rpcz_store.cc:269] 0709 13:07:23.448636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.349624 (+1900988us) service_pool.cc:224] Handling call
0709 13:07:25.350406 (+   782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.334367 27795 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:25.352620 27795 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.352955 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.353703 26759 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.355377 27941 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.355516 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:24.620191 28045 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:24.626686 28049 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.004s
I20260709 13:07:25.261142 28032 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:25.360258 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57605.3us
I20260709 13:07:25.360563 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.264056 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.266134 27902 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.365691 27902 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.271106 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.365994 28077 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.366405 26604 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:25.366583 27949 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:25.366941 26604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 61) took 1876 ms (client timeout 2077 ms). Trace:
W20260709 13:07:25.367329 26604 rpcz_store.cc:269] 0709 13:07:23.490470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.270849 (+1780379us) service_pool.cc:224] Handling call
0709 13:07:25.366886 (+ 96037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.367803 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.368276 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.350307 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.280292 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:24.911192 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.369695 26606 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:25.370030 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 961) took 1902 ms (client timeout 1960 ms). Trace:
W20260709 13:07:25.370539 26611 rpcz_store.cc:269] 0709 13:07:23.467411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.910965 (+1443554us) service_pool.cc:224] Handling call
0709 13:07:25.369977 (+459012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.371373 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:25.372010 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963) took 1897 ms (client timeout 2272 ms). Trace:
W20260709 13:07:25.372324 26611 rpcz_store.cc:269] 0709 13:07:23.474794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.371142 (+1896348us) service_pool.cc:224] Handling call
0709 13:07:25.371965 (+   823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.372822 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.373065 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.100682 26507 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:25.283255 26603 rpcz_store.cc:269] 0709 13:07:23.669664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.945022 (+1275358us) service_pool.cc:224] Handling call
0709 13:07:25.282874 (+337852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.374264 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:25.374899 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956) took 1838 ms (client timeout 2213 ms). Trace:
W20260709 13:07:25.375226 26603 rpcz_store.cc:269] 0709 13:07:23.536370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.374037 (+1837667us) service_pool.cc:224] Handling call
0709 13:07:25.374853 (+   816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.374600 26507 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 1 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:25.373548 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985) took 1492 ms (client timeout 1765 ms). Trace:
W20260709 13:07:25.375828 26605 rpcz_store.cc:269] 0709 13:07:23.880930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.372575 (+1491645us) service_pool.cc:224] Handling call
0709 13:07:25.373494 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.284768 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:25.269538 26610 rpcz_store.cc:269] 0709 13:07:23.474969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.268480 (+1793511us) service_pool.cc:224] Handling call
0709 13:07:25.269134 (+   654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.377485 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.377902 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.378332 26611 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.378866 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957) took 1912 ms. Trace:
W20260709 13:07:25.283847 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1957) took 1747 ms (client timeout 1791 ms). Trace:
W20260709 13:07:25.379967 26609 rpcz_store.cc:269] 0709 13:07:23.536599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.599628 (+1063029us) service_pool.cc:224] Handling call
0709 13:07:25.283792 (+684164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.304230 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.306878 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:25.315997 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.302518 27315 rpcz_store.cc:276] 0709 13:07:23.813200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.814595 (+  1395us) service_pool.cc:224] Handling call
0709 13:07:25.127997 (+1313402us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:25.128206 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.128421 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:25.128451 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.128496 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.128525 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.128588 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.128703 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352320}
W20260709 13:07:25.381664 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46521.5us
I20260709 13:07:25.316929 28075 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:25.317533 27312 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:25.317485 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.320291 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.206758 27977 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:25.409364 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:25.318116 27915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.010s	sys 0.006s
I20260709 13:07:25.316897 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:25.227610 27857 rpcz_store.cc:276] 0709 13:07:18.311461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.322905 (+ 11444us) service_pool.cc:224] Handling call
0709 13:07:18.685107 (+362202us) ts_tablet_manager.cc:934] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
0709 13:07:19.071211 (+386104us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f019fcaa 00007f40f019fbd2 00007f40f8204131
0709 13:07:23.684973 (+4613762us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:24.645739 (+960766us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:24.645851 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:24.697408 (+ 51557us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:24.697745 (+   337us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:24.698391 (+   646us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:24.701548 (+  3157us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5691,"spinlock_wait_cycles":18327424,"tablet-copy.queue_time_us":208694,"thread_start_us":1105545,"threads_started":2}
I20260709 13:07:25.314066 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:25.411814 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97820us
I20260709 13:07:25.412624 28029 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:25.412521 27900 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:25.412925 27977 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:25.221684 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:25.413735 28025 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.413884 27905 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:25.414518 28025 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.331403 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:25.331048 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:25.415130 28075 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.415506 28075 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:25.415542 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 84210.8us
I20260709 13:07:25.416006 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.416524 26685 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.416407 28075 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.417573 28075 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.279320 26578 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49434 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1979)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1983)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1984)
I20260709 13:07:25.303535 28009 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.420522 27979 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.420933 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:25.421470 28009 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:25.302248 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 179836us
I20260709 13:07:25.401021 27902 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.330996 28079 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.336071 26686 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:25.408852 27949 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:25.411600 28032 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:07:25.328122 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:25.336433 27819 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.337270 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.427254 26680 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.252743 28018 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.356370 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.429793 26685 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:25.356931 28076 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.358021 28045 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.358832 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:25.361583 26754 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.361903 26756 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.362641 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.363420 28049 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.369097 26604 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:25.370083 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 965) took 1895 ms (client timeout 2162 ms). Trace:
I20260709 13:07:25.283769 27849 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.283993 28053 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.398366 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.408263 27978 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:25.399540 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 958) took 1933 ms (client timeout 2207 ms). Trace:
W20260709 13:07:25.461414 26608 rpcz_store.cc:269] 0709 13:07:23.466545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.377282 (+1910737us) service_pool.cc:224] Handling call
0709 13:07:25.399485 (+ 22203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.462373 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.463167 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 1964) took 1829 ms. Trace:
I20260709 13:07:25.379309 26610 rpcz_store.cc:276] 0709 13:07:23.466261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.377616 (+1911355us) service_pool.cc:224] Handling call
0709 13:07:25.378799 (+  1183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.400611 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93815.5us
I20260709 13:07:25.403368 26758 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:25.403971 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 119262us
W20260709 13:07:25.404718 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 972) took 1791 ms (client timeout 2135 ms). Trace:
I20260709 13:07:25.467772 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:25.404625 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.406554 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.463505 26608 rpcz_store.cc:276] 0709 13:07:23.633395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.462107 (+1828712us) service_pool.cc:224] Handling call
0709 13:07:25.463121 (+  1014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.469233 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:25.407050 26759 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:25.407538 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44754.2us
I20260709 13:07:25.472177 26759 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.414711 27905 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.333540 27321 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:25.473274 26759 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.400251 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:25.431001 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 953) took 1965 ms. Trace:
I20260709 13:07:25.446455 26756 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.474099 26609 rpcz_store.cc:276] 0709 13:07:23.465299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.380790 (+1915491us) service_pool.cc:224] Handling call
0709 13:07:25.430925 (+ 50135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.475039 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.475167 26756 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:25.451949 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 954) took 1986 ms (client timeout 2244 ms). Trace:
W20260709 13:07:25.476346 26612 rpcz_store.cc:269] 0709 13:07:23.465513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.351588 (+1886075us) service_pool.cc:224] Handling call
0709 13:07:25.451874 (+100286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.476225 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.443771 28076 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.477353 26609 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:25.477398 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.443213 27872 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.450388 26680 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:25.482403 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.456583 26754 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:25.457820 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 981) took 1715 ms (client timeout 2186 ms). Trace:
I20260709 13:07:25.483119 26608 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
W20260709 13:07:25.459854 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46618.8us
W20260709 13:07:25.468043 26611 rpcz_store.cc:269] 0709 13:07:23.613730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.372863 (+1759133us) service_pool.cc:224] Handling call
0709 13:07:25.404641 (+ 31778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.410835 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:25.483309 26603 rpcz_store.cc:269] 0709 13:07:23.742832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.376820 (+1633988us) service_pool.cc:224] Handling call
0709 13:07:25.457766 (+ 80946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.484089 26683 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:25.439985 27857 tablet_copy_client.cc:806] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:25.453637 26760 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:25.479561 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.485390 26610 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.480237 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:25.413744 26757 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:25.398952 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.484160 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:25.485536 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.490145 26611 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.490538 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 974) took 1840 ms. Trace:
I20260709 13:07:25.484771 26612 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.490839 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 966) took 2014 ms. Trace:
I20260709 13:07:25.491212 26608 rpcz_store.cc:276] 0709 13:07:23.476528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.482188 (+2005660us) service_pool.cc:224] Handling call
0709 13:07:25.490790 (+  8602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.491595 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.492070 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.492604 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.463735 27979 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:25.490850 26611 rpcz_store.cc:276] 0709 13:07:23.650387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.483712 (+1833325us) service_pool.cc:224] Handling call
0709 13:07:25.490481 (+  6769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.493307 26612 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.489984 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:25.444535 27807 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:07:25.457926 26752 raft_consensus.cc:606] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:25.442975 27900 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:25.501358 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.460179 27941 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:25.499065 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.489691 28082 ts_tablet_manager.cc:933] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.497694 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.478582 27905 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:25.439881 27921 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:25.485239 27984 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.452634 26606 rpcz_store.cc:269] 0709 13:07:23.475118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.280034 (+1804916us) service_pool.cc:224] Handling call
0709 13:07:25.370032 (+ 89998us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.478731 26604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 970) took 1924 ms (client timeout 2184 ms). Trace:
I20260709 13:07:25.503270 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.504264 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.505414 26610 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.455444 28018 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.487547 28079 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:25.481374 28032 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:25.480451 28076 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:25.481998 27872 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:25.492816 26608 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:25.506253 26609 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.495458 27857 tablet_copy_client.cc:670] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:25.512939 26605 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:25.460117 28003 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:25.499811 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:25.531499 27312 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:25.531910 26607 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:25.501988 27979 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.512559 26603 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.512962 26612 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.512928 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.499706 27945 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.485268 27949 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:25.503926 27978 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:25.487563 28077 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:25.492142 28009 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:25.557638 28009 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.558036 28009 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:25.558521 27829 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.520083 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 967) took 2027 ms. Trace:
I20260709 13:07:25.559342 26609 rpcz_store.cc:276] 0709 13:07:23.492206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.486879 (+1994673us) service_pool.cc:224] Handling call
0709 13:07:25.520001 (+ 33122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.506922 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.560364 26611 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:25.507117 28025 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:25.413900 27977 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.509433 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:25.527906 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.549476 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.507752 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:25.515201 28079 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.543709 26610 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:25.538358 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 63) took 1474 ms (client timeout 1753 ms). Trace:
I20260709 13:07:25.517326 28086 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:25.506083 27941 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.512849 27984 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:25.512082 26604 rpcz_store.cc:269] 0709 13:07:23.554844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.368012 (+1813168us) service_pool.cc:224] Handling call
0709 13:07:25.470241 (+102229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.516341 28001 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:07:25.556074 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 73421.2us
W20260709 13:07:25.572306 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64629us
I20260709 13:07:25.586517 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.566403 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.558919 27829 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:25.574846 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.555073 28018 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:25.574335 26612 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:25.580869 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 121764us
I20260709 13:07:25.591909 26603 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:25.559294 27915 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:25.561935 26678 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.593426 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:25.593294 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:25.575593 28022 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:25.576134 28079 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.580403 26606 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.584386 27807 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.548678 27905 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.558866 28009 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.584470 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:25.551215 28089 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:25.559644 27872 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.560884 28076 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:25.746508 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 153304us
I20260709 13:07:25.755170 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:25.746373 26612 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.759090 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 969) took 2227 ms. Trace:
I20260709 13:07:25.759629 26612 rpcz_store.cc:276] 0709 13:07:23.531656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.592073 (+2060417us) service_pool.cc:224] Handling call
0709 13:07:25.746084 (+154011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.758828 (+ 12744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.759032 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.747350 26608 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:25.761360 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 950) took 2312 ms. Trace:
I20260709 13:07:25.761767 26608 rpcz_store.cc:276] 0709 13:07:23.449017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.596831 (+2147814us) service_pool.cc:224] Handling call
0709 13:07:25.746984 (+150153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.761071 (+ 14087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.761301 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.649247 26609 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.779963 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 959) took 2313 ms. Trace:
I20260709 13:07:25.780413 26609 rpcz_store.cc:276] 0709 13:07:23.466839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.596661 (+2129822us) service_pool.cc:224] Handling call
0709 13:07:25.649066 (+ 52405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.779606 (+130540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.779896 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.591477 27978 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:25.686702 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 93297.1us
W20260709 13:07:25.700588 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 203678us
W20260709 13:07:25.574904 26605 rpcz_store.cc:269] 0709 13:07:24.063392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.376500 (+1313108us) service_pool.cc:224] Handling call
0709 13:07:25.537533 (+161033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.619107 27926 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.781734 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.622957 28022 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:25.849583 26603 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.853690 26609 raft_consensus.cc:2376] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4. Re-sending same reply.
I20260709 13:07:25.745095 28029 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:25.854564 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4360 after lost signal to thread 25510
I20260709 13:07:25.855127 27979 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:25.855602 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08002062e0 after lost signal to thread 26544
W20260709 13:07:25.855991 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08002061a0 after lost signal to thread 26558
W20260709 13:07:25.856680 28094 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:07:25.857137 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbac0 after lost signal to thread 26636
I20260709 13:07:25.857427 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1963) took 2224 ms. Trace:
I20260709 13:07:25.854594 28029 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:25.857890 26609 rpcz_store.cc:276] 0709 13:07:23.633108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.856595 (+2223487us) service_pool.cc:224] Handling call
0709 13:07:25.856853 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.857111 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.857134 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.857180 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.857223 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.857276 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.857375 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.858532 28029 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.859412 26609 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:25.859490 28029 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.859756 28022 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.860020 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1967) took 2221 ms. Trace:
I20260709 13:07:25.860424 26609 rpcz_store.cc:276] 0709 13:07:23.638492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.858921 (+2220429us) service_pool.cc:224] Handling call
0709 13:07:25.859217 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.859791 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.859974 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.861752 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 975) took 2206 ms. Trace:
I20260709 13:07:25.862030 26609 rpcz_store.cc:276] 0709 13:07:23.654947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.861074 (+2206127us) service_pool.cc:224] Handling call
0709 13:07:25.861332 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.861478 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.861501 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.861540 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.861568 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.861614 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.861709 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.863225 26609 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.784948 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:25.792642 26752 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:07:25.857429 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbaa0 after lost signal to thread 26637
W20260709 13:07:25.865314 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08001641c0 after lost signal to thread 26711
W20260709 13:07:25.866590 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9560 after lost signal to thread 26785
W20260709 13:07:25.866849 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9580 after lost signal to thread 26786
I20260709 13:07:25.867355 27857 tablet_copy_client.cc:538] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:25.863999 26752 raft_consensus.cc:614] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:25.869441 28100 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.870283 28100 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:25.751919 27807 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:25.870868 26633 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9e40 after lost signal to thread 27345
I20260709 13:07:25.871471 27807 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:25.872073 26633 debug-util.cc:398] Leaking SignalData structure 0x7b080037fec0 after lost signal to thread 28027
I20260709 13:07:25.872277 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:25.872939 26752 raft_consensus.cc:606] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:25.873360 26752 raft_consensus.cc:614] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:25.631451 28053 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.874285 28009 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.758522 28023 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:07:25.876696 27857 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:25.877696 28023 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:25.872471 27807 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.701241 27829 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:25.879927 27829 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.620090 27862 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.201s
I20260709 13:07:25.882598 27862 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.882961 27862 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:25.883700 27862 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.884388 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:25.884804 27862 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.886168 26606 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.649644 28049 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.888104 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:25.888441 27926 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:25.888077 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1968) took 2135 ms. Trace:
I20260709 13:07:25.888830 27926 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:25.889488 27926 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.892570 27941 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:25.897042 26604 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.631148 28093 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.239s
I20260709 13:07:25.621307 27849 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:25.900926 26610 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:25.901132 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1958) took 2269 ms. Trace:
I20260709 13:07:25.902799 26603 rpcz_store.cc:276] 0709 13:07:23.631980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.778911 (+2146931us) service_pool.cc:224] Handling call
0709 13:07:25.849419 (+ 70508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.900880 (+ 51461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.901080 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.903061 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 118199us
W20260709 13:07:25.704867 28084 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:25.908425 28093 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.908833 28093 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:25.909080 27316 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:25.909639 28093 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.913869 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:25.918474 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:25.919917 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:25.648779 27915 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:25.893236 28045 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:25.927956 26603 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.930896 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 983) took 2137 ms. Trace:
I20260709 13:07:25.931332 26603 rpcz_store.cc:276] 0709 13:07:23.793407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.903707 (+2110300us) service_pool.cc:224] Handling call
0709 13:07:25.927735 (+ 24028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.930557 (+  2822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.930822 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.907187 27872 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.902043 28076 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.901855 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1959) took 2269 ms. Trace:
I20260709 13:07:25.906795 28023 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:25.916738 26757 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:25.939026 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 977) took 2258 ms. Trace:
I20260709 13:07:25.941956 26609 rpcz_store.cc:276] 0709 13:07:23.680758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.862822 (+2182064us) service_pool.cc:224] Handling call
0709 13:07:25.863073 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.863520 (+   447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.938949 (+ 75429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.946208 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.953882 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.957276 26761 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 2: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:25.958868 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.925880 27905 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.916976 28089 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:07:25.973670 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 384051us
I20260709 13:07:25.967124 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.947441 27902 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.937664 26678 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:25.984329 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.961495 27988 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:25.972270 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 217174us
I20260709 13:07:25.963730 28023 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:25.901676 26606 rpcz_store.cc:276] 0709 13:07:23.753105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.886968 (+2133863us) service_pool.cc:224] Handling call
0709 13:07:25.887444 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.887616 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.887644 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.887720 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:25.887823 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.887906 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.888020 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.993383 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:25.980065 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:25.964460 27900 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.935989 26604 rpcz_store.cc:276] 0709 13:07:23.632200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.778907 (+2146707us) service_pool.cc:224] Handling call
0709 13:07:25.896850 (+117943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.897694 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.901316 (+  3622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.961958 27866 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:07:25.966181 28022 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:26.044880 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.130419 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.131095 25512 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd80 after lost signal to thread 27285
I20260709 13:07:26.131223 26603 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.125684 28036 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.125826 28092 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:25.937844 27978 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:26.140657 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.077s (SENT) [suppressed 42 similar messages]
W20260709 13:07:26.163228 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.165419 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.020s	sys 0.030s
W20260709 13:07:26.167192 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.020s	sys 0.030s
W20260709 13:07:26.168891 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 698389us
W20260709 13:07:26.180315 28082 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.035s	sys 0.073s
W20260709 13:07:26.183372 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 194464us
W20260709 13:07:26.181660 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.189440 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.191488 26683 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.165815 28092 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.169297 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.182972 28082 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.035s	sys 0.073s
I20260709 13:07:26.170596 28023 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.253685 26683 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:07:26.200371 28103 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:07:26.183127 27902 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.201632 27849 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:26.265856 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 76502us
I20260709 13:07:26.227799 26752 raft_consensus.cc:606] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:26.268085 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.228016 27921 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.207846 28009 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:26.270612 26683 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:26.187841 28036 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.273406 26606 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.300200 26684 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:26.288461 28082 tablet_copy_client.cc:323] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:07:26.302122 28023 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.273944 27849 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:26.303216 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 623) took 1160 ms. Trace:
I20260709 13:07:26.303576 26761 rpcz_store.cc:276] 0709 13:07:25.142304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.256880 (+114576us) service_pool.cc:224] Handling call
0709 13:07:26.303025 (+1046145us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400082d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.303164 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599396736}
I20260709 13:07:26.304455 27849 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:26.306317 26758 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:26.305783 27926 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:26.306756 28036 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:26.292089 28111 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.298436 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 982) took 2545 ms. Trace:
W20260709 13:07:26.296957 28106 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:07:26.308003 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1008) took 1160 ms. Trace:
I20260709 13:07:26.309110 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 628) took 1165 ms. Trace:
I20260709 13:07:26.308461 26758 rpcz_store.cc:276] 0709 13:07:25.147452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.467527 (+320075us) service_pool.cc:224] Handling call
0709 13:07:25.515064 (+ 47537us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:26.306141 (+791077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.306706 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.307831 (+  1125us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b5400082d50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.307952 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826045696}
I20260709 13:07:26.309612 26755 rpcz_store.cc:276] 0709 13:07:25.143518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.444452 (+300934us) service_pool.cc:224] Handling call
0709 13:07:25.485662 (+ 41210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.511008 (+ 25346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.512416 (+  1408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.550978 (+ 38562us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.991025 (+440047us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.994158 (+  3133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.006215 (+ 12057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.308892 (+302677us) raft_consensus.cc:1685] finished
0709 13:07:26.308920 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.309056 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":643,"raft.queue_time_us":4088,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3282,"thread_start_us":384218,"threads_started":1,"wal-append.queue_time_us":477055}
I20260709 13:07:26.311709 28096 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.312110 28096 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.312983 28096 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.314273 28096 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.308141 26605 rpcz_store.cc:276] 0709 13:07:23.758007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.867901 (+2109894us) service_pool.cc:224] Handling call
0709 13:07:25.868205 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.868410 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:25.868732 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.254399 (+385667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.262415 (+  8016us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:26.265258 (+  2843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.269105 (+  3847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.293043 (+ 23938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89126,"prepare.queue_time_us":2993,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":85422,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6288,"thread_start_us":296532,"threads_started":1}
I20260709 13:07:26.315582 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.274341 26752 raft_consensus.cc:614] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:26.316992 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49034.1us
I20260709 13:07:26.320062 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.268828 27915 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:26.273828 28045 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:26.296510 28110 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:07:26.322463 28099 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:07:26.322734 28102 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:07:26.272420 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 131817us
I20260709 13:07:26.331871 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:26.325395 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.321676 27902 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.274147 27921 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.319383 28049 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:26.335266 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:26.349211 27284 leader_election.cc:336] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.753s (SENT)
I20260709 13:07:26.349918 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.351907 28025 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:26.356387 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.358220 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.359383 26606 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.293118 28092 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.363555 26604 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.348855 27862 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:26.368531 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:26.367194 26605 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:26.344731 28105 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.331468 27919 raft_consensus.cc:1027] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: attempt to promote peer 77c617823f2e4a938ef247a8924e299b: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:26.367213 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.335484 28111 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.382169 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.383065 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88701.2us
I20260709 13:07:26.382191 27807 raft_consensus.cc:1027] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: attempt to promote peer 77c617823f2e4a938ef247a8924e299b: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:07:26.498629 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.387739 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:26.510144 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260709 13:07:26.511310 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.295606 28009 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:26.443120 28079 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260709 13:07:26.429467 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 644) took 1115 ms. Trace:
I20260709 13:07:26.528442 26685 rpcz_store.cc:276] 0709 13:07:25.314174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.451280 (+137106us) service_pool.cc:224] Handling call
0709 13:07:25.453381 (+  2101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.460747 (+  7366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.460779 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.477653 (+ 16874us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.953606 (+475953us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.953645 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.953720 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.429223 (+475503us) raft_consensus.cc:1685] finished
0709 13:07:26.429251 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.429404 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9035,"raft.queue_time_us":4668,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":16649,"thread_start_us":459252,"threads_started":1,"wal-append.queue_time_us":710674}
I20260709 13:07:26.529659 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:26.529994 26651 connection.cc:256] RPC call timeout handler was delayed by -1.0532930450000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:07:26.530746 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.531301 26685 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.453477 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 636) took 1171 ms. Trace:
W20260709 13:07:26.400629 27829 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
I20260709 13:07:26.405689 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.466949 26758 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:26.533464 26759 rpcz_store.cc:276] 0709 13:07:25.281734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.474814 (+193080us) service_pool.cc:224] Handling call
0709 13:07:25.488850 (+ 14036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.489172 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.489199 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.489579 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.936057 (+446478us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:26.203550 (+267493us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.204630 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.204725 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.347756 (+143031us) raft_consensus.cc:1685] finished
0709 13:07:26.347783 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.453260 (+105477us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540023afd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.453407 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364573,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":87640,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":35131,"spinlock_wait_cycles":31622528,"thread_start_us":660590,"threads_started":2,"wal-append.queue_time_us":624383}
I20260709 13:07:26.401222 26606 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.431305 27921 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:26.450886 27872 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.000s
I20260709 13:07:26.468880 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:26.549786 26761 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.550328 27977 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:26.461431 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.425594 26605 raft_consensus.cc:2410] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:26.551224 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:26.552145 27977 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.552489 26603 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.552335 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:26.552654 27977 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.552155 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:26.553491 27977 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.554068 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.554454 27977 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.555150 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.555876 26603 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 2: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.422320 27926 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:26.448071 26681 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:26.447103 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 651) took 1082 ms. Trace:
I20260709 13:07:26.469789 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:26.557435 26754 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.557758 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.558192 26609 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:26.373806 28049 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:26.446429 28076 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:07:26.407135 26683 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:26.423081 28086 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:26.448613 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.562094 26686 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:26.433362 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 625) took 1290 ms. Trace:
I20260709 13:07:26.450145 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1960) took 2817 ms. Trace:
I20260709 13:07:26.536033 28100 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.564814 26608 rpcz_store.cc:276] 0709 13:07:23.632377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.912276 (+2279899us) service_pool.cc:224] Handling call
0709 13:07:25.912570 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.947888 (+ 35318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.947931 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.947987 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:25.948029 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.449913 (+501884us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:26.449959 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.450089 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80739584}
I20260709 13:07:26.387639 28092 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.401093 27919 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:26.405077 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:26.406080 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.455219 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.520829 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.571457 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.571902 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.572732 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.495388 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.574111 26756 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:26.528807 27866 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:26.458431 28022 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:26.497282 28001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.010s	sys 0.019s
I20260709 13:07:26.540324 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.541617 26685 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:26.534739 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.578152 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.576082 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.578866 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.579137 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.579459 26758 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:26.580101 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.580489 26758 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:26.580621 26685 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:26.548775 26612 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.428756 28093 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.583528 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.554456 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.531332 27862 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.564491 28086 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.575237 28076 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:26.592957 26761 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:26.574033 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:26.575598 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.581876 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.582928 26754 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:26.556082 28003 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.561550 27921 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.531632 28079 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.587123 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.596307 26759 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:26.598536 28079 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:26.565678 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.583806 27315 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:26.574553 28077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.006s	sys 0.009s
W20260709 13:07:26.603735 28077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.007s	sys 0.009s
I20260709 13:07:26.603785 27866 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.604847 27866 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:26.590916 27978 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:26.608282 28003 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:26.608655 28003 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.608704 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.609499 28003 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.609977 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.610600 28003 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.610850 26606 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.612058 27857 tablet_bootstrap.cc:700] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent opening tablet: real 0.226s	user 0.001s	sys 0.001s
I20260709 13:07:26.613600 28107 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.614960 28107 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.615291 28107 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.616219 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 639) took 1303 ms. Trace:
I20260709 13:07:26.616576 26687 rpcz_store.cc:276] 0709 13:07:25.312976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.349427 (+ 36451us) service_pool.cc:224] Handling call
0709 13:07:26.616035 (+1266608us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54001e87d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.616162 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961702272}
W20260709 13:07:26.617079 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.617733 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.577674 28098 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:07:26.618422 26687 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:26.594673 28076 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:26.619685 28076 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.622329 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.624125 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.625195 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.625409 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.626166 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.627184 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.628005 28098 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:26.628371 28098 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.628587 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1961) took 2996 ms. Trace:
I20260709 13:07:26.628991 26612 rpcz_store.cc:276] 0709 13:07:23.632612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.402818 (+2770206us) service_pool.cc:224] Handling call
0709 13:07:26.403147 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.581955 (+178808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.628358 (+ 46403us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400065254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:26.628530 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334487808}
I20260709 13:07:26.548677 27849 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:07:26.583653 28001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.010s	sys 0.019s
I20260709 13:07:26.635952 27829 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.637041 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:26.557029 26678 rpcz_store.cc:276] 0709 13:07:25.364819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.371173 (+  6354us) service_pool.cc:224] Handling call
0709 13:07:26.446851 (+1075678us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54001ea0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.446987 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198950272}
I20260709 13:07:26.600314 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.639099 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:26.639811 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.590142 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:26.600827 28125 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:26.602767 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.619218 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.630748 26612 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:26.566305 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:26.565280 28115 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:26.595062 28100 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:26.527205 26726 leader_election.cc:336] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.676s (SENT)
I20260709 13:07:26.629189 28098 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:26.631007 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:26.642949 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68989.8us
W20260709 13:07:26.644249 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54138.8us
I20260709 13:07:26.666846 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.644749 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:26.668581 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86759us
I20260709 13:07:26.644986 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:26.646507 26686 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.651335 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.652135 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:26.672775 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 145609us
I20260709 13:07:26.674355 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:26.676981 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.676236 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.671495 26681 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.679525 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.679893 26681 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [1.2-2.3]
I20260709 13:07:26.682886 26686 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:26.646224 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1973) took 1734 ms. Trace:
I20260709 13:07:26.684408 26686 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:26.684298 26612 rpcz_store.cc:276] 0709 13:07:24.912267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.630099 (+1717832us) service_pool.cc:224] Handling call
0709 13:07:26.630400 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.645896 (+ 15496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.646157 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.685827 26612 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.646359 26603 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:26.655432 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.664938 26679 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:26.690699 26682 raft_consensus.cc:2410] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.689607 26612 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:26.671331 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.692241 26612 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 1
I20260709 13:07:26.693051 26612 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:26.693472 26612 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.694563 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.696142 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.696774 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:26.754266 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54919.4us
I20260709 13:07:26.710314 26682 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:26.757287 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86023.5us
I20260709 13:07:26.757532 26687 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:26.758100 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:26.758671 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61977.7us
I20260709 13:07:26.759019 26682 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.759500 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.760739 26682 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:26.762614 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.655151 28027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04d1d6cb7c54df78a1746de67ce6198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.651265 27807 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.616032 28107 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.659850 28001 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.703150 27921 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.666200 28115 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:26.757385 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59255.3us
I20260709 13:07:26.663626 27849 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:26.656989 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:26.759042 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:26.735335 28022 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.663429 28098 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.772439 27795 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.691921 27941 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.778656 28123 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.786408 27866 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:26.699872 27926 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.762382 28105 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:26.768350 27872 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.793334 28117 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.648543 27902 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.139s
I20260709 13:07:26.770411 27915 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.775883 26606 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.774686 27945 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.795846 28115 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.780822 27807 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.697850 28079 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:26.807405 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:26.703047 27978 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:07:26.784106 28111 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:26.788791 28025 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.768810 28112 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:26.815618 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49026.1us
I20260709 13:07:26.794443 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:26.776584 28089 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:26.822345 28009 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:26.798102 27984 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:26.788700 27829 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:26.821038 26604 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:26.795118 27849 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.830612 28117 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:26.815946 27926 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:26.794821 27919 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.829249 28133 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:07:26.822722 28123 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:26.858587 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.818142 28032 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:26.831897 27807 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:26.852095 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.831316 28079 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:26.830289 27795 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.842141 27945 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:26.855767 27819 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.855314 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:26.873301 27866 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.860303 28045 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:26.873178 28139 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:07:26.871434 27977 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.814248 28100 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.859974 27941 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:07:26.898059 28112 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:26.878621 27926 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.921103 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.865314 28022 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:26.564672 26753 rpcz_store.cc:276] 0709 13:07:25.142798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.371560 (+228762us) service_pool.cc:224] Handling call
0709 13:07:25.398012 (+ 26452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.416034 (+ 18022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.416066 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.416543 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.936897 (+520354us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b18001d19a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:07:26.224384 (+287487us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:26.229683 (+  5299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.261581 (+ 31898us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.432941 (+171360us) raft_consensus.cc:1685] finished
0709 13:07:26.432977 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.433286 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10447,"raft.queue_time_us":13861,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":18554240,"thread_start_us":249029,"threads_started":1,"wal-append.queue_time_us":916396}
I20260709 13:07:26.895061 28079 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.896337 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1983) took 1614 ms. Trace:
I20260709 13:07:26.856802 28025 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:26.885663 27919 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:26.926373 27977 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.900640 27819 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.912568 27866 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.935747 28105 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:26.940107 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83346.8us
W20260709 13:07:26.918462 28135 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:26.936481 26611 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:26.936767 28112 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:26.952967 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:26.953560 26611 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:26.955771 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.952169 28123 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.960250 27866 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.961364 27866 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.944895 27829 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:26.964401 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 205404us
I20260709 13:07:26.966604 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.969316 27919 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:26.970582 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:26.973371 26753 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:26.977193 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 992) took 1054 ms. Trace:
I20260709 13:07:26.977357 26760 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:26.977550 26609 rpcz_store.cc:276] 0709 13:07:25.922989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.978957 (+ 55968us) service_pool.cc:224] Handling call
0709 13:07:26.977023 (+998066us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540003e3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:26.977145 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265268480}
I20260709 13:07:26.978180 28003 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:26.978734 28003 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:26.978931 26609 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:26.979178 28003 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.979739 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:26.957549 27795 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.948179 27977 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.981173 28003 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:26.933351 27915 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.982465 27915 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:26.985244 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:26.985935 26760 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:26.987840 28077 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:26.987782 27978 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.988091 28003 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.988318 28077 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:26.989696 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.005641 26756 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:27.006945 26756 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.991128 26612 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:27.007521 26612 pending_rounds.cc:85] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:07:27.007822 26612 pending_rounds.cc:107] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:27.008092 26612 raft_consensus.cc:2889] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.979888 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 272d473e821e4c15a9f3fa0471adfdc6 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:07:26.994814 26761 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:27.014745 26761 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:07:26.995348 26758 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:26.988941 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.018294 26687 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:26.941490 26604 rpcz_store.cc:276] 0709 13:07:25.273475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.664682 (+1391207us) service_pool.cc:224] Handling call
0709 13:07:26.794656 (+129974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.865695 (+ 71039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.887917 (+ 22222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.997017 26609 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:26.997694 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.000365 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:26.967031 28025 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:26.989598 28045 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.027242 28001 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:26.965490 27829 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:27.020459 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 272d473e821e4c15a9f3fa0471adfdc6 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6
I20260709 13:07:26.949604 27849 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.039592 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.043882 26603 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
W20260709 13:07:27.043444 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87771.3us
I20260709 13:07:26.952494 27945 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.046847 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:27.025812 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:27.028785 27949 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.048265 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:27.030155 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66716.8us
I20260709 13:07:27.063259 26682 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:27.063947 27829 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.065165 27829 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.065795 27872 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:27.033267 28149 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.080875 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:27.084967 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:27.020473 28086 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.051107 27862 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.047489 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.060835 28089 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.047151 28096 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:07:27.092352 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.090821 28139 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:27.021497 27819 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:27.058177 27988 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:27.113891 28139 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:27.095724 28151 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.115348 28139 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:27.119269 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.096740 27315 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:27.035955 28112 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.121677 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 196) took 1331 ms. Trace:
I20260709 13:07:27.121978 28112 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.122219 27315 rpcz_store.cc:276] 0709 13:07:25.790325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.792481 (+  2156us) service_pool.cc:224] Handling call
0709 13:07:26.404908 (+612427us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:27.121573 (+716665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98505984}
I20260709 13:07:27.124154 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:27.086216 28149 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:26.950700 28117 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.057857 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.089185 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:27.059962 27316 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:27.114084 27988 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.054895 28077 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.073925 27807 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.132800 27321 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:27.092274 28009 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.134068 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:27.143235 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54141.7us
I20260709 13:07:27.146402 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:27.129031 27905 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.149876 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:07:27.150876 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.134440 28149 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.153702 26686 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:27.155061 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.149036 28018 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.162756 26607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 980) took 3459 ms (client timeout 1748 ms). Trace:
I20260709 13:07:27.163019 26752 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.163458 26752 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:27.163223 26607 rpcz_store.cc:269] 0709 13:07:23.703326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.266260 (+1562934us) service_pool.cc:224] Handling call
0709 13:07:27.162557 (+1896297us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001004d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.162687 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587028224}
I20260709 13:07:27.164570 26752 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.165526 26752 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.166497 27926 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.138536 28144 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:27.098021 28123 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:27.193343 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:27.194151 26686 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:27.188052 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.198810 27979 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.199378 27979 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:27.200480 27979 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.201270 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 1984) took 1927 ms. Trace:
I20260709 13:07:27.202039 27979 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.144712 26678 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:27.148211 28112 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:27.204156 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.055217 28105 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.153309 28139 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:27.201907 26606 rpcz_store.cc:276] 0709 13:07:25.273718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.665113 (+1391395us) service_pool.cc:224] Handling call
0709 13:07:26.707433 (+ 42320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.827067 (+119634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.200977 (+373910us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002855d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.201188 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61386496}
I20260709 13:07:27.220391 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.214076 28086 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:27.214649 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 55504.3us
I20260709 13:07:27.162899 28018 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.215303 27866 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:27.216333 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:27.152841 26604 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:27.194730 27921 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.167971 28147 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:27.203366 27872 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.238981 26609 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:27.147156 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.152168 28009 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:07:27.152558 27905 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.143772 28001 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:27.233032 28076 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 13:07:27.250268 27945 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.255218 27945 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.234056 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.231976 28139 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:27.242663 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.240456 27872 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.264101 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 121498us
I20260709 13:07:27.264184 28139 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.266111 27829 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.266569 27829 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.235419 27977 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.268193 27872 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.267864 28086 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.273811 27312 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:27.258149 28076 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.285413 27807 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.286778 27977 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.280853 27926 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:27.293614 28164 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:07:27.293430 27988 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.283366 26752 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:27.278501 28148 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.296536 27988 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.296649 28148 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.299368 26681 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:27.278453 28086 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:27.304781 28076 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.306111 27829 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.291234 28018 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.306372 27857 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:27.301858 28079 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.307753 28148 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:27.302276 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39266 (request call id 218) took 3803 ms. Trace:
I20260709 13:07:27.310122 28027 rpcz_store.cc:276] 0709 13:07:23.483003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.483660 (+   657us) service_pool.cc:224] Handling call
0709 13:07:24.168500 (+684840us) ts_tablet_manager.cc:934] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
0709 13:07:26.653892 (+2485392us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:26.991142 (+337250us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:27.019385 (+ 28243us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:27.266908 (+247523us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:27.270252 (+  3344us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:27.281057 (+ 10805us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:27.286307 (+  5250us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":22029,"tablet-copy.queue_time_us":89344,"thread_start_us":143744,"threads_started":2}
I20260709 13:07:27.311915 28027 tablet_copy_client.cc:806] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:27.312719 28027 tablet_copy_client.cc:670] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:27.302392 28086 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.315199 27905 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:27.320243 27849 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.320508 28079 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:27.320781 28098 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:07:27.321316 27857 tablet_bootstrap.cc:492] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:27.327492 27829 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.328265 27945 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:27.328064 27829 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.328451 27857 ts_tablet_manager.cc:1403] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 1.452s	user 0.030s	sys 0.013s
I20260709 13:07:27.324380 28009 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.326736 28148 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.332150 28025 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:27.329291 28009 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.336851 28009 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:27.333349 28148 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.338045 28149 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.339221 28148 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.340023 28053 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.340377 28053 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:27.341111 28053 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.342082 28053 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.344542 27829 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.345137 27872 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.345335 28115 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:27.347620 28115 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.335480 28086 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.352895 27778 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.353137 28149 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.353427 27778 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:27.354501 27778 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.355295 28086 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.361382 28077 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:27.364378 27779 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:07:27.365340 27949 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.365820 27949 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:27.366776 27949 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.336071 27857 raft_consensus.cc:359] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:27.375914 28036 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.376456 28036 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:27.377477 28036 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.378997 28036 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.372493 28107 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.394755 27949 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.455054 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.456948 26606 raft_consensus.cc:2376] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3. Re-sending same reply.
I20260709 13:07:27.459280 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.466837 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.472914 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1002) took 1172 ms. Trace:
I20260709 13:07:27.490983 26605 rpcz_store.cc:276] 0709 13:07:26.300331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.551855 (+251524us) service_pool.cc:224] Handling call
0709 13:07:27.472432 (+920577us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.472716 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525761920}
I20260709 13:07:27.492760 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.474730 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.495767 26611 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.496402 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.497403 26607 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.497517 26611 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:27.499362 26611 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:27.475696 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:27.484458 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 200082us
I20260709 13:07:27.500615 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 668) took 1006 ms. Trace:
I20260709 13:07:27.485157 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.486045 26679 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:27.471385 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.501078 26681 rpcz_store.cc:276] 0709 13:07:26.494490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.696912 (+202422us) service_pool.cc:224] Handling call
0709 13:07:26.697199 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.486785 (+789586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.500112 (+ 13327us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54003138d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:27.500377 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384459648}
I20260709 13:07:27.509637 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:27.510434 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:27.535055 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.536350 26679 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:27.537701 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.538463 26609 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:27.512437 26608 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:27.539803 26608 pending_rounds.cc:85] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 1
I20260709 13:07:27.540198 26608 pending_rounds.cc:107] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:27.540601 26608 raft_consensus.cc:2889] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.544242 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:27.544979 26604 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.545537 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.550437 27778 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.552152 28023 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.552554 28096 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.553406 28153 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:27.554302 28089 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:27.554492 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.555223 28144 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.556273 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.556790 28045 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.560060 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.560446 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.561729 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.564311 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.565189 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.566789 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.567001 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.563438 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.585335 26679 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.586709 28153 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:27.601326 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:07:27.602536 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59628.3us
I20260709 13:07:27.602969 28153 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:27.600206 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.612960 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.606142 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.604660 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.605103 26612 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:27.633630 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.633821 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.634008 27872 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:27.634557 26612 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.634884 26611 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3.
I20260709 13:07:27.604426 26685 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:07:27.606474 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.634580 26608 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:27.604703 28089 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.665482 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.669274 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:27.670596 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.672361 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:27.675587 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.677003 26759 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:27.678535 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:27.679538 28093 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:27.681831 26611 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.691344 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:27.692214 27315 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:27.695869 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.371884 27857 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:27.701929 27857 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:27.703406 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.706873 26755 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:27.708108 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.604367 28045 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.604229 28149 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.747972 28149 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.748469 28149 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.753192 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.754182 26609 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.603937 28144 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:27.739418 26611 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:27.742936 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.603581 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:27.760949 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.772579 28152 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.773598 26761 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:27.774084 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 170686us
I20260709 13:07:27.776420 27829 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:27.778116 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 234) took 1136 ms. Trace:
W20260709 13:07:27.779567 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.785053 28144 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:27.792687 26755 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:27.794647 28144 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.794842 26755 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:27.795292 28144 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.796078 26510 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.797385 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.798139 28144 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:27.799921 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 117085us
W20260709 13:07:27.801512 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.801803 26507 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 215) took 9210 ms. Trace:
I20260709 13:07:27.802815 26752 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:27.803211 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.612124 28096 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.771194 28023 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.778625 27312 rpcz_store.cc:276] 0709 13:07:26.641602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.645054 (+  3452us) service_pool.cc:224] Handling call
0709 13:07:27.132147 (+487093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.282953 (+150806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.776937 (+493984us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:27.777660 (+   723us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54006f2f50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.777905 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394945280}
I20260709 13:07:27.825438 28023 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.826960 26759 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:27.798633 26510 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.665959 28089 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:27.781991 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 218952us
I20260709 13:07:27.815085 28096 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.815884 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:27.819320 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.819823 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.820341 26575 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:27.779491 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.832137 26606 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:27.832316 26679 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:27.830807 27857 ts_tablet_manager.cc:1434] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.502s	user 0.005s	sys 0.005s
I20260709 13:07:27.846793 26612 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:27.847864 26510 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.863866 26607 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:27.869145 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.870293 26606 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.871059 26684 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:27.825448 28045 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:27.874943 27819 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.875430 26760 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:27.877560 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102113us
I20260709 13:07:27.877099 26510 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.878326 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.879055 27315 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:27.872736 26754 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:27.871493 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.873807 26609 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:27.872166 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.874781 27919 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.884696 26683 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:27.885730 26678 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:27.887924 27829 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:27.887844 27919 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.888425 27829 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.888841 27829 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.890512 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.891207 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 1993) took 1432 ms. Trace:
I20260709 13:07:27.848770 26604 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:27.892410 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:27.892625 28089 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.892990 26758 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:27.893054 26604 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2. Re-sending same reply.
I20260709 13:07:27.894845 26604 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:27.895864 27902 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.896462 27902 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:27.897737 28086 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:27.898089 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57306.6us
W20260709 13:07:27.899034 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 83557.1us
I20260709 13:07:27.900014 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.900852 28023 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:27.901275 28153 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:27.897771 28053 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:07:27.901948 27905 raft_consensus.cc:2764] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:27.901942 27919 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.891615 26683 rpcz_store.cc:276] 0709 13:07:26.459059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.600076 (+141017us) service_pool.cc:224] Handling call
0709 13:07:27.890993 (+1290917us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.891127 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001591552}
I20260709 13:07:27.895414 26697 tablet_copy_source_session.cc:215] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:27.905186 28098 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:27.907075 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.908511 27316 pending_rounds.cc:85] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 4
I20260709 13:07:27.909399 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.898229 28086 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.908923 27316 pending_rounds.cc:107] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 13:07:27.851929 27857 ts_tablet_manager.cc:1467] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Tablet startup took 523ms
I20260709 13:07:27.919438 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.880563 28152 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:27.917510 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.919641 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.921401 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:27.930589 26606 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.879076 26510 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.928876 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:27.933314 27849 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.591s	user 0.000s	sys 0.014s
I20260709 13:07:27.935293 27902 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:27.879514 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.935963 26607 raft_consensus.cc:2376] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3. Re-sending same reply.
W20260709 13:07:27.936410 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57127.4us
I20260709 13:07:27.937114 28152 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:27.937783 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.918617 28086 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.938855 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.918462 26603 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:27.923127 26685 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:27.921141 26760 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:27.924423 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:27.802217 26507 rpcz_store.cc:276] 0709 13:07:18.591637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.591990 (+   353us) service_pool.cc:224] Handling call
0709 13:07:27.801542 (+9209552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.474354 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.474931 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.474965 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:07:25.474982 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:25.508292 (+ 33310us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.511806 (+  3514us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.511838 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:07:25.526103 (+ 14265us) tablet.cc:701] Row locks acquired
0709 13:07:25.526124 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:25.526272 (+   148us) write_op.cc:270] Start()
0709 13:07:25.526383 (+   111us) write_op.cc:276] Timestamp: P: 1783602445526230 usec, L: 0
0709 13:07:25.526409 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.531698 (+  5289us) log.cc:844] Serialized 993 byte log entry
0709 13:07:26.816744 (+1285046us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.145502 (+328758us) write_op.cc:301] APPLY: starting
0709 13:07:27.148973 (+  3471us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.169932 (+ 20959us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.211404 (+ 41472us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.261710 (+ 50306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.275954 (+ 14244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:07:27.277497 (+  1543us) write_op.cc:312] APPLY: finished
0709 13:07:27.286002 (+  8505us) log.cc:844] Serialized 28 byte log entry
0709 13:07:27.295940 (+  9938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.296030 (+    90us) write_op.cc:454] Released schema lock
0709 13:07:27.296066 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.296410 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.296445 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2391898,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":313467,"apply.run_cpu_time_us":2906,"apply.run_wall_time_us":158079,"num_ops":2,"prepare.queue_time_us":50134,"prepare.run_cpu_time_us":26161,"prepare.run_wall_time_us":481133,"raft.queue_time_us":438252,"raft.run_cpu_time_us":23963,"raft.run_wall_time_us":178706,"replication_time_us":1266186,"thread_start_us":1017238,"threads_started":4,"wal-append.queue_time_us":455568}]]}
I20260709 13:07:27.925925 28153 consensus_queue.cc:1243] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:27.917810 27872 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.919802 27316 raft_consensus.cc:2889] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.958601 26609 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:27.926959 28036 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.004s
I20260709 13:07:27.927359 28053 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.969890 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:27.927841 28098 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.950217 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:27.954411 26612 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.957253 27905 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:27.938855 27949 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.006s
I20260709 13:07:27.957726 26604 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:07:27.971906 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64984.7us
W20260709 13:07:27.980024 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 64689.7us
I20260709 13:07:27.956622 27902 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.980762 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.943749 27919 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:27.958462 27872 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:27.987339 28107 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:27.970057 28053 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:27.975469 27905 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.998874 26608 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:27.979208 26604 pending_rounds.cc:85] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 1
I20260709 13:07:28.002724 26754 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:28.002620 27866 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:07:28.004081 28093 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:28.005051 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:27.978309 28153 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.000952 27905 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.018518 27872 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.019977 27872 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.023468 26761 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:28.008034 26604 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:27.997720 27949 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:28.034847 26604 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.046566 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.040371 28144 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:28.041311 27902 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:28.055981 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.039710 27849 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.058175 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.039498 28053 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.041757 28093 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:28.079733 26682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.041s	sys 0.090s
W20260709 13:07:28.080201 26682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.042s	sys 0.090s
W20260709 13:07:28.079859 27807 consensus_queue.cc:1175] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e09ea9b455894a0189912a7b9b6b2f84" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:07:28.080651 28093 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.081403 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.045s	sys 0.086s
W20260709 13:07:28.081712 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.045s	sys 0.086s
I20260709 13:07:28.082625 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 660) took 1603 ms. Trace:
W20260709 13:07:28.057191 28154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.016s
I20260709 13:07:28.061825 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:28.083809 28001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.005s	sys 0.034s
W20260709 13:07:28.084057 28154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.004s	sys 0.017s
W20260709 13:07:28.084197 28001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.005s	sys 0.034s
I20260709 13:07:28.066563 27829 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.085343 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104681us
I20260709 13:07:28.086561 27829 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.067761 28049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.011s	sys 0.023s
W20260709 13:07:28.068495 28115 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.006s
W20260709 13:07:28.087316 28112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.008s	sys 0.015s
W20260709 13:07:28.087744 28112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.008s	sys 0.016s
I20260709 13:07:28.088048 28112 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:28.088181 26679 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:28.071921 27902 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:28.060604 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 67) took 3358 ms. Trace:
I20260709 13:07:28.089548 27902 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.090142 28107 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:28.090579 28107 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.090955 28107 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.057565 28144 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:28.092016 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54974.8us
I20260709 13:07:28.091938 28144 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.093151 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:28.093618 28144 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.093885 26604 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:28.093911 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.074421 28053 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.095472 26761 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:28.096767 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.097466 26754 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:28.088933 26610 rpcz_store.cc:276] 0709 13:07:24.595120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.904488 (+1309368us) service_pool.cc:224] Handling call
0709 13:07:27.164438 (+1259950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.205262 (+ 40824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.205309 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.216617 (+ 11308us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.243417 (+ 26800us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.268386 (+ 24969us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.268619 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.268690 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.946864 (+678174us) raft_consensus.cc:1685] finished
0709 13:07:27.946901 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.947987 (+  1086us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001004d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:27.953623 (+  5636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30911,"prepare.queue_time_us":24808,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":1819,"raft.queue_time_us":49506,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":4080,"spinlock_wait_cycles":2896886144,"thread_start_us":26433,"threads_started":1,"wal-append.queue_time_us":690621}
W20260709 13:07:28.075745 26686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.017s	sys 0.023s
I20260709 13:07:28.099421 27849 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:28.099866 26686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.018s	sys 0.023s
I20260709 13:07:28.100076 27849 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:28.087332 27829 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:28.102118 27829 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:28.103153 27829 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.103699 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58388.7us
I20260709 13:07:28.104648 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:28.060343 28096 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:28.107013 28049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.012s	sys 0.023s
I20260709 13:07:28.107177 28096 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.107652 28096 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.079545 27905 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.109542 28049 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:28.109941 28049 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:28.110437 28018 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.111785 27905 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.110822 28049 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.112486 27905 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:28.112907 28049 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.113159 26611 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:07:28.113598 26611 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 2
I20260709 13:07:28.113832 26611 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:07:28.114063 26611 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:28.113219 28155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.000s	sys 0.018s
I20260709 13:07:28.110847 28018 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:28.116122 28155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.000s	sys 0.019s
I20260709 13:07:28.074908 28149 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.121024 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.124778 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 675) took 1050 ms. Trace:
I20260709 13:07:28.125197 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.112941 27905 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:27.920850 27857 ts_tablet_manager.cc:1469] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Trace:
0709 13:07:18.311461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.322905 (+ 11444us) service_pool.cc:224] Handling call
0709 13:07:18.685107 (+362202us) ts_tablet_manager.cc:934] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
0709 13:07:19.071211 (+386104us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f019fcaa 00007f40f019fbd2 00007f40f8204131
0709 13:07:23.684973 (+4613762us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:24.645739 (+960766us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:24.645851 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:24.697408 (+ 51557us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:24.697745 (+   337us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:24.698391 (+   646us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:24.701548 (+  3157us) inbound_call.cc:177] Queueing success response
0709 13:07:25.876365 (+1174817us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:27.328916 (+1452551us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:27.333879 (+  4963us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:27.334459 (+   580us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":5691,"raft.queue_time_us":414,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":226,"spinlock_wait_cycles":18327424,"tablet-copy.queue_time_us":208694,"tablet-download-pool.queue_time_us":8960,"tablet-download-pool.run_cpu_time_us":1590,"tablet-download-pool.run_wall_time_us":331711,"thread_start_us":1105545,"threads_started":2}
I20260709 13:07:28.130146 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.130846 26685 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 1.
I20260709 13:07:28.131413 28152 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.132009 28152 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.132408 26678 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:28.127187 28128 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.133680 28128 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.135187 26757 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:28.135835 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.136428 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.136672 26758 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:28.137367 27919 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:28.137795 27919 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.138151 27919 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.138700 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.045601 28023 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:07:28.141119 26687 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:28.082942 26680 rpcz_store.cc:276] 0709 13:07:26.479202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.668901 (+189699us) service_pool.cc:224] Handling call
0709 13:07:26.770936 (+102035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.771183 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:27.488868 (+717685us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b1800366be0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf
0709 13:07:27.489157 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.082137 (+592980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.082214 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.082355 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.082448 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.082557 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43697,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"spinlock_wait_cycles":2294016,"thread_start_us":618760,"threads_started":2}
I20260709 13:07:28.142442 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.125352 26682 rpcz_store.cc:276] 0709 13:07:27.072794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.073077 (+   283us) service_pool.cc:224] Handling call
0709 13:07:27.073505 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.089062 (+ 15557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.089108 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.101162 (+ 12054us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.080777 (+979615us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:28.080836 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.080923 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.118429 (+ 37506us) raft_consensus.cc:1685] finished
0709 13:07:28.118455 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.122971 (+  4516us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15087,"raft.queue_time_us":15932,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":38004,"thread_start_us":946294,"threads_started":1,"wal-append.queue_time_us":958314}
I20260709 13:07:28.146010 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:28.146878 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.142462 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.149533 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:28.150676 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.124742 28115 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.152361 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.152953 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.162217 26611 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.141820 28152 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.164798 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.101317 27849 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.150534 28077 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:28.170605 26683 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:28.171167 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.150025 27819 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:28.167223 26685 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:28.155148 28128 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.168918 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.172230 26679 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:28.128342 27905 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.186436 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44761.1us
I20260709 13:07:28.170894 28077 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.192317 28077 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.175176 27819 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.196347 27819 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.173458 27949 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:28.201979 27949 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:28.202397 27949 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.202737 28107 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.175817 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.204991 26678 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:28.152261 28018 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.212716 28152 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:28.213801 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.226552 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 396131us
I20260709 13:07:28.236243 26610 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
W20260709 13:07:28.237905 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51926.2us
I20260709 13:07:28.168401 28086 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.190021 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.302676 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:28.221959 28053 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:07:28.316608 26758 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:28.229713 28152 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.278492 28023 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:28.279469 26757 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:07:28.318287 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.030s	sys 0.011s
I20260709 13:07:28.330024 28149 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.173938 28112 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.339838 28105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.015s	sys 0.034s
W20260709 13:07:28.344233 28105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.015s	sys 0.035s
I20260709 13:07:28.344861 28111 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:07:28.346690 28032 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.347235 28032 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.348459 28107 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.349887 28032 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:28.350344 28117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.012s	sys 0.025s
I20260709 13:07:28.350680 28152 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.323171 28098 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.332861 28023 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.337409 28001 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.354233 28001 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.354612 28023 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.355499 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:28.321563 28128 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:28.356278 28001 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.340922 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.031s	sys 0.011s
W20260709 13:07:28.330334 28139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.014s	sys 0.025s
I20260709 13:07:28.358506 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.365067 26758 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:07:28.350716 28117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.012s	sys 0.025s
W20260709 13:07:28.368369 28139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.014s	sys 0.026s
I20260709 13:07:28.368839 26753 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:28.370235 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.371131 26759 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:28.371932 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-2da4a43c4ca64471b27b22ea1a167d13 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:07:28.372346 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.375510 28036 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.376153 28036 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.376996 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:28.378239 28036 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:28.378803 28036 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:28.381017 28174 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.373533 26759 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:28.372581 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-2da4a43c4ca64471b27b22ea1a167d13 on tablet 2da4a43c4ca64471b27b22ea1a167d13 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:28.384439 26680 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:07:28.386142 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 153955us
I20260709 13:07:28.386907 26611 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:28.387568 27866 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.383438 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.392648 27866 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.393545 26759 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.397006 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2000) took 1191 ms. Trace:
W20260709 13:07:28.383582 28182 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:28.401202 26686 rpcz_store.cc:276] 0709 13:07:27.205956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.222522 (+ 16566us) service_pool.cc:224] Handling call
0709 13:07:27.236885 (+ 14363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.237417 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.237459 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.238022 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.100438 (+862416us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:28.100488 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.100580 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.396749 (+296169us) raft_consensus.cc:1685] finished
0709 13:07:28.396774 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.396936 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1291,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11231,"thread_start_us":839750,"threads_started":1,"wal-append.queue_time_us":976658}
I20260709 13:07:28.413772 28086 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:28.414690 28086 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:28.341363 28149 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.441895 26603 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:28.415279 28086 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.448977 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69292us
I20260709 13:07:28.449472 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:28.397439 27819 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:28.469053 26756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.050s
W20260709 13:07:28.481575 26756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.003s	sys 0.050s
I20260709 13:07:28.463801 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.484139 26757 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.486702 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:28.464480 28147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.008s	sys 0.020s
W20260709 13:07:28.488330 28147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.009s	sys 0.021s
I20260709 13:07:28.488643 28147 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:28.488767 28096 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.488925 28139 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.489705 28147 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.490360 28139 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.490880 28096 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.492676 28086 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.492883 28154 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.493221 28086 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:28.493515 28154 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.493824 28086 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.454350 28036 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:28.491827 28117 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:28.496411 28036 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.496613 28117 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.496778 28036 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:28.496999 28117 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:28.497152 27919 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.497789 28036 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.499200 28036 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.497943 28117 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.501942 26608 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:28.481428 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.010s	sys 0.019s
I20260709 13:07:28.464597 28152 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.500597 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.499281 27919 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.508030 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.010s	sys 0.019s
I20260709 13:07:28.453518 28149 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.518088 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:28.521030 26680 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:28.518541 27866 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.513667 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.18151e+06us
W20260709 13:07:28.526139 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.495433 27949 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:28.532378 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 114881us
I20260709 13:07:28.501101 28154 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:28.535238 26510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.002s	sys 0.024s
W20260709 13:07:28.537720 26510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.002s	sys 0.024s
I20260709 13:07:28.536378 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.540056 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.540975 26680 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:28.543686 26687 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:28.535576 27284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.016s
W20260709 13:07:28.534516 27316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.010s	sys 0.040s
I20260709 13:07:28.522926 28096 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.532544 28086 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.587040 26683 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:28.588207 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.536504 28117 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.589607 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:28.542395 28115 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.597793 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:28.590515 27316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.040s
I20260709 13:07:28.565868 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:28.587798 27284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.016s
I20260709 13:07:28.603009 26680 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:28.610704 26759 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
W20260709 13:07:28.619356 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.595714 27866 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.538486 28089 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:28.635296 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:28.643963 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 126029us
I20260709 13:07:28.645601 26684 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:28.590229 28174 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.646873 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:28.650583 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.599010 28128 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:28.612263 28154 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.533214 28178 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:07:28.640599 28098 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:28.677086 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:28.677558 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.678589 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 93741.2us
I20260709 13:07:28.678915 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.682538 26759 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.632962 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 694202us
I20260709 13:07:28.679256 27919 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.691468 26758 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:07:28.659890 28093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.013s	sys 0.020s
I20260709 13:07:28.641988 28096 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.688264 26678 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:28.684804 28098 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.702257 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.672904 27819 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.642153 27866 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:28.693970 28155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.019s
W20260709 13:07:28.706851 27829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.019s	sys 0.045s
W20260709 13:07:28.702857 28093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.020s
I20260709 13:07:28.763803 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:28.768306 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 82048.5us
I20260709 13:07:28.709538 28098 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.688377 28128 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:28.759393 28155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.007s	sys 0.020s
W20260709 13:07:28.764837 27829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.019s	sys 0.046s
I20260709 13:07:28.794669 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.764529 28089 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.708863 27919 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:28.801962 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.808676 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.777078 27819 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.808820 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.846530 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.847321 26758 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.849867 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 204940us
I20260709 13:07:28.803606 27949 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.810290 28149 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:28.859108 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:28.816360 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.845809 28154 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:28.882818 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.876318 28128 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:28.805712 28089 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.860437 28049 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.856247 27902 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.890787 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.917208 26680 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.863441 28185 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:28.888851 26759 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:28.858438 28105 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.896859 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:28.862967 27287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.017s
I20260709 13:07:28.897528 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.899580 28172 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.899840 28144 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.900494 28187 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:07:28.901479 28190 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:07:28.901723 28176 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:07:28.902383 28189 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:28.905685 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.890291 27807 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.908073 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.911741 27778 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:28.911892 27919 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.912554 28177 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:07:28.919283 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:28.953243 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 150989us
I20260709 13:07:28.921412 28178 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.956512 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.944502 28096 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.957116 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:28.957121 26685 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.959702 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 654) took 1801 ms. Trace:
I20260709 13:07:28.923979 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:28.924450 28210 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.885625 28154 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:28.924796 28184 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:28.929528 27866 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.929996 28193 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:07:28.970551 28197 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.920279 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.858449 28174 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:28.925339 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:28.972645 26686 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.915555 28077 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.001s
I20260709 13:07:28.938000 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.977523 26759 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.892673 26678 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:28.940003 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80939.4us
I20260709 13:07:28.940604 27902 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:28.942219 28144 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.942605 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 76) took 1490 ms. Trace:
I20260709 13:07:28.984447 26605 rpcz_store.cc:276] 0709 13:07:27.452297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.492309 (+ 40012us) service_pool.cc:224] Handling call
0709 13:07:28.942366 (+1450057us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002850d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:28.942516 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3311698816}
I20260709 13:07:28.985158 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1045) took 1016 ms. Trace:
I20260709 13:07:28.985692 28144 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.926360 28049 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:28.947378 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.988339 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.988547 26754 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.948354 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.971140 26757 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:28.929572 28018 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.951057 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.946768 27807 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.952520 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.953404 27778 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.962852 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:28.999491 26608 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.000650 27778 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:29.003706 27807 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.004315 26611 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.007800 26680 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:28.967065 26758 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:28.967931 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.968511 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49311.2us
I20260709 13:07:28.967222 28154 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.996726 28032 raft_consensus.cc:2764] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:29.012094 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:28.969364 28198 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:28.969499 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:29.016691 26610 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.944392 28105 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.969981 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 668) took 1178 ms. Trace:
I20260709 13:07:29.015092 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:28.970649 26685 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:28.936388 28172 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.930272 28098 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:28.973610 28201 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.973793 28174 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.030907 28105 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.974196 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:29.031844 28201 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.033121 28172 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.974105 28112 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:29.034024 26679 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:28.975274 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 678) took 1718 ms. Trace:
I20260709 13:07:29.034155 28201 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:28.976270 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52386.3us
I20260709 13:07:29.034957 28098 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.960112 26753 rpcz_store.cc:276] 0709 13:07:27.137615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.140696 (+  3081us) service_pool.cc:224] Handling call
0709 13:07:27.163122 (+ 22426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.369437 (+1206315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.884616 (+515179us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002ea4d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:28.938897 (+ 54281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771389696}
I20260709 13:07:29.035722 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.024451 28210 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:29.036582 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:28.931761 27287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.010s	sys 0.017s
I20260709 13:07:29.037957 28210 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:28.980867 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:29.038827 26612 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:28.982547 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 208) took 1079 ms. Trace:
I20260709 13:07:28.972343 28096 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.040719 28096 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:29.041303 28096 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.986377 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.042943 26683 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 2: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:29.043402 28199 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.089s	user 0.002s	sys 0.001s
I20260709 13:07:28.989380 26603 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.017274 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:28.987918 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:28.993057 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:28.997587 28147 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.015615 26608 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:29.017563 27807 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.087806 27807 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.088220 27807 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.018877 27778 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:29.017619 28149 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:29.087277 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:29.089216 27778 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.088928 28149 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.089597 27778 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:29.089427 28208 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.091131 28149 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:28.989289 28200 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.021387 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:29.021940 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64929.8us
I20260709 13:07:29.023520 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.017763 26756 rpcz_store.cc:276] 0709 13:07:27.791586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.833732 (+ 42146us) service_pool.cc:224] Handling call
0709 13:07:27.861430 (+ 27698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.888167 (+ 26737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.888198 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.888663 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.482026 (+593363us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:28.482072 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.482154 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.969770 (+487616us) raft_consensus.cc:1685] finished
0709 13:07:28.969791 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.969923 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3867,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":592955,"threads_started":1,"wal-append.queue_time_us":795774}
I20260709 13:07:29.018708 26611 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:29.025307 26759 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:29.034289 28112 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:29.034523 26681 rpcz_store.cc:276] 0709 13:07:27.257383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.822403 (+565020us) service_pool.cc:224] Handling call
0709 13:07:27.822945 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.823576 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.823610 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.908473 (+ 84863us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.231570 (+323097us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.231611 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.231712 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.974528 (+742816us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b24000fd4d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:07:28.975000 (+   472us) raft_consensus.cc:1685] finished
0709 13:07:28.975017 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.975218 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":348,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":238,"spinlock_wait_cycles":41659136,"thread_start_us":322668,"threads_started":1,"wal-append.queue_time_us":604687}
I20260709 13:07:28.985569 26760 rpcz_store.cc:276] 0709 13:07:27.968520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.968688 (+   168us) service_pool.cc:224] Handling call
0709 13:07:27.970056 (+  1368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.987112 (+ 17056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.987187 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.987755 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.468797 (+481042us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.468851 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.468947 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.984981 (+516034us) raft_consensus.cc:1685] finished
0709 13:07:28.985001 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.985108 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5419,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13703,"thread_start_us":480585,"threads_started":1,"wal-append.queue_time_us":702179}
I20260709 13:07:28.980086 28077 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.093638 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.048681 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1044) took 1100 ms. Trace:
I20260709 13:07:29.054945 28174 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:29.102742 28077 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.106148 26611 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:29.056178 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.037920 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.057766 28096 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.061174 26610 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:29.065377 26686 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:28.889910 27819 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.075482 26754 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.084230 26678 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:29.084771 26757 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:29.085436 28147 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:29.087195 28089 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:29.092537 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69052.4us
I20260709 13:07:29.091450 28208 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.097265 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.148165 26611 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:29.149326 26603 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:29.040576 27316 rpcz_store.cc:276] 0709 13:07:27.902686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.907764 (+  5078us) service_pool.cc:224] Handling call
0709 13:07:27.908180 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.987456 (+ 79276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.987497 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.987998 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.641231 (+653233us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.642713 (+  1482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.658097 (+ 15384us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.978001 (+319904us) raft_consensus.cc:1685] finished
0709 13:07:28.979359 (+  1358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.982481 (+  3122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":620272,"threads_started":1,"wal-append.queue_time_us":623239}
I20260709 13:07:29.090708 27778 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.118536 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.157932 26756 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:29.094313 28152 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
W20260709 13:07:29.129309 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 73302.9us
I20260709 13:07:29.129463 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.135866 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:29.137269 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62911.9us
W20260709 13:07:29.138586 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59818us
I20260709 13:07:29.138821 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.160569 26759 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:29.140158 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.100231 28032 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.143574 26608 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:29.084236 27312 raft_consensus.cc:1217] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:29.104506 28105 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.162189 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.164526 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.166039 26759 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.173034 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.094064 28200 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:29.180859 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51484us
I20260709 13:07:29.177415 26754 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.179899 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:29.199919 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.154879 28210 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.154556 28208 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.198553 28018 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.160169 28049 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.139168 26753 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.133390 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:29.184047 28201 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:29.223340 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53779us
I20260709 13:07:29.227768 28202 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:29.227897 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 60071us
I20260709 13:07:29.166601 28152 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.232759 26759 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
W20260709 13:07:29.232949 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49214.3us
I20260709 13:07:29.205065 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 677) took 1084 ms. Trace:
I20260709 13:07:29.246547 28200 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.244697 26761 rpcz_store.cc:276] 0709 13:07:28.120763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.120889 (+   126us) service_pool.cc:224] Handling call
0709 13:07:28.129827 (+  8938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.130198 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.130225 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.141527 (+ 11302us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.658831 (+517304us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:28.658868 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.658934 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.042814 (+383880us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:29.178193 (+135379us) raft_consensus.cc:1685] finished
0709 13:07:29.178222 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.205001 (+ 26779us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":31020288,"thread_start_us":488817,"threads_started":1,"wal-append.queue_time_us":804854}
I20260709 13:07:29.248220 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:29.248543 28154 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.248657 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.250506 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:29.244793 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65008.4us
I20260709 13:07:29.177301 28197 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.223413 27949 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.258430 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.258803 26684 raft_consensus.cc:2368] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:29.252362 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.254967 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.246476 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.198915 28172 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.256690 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.257560 26761 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:29.223726 28018 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.260484 26759 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:29.261201 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.260905 28147 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.258533 27829 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.262473 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.257982 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.274778 26683 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.275187 26682 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.275343 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.268671 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.268388 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.238765 28174 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.272261 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.277055 26679 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.277074 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.247439 28210 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:29.259095 28105 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:29.259025 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:29.253738 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 152613us
I20260709 13:07:29.268491 28152 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.273093 28018 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.271054 28032 raft_consensus.cc:2764] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:29.286037 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.289341 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:29.277240 27902 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:29.294734 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:29.281306 28128 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:29.299163 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 115028us
I20260709 13:07:29.283175 27829 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:29.300920 26678 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:29.301236 28117 raft_consensus.cc:2764] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:07:29.301723 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.302258 28200 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.286791 28174 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:29.224304 28112 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.283373 28105 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.314072 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.299707 28152 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:29.311645 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.290616 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.303093 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.337510 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.345345 26760 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.311033 28154 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:29.336232 27949 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:29.345889 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.319885 28200 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.329106 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:29.330812 28105 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.326100 27819 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:29.357272 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62655us
I20260709 13:07:29.343845 28202 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:29.369593 28202 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.359964 26756 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.361069 27829 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.362171 27315 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:29.362886 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:29.363370 27807 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.348212 28036 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.364355 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.368132 28152 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.373297 27318 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:29.347823 28201 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:29.363726 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 60728.9us
I20260709 13:07:29.390190 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.316334 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:29.382871 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.394457 26684 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:29.354076 28149 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.357326 28200 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.391426 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.374251 28211 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:29.353631 26753 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:29.352586 28178 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:29.400120 26684 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:29.382447 28093 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.406376 26684 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:29.383287 28036 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.358254 28139 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:07:29.422749 26760 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:29.396221 28112 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.401633 28211 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.388002 27819 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:29.460248 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70161us
I20260709 13:07:29.416169 28093 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:29.465214 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 100977us
I20260709 13:07:29.424481 28036 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.424083 28154 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:29.100039 26755 rpcz_store.cc:276] 0709 13:07:27.948388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.951837 (+  3449us) service_pool.cc:224] Handling call
0709 13:07:27.994580 (+ 42743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.055866 (+ 61286us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:28.072245 (+ 16379us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.567487 (+495242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.679982 (+112495us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.687970 (+  7988us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:28.694192 (+  6222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.701632 (+  7440us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.048467 (+346835us) raft_consensus.cc:1685] finished
0709 13:07:29.048492 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.048622 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3655,"prepare.queue_time_us":11461,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":39,"raft.queue_time_us":36943,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8937,"thread_start_us":448310,"threads_started":1,"wal-append.queue_time_us":684133}
I20260709 13:07:29.466071 26684 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:29.474822 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87703.1us
I20260709 13:07:29.462746 28211 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.468924 28093 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.470741 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 94) took 1100 ms. Trace:
W20260709 13:07:29.484256 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.484421 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:29.490845 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99546.4us
I20260709 13:07:29.484810 26684 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.393627 28210 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:29.489966 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:29.471969 28117 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.490965 26761 rpcz_store.cc:276] 0709 13:07:28.370501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.276757 (+906256us) service_pool.cc:224] Handling call
0709 13:07:29.409684 (+132927us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:29.422496 (+ 12812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.467638 (+ 45142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.467929 (+   291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.468189 (+   260us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.468380 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.470509 (+  2129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.470650 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17948928}
W20260709 13:07:29.494485 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.497474 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.481601 28045 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.424363 28174 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.487208 28172 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:29.524902 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 221025us
I20260709 13:07:29.512585 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:29.548384 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74814us
I20260709 13:07:29.480518 27819 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.505527 28154 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:29.471951 28208 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:29.552760 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46982.1us
W20260709 13:07:29.556959 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44456us
I20260709 13:07:29.558624 28045 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.478345 27949 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.563246 27849 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.563944 28082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d473e821e4c15a9f3fa0471adfdc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:29.564283 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83796us
I20260709 13:07:29.563973 28027 tablet_copy_client.cc:538] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:07:29.553778 28225 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:07:29.480651 28201 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:29.574031 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 93878.3us
I20260709 13:07:29.597988 27286 leader_election.cc:400] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:29.598381 27286 leader_election.cc:403] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.580667 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.549455 28098 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:29.395380 28107 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:29.573249 27807 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.613129 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.568643 28149 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.597390 27849 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:29.623399 26687 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:29.599365 28045 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:29.617017 28238 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.636832 28238 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:29.586022 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.634313 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:29.633795 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59832us
I20260709 13:07:29.637743 28244 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:29.667479 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.637313 28246 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.666096 28197 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:29.664520 28202 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:29.694825 27321 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:29.698397 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:29.677806 28149 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:29.633627 28172 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:29.705204 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51270.7us
I20260709 13:07:29.705576 28208 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:29.706214 28245 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.706713 28202 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.707259 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:29.708258 28237 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:29.702111 28045 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.708544 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:29.708987 28202 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:29.716794 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 82578.8us
I20260709 13:07:29.722033 26684 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:07:29.722394 26684 pending_rounds.cc:85] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:07:29.722643 26684 pending_rounds.cc:107] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:29.722973 26684 raft_consensus.cc:2889] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.723748 26681 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:29.732604 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146894us
I20260709 13:07:29.740696 26681 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:29.719719 28098 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:29.721649 28197 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:29.744876 28233 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:29.747785 28264 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:29.750738 28235 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:29.721969 28245 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:29.731585 28244 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:29.746591 28234 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 13:07:29.735984 27819 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:29.766613 27320 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Advancing to term 3
I20260709 13:07:29.750645 28264 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:29.686807 27849 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.767449 27778 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.804761 27318 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:29.745368 28018 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.710088 28238 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.800508 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.801843 28139 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:29.828629 28257 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:29.829998 28245 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.834455 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:29.839284 27320 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:07:29.839763 27320 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 2
I20260709 13:07:29.840116 26758 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:29.841451 27320 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:07:29.841745 27320 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.843463 27318 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:29.809392 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 237356us
I20260709 13:07:29.802207 28200 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.849850 26753 raft_consensus.cc:2368] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:29.851090 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.851651 28200 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.858140 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.864261 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:29.872593 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 680) took 1364 ms. Trace:
I20260709 13:07:29.836002 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:29.873584 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.873971 27312 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:29.854212 28128 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.875018 28259 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.876616 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:29.872970 26759 rpcz_store.cc:276] 0709 13:07:28.508731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.278592 (+769861us) service_pool.cc:224] Handling call
0709 13:07:29.290784 (+ 12192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.291066 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.291104 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.291641 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.396469 (+104828us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:29.396520 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.396610 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.872362 (+475752us) raft_consensus.cc:1685] finished
0709 13:07:29.872389 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.872527 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936832,"thread_start_us":66835,"threads_started":1,"wal-append.queue_time_us":156267}
W20260709 13:07:29.884339 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49951.6us
I20260709 13:07:29.844729 28197 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.876925 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:29.807747 28149 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.836217 28139 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:29.875506 28259 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.860891 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:29.852244 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.866641 28027 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:29.857082 28018 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:29.860096 28096 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:30.108960 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.867558 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:30.117605 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:29.875501 28128 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:29.978171 28246 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:29.888844 28202 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.885779 27819 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:30.072497 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:30.072682 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 184067us
I20260709 13:07:29.907653 28266 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.909386 28192 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:29.866022 27319 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:30.080765 27285 leader_election.cc:400] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
W20260709 13:07:30.148980 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72804.3us
I20260709 13:07:30.084805 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:30.092463 28077 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.085183 28105 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.009s
W20260709 13:07:30.096169 28268 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.181s	user 0.000s	sys 0.008s
W20260709 13:07:30.111387 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 227898us
I20260709 13:07:30.183867 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:30.089660 28259 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:30.112030 28261 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.289s	user 0.000s	sys 0.013s
I20260709 13:07:30.113001 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:30.089581 28264 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.977108 28093 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.122217 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:30.073114 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:30.146239 28036 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.666s	user 0.015s	sys 0.001s
I20260709 13:07:30.167367 26603 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 5. Ops: []
W20260709 13:07:30.110255 28222 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.801s	user 0.010s	sys 0.006s
I20260709 13:07:30.172998 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:30.173034 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:30.227067 26608 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:30.184635 26610 raft_consensus.cc:2368] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4.
I20260709 13:07:30.184849 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:30.128528 28202 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.092834 28098 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20260709 13:07:30.211100 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:30.136564 27819 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.124910 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52795.2us
I20260709 13:07:30.183444 28077 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:30.237922 28202 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.269905 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:30.174649 28227 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:30.216229 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95281.7us
I20260709 13:07:30.183477 28105 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.254791 26610 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:30.173421 28266 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.231307 28036 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.288918 28263 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:07:30.289425 28036 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:30.256620 27819 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.289933 28270 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:07:30.291258 28248 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 13:07:30.292852 28211 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.003s
I20260709 13:07:30.293224 28211 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.294943 26760 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:30.278254 28139 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:30.274891 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:30.280799 28246 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.281415 27905 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.281708 28197 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:30.247133 28271 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:07:30.300191 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 226560us
I20260709 13:07:30.302057 26754 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:30.307235 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:30.320621 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.224009 28264 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.349968 26682 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.353468 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:30.354300 26611 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:30.328493 26755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.022s	sys 0.046s
I20260709 13:07:30.310039 28252 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.366146 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.348546 26753 raft_consensus.cc:2368] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3.
I20260709 13:07:30.355876 28248 consensus_queue.cc:1243] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:30.372962 26605 pending_rounds.cc:85] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 1
I20260709 13:07:30.383437 26605 pending_rounds.cc:107] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:30.375254 26724 leader_election.cc:400] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4.
I20260709 13:07:30.326828 28263 consensus_queue.cc:1243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:30.360759 28201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.010s	sys 0.023s
I20260709 13:07:30.383903 26724 leader_election.cc:403] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:07:30.365906 26755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.022s	sys 0.047s
I20260709 13:07:30.300727 28227 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.388098 26605 raft_consensus.cc:2889] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.485189 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:30.485317 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 119249us
I20260709 13:07:30.544364 26685 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.494146 26606 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.494855 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:30.545679 26609 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:30.497565 26612 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:07:30.387027 28112 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.005s
I20260709 13:07:30.348788 28139 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:30.535264 28089 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.503089 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:30.487841 28273 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:07:30.390585 28107 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.004s
I20260709 13:07:30.380488 28098 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.504048 26603 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:30.506273 28274 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:07:30.589382 27819 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.591243 28200 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:30.506704 26604 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:30.520442 28211 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:30.522141 26682 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:30.384727 27905 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:30.306623 28174 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:30.307931 28053 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:07:30.591528 27819 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.382443 28252 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.510954 28202 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.565236 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:30.567641 28285 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 13:07:30.529354 28201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.014s	sys 0.033s
W20260709 13:07:30.575706 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 200550us
I20260709 13:07:30.577996 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 705) took 1073 ms. Trace:
I20260709 13:07:30.583988 26607 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.583256 26685 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:30.592077 28077 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.488647 28248 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 13:07:30.597278 26756 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:30.611166 26756 pending_rounds.cc:85] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 1
I20260709 13:07:30.611486 26756 pending_rounds.cc:107] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:30.611796 26756 raft_consensus.cc:2889] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.599363 26760 rpcz_store.cc:276] 0709 13:07:29.495878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.497225 (+  1347us) service_pool.cc:224] Handling call
0709 13:07:30.568708 (+1071483us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:30.568909 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832093952}
W20260709 13:07:30.569664 28210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.056s	sys 0.081s
I20260709 13:07:30.565256 28263 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4.
I20260709 13:07:30.578778 28152 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:30.569478 28197 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:30.622008 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:30.600328 28172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.058s	sys 0.132s
I20260709 13:07:30.586205 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 703) took 1442 ms. Trace:
I20260709 13:07:30.585563 28128 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:30.598660 28200 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:30.614356 28210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.057s	sys 0.082s
I20260709 13:07:30.663965 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:30.642959 28172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.058s	sys 0.132s
I20260709 13:07:30.615005 28098 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:30.687578 26607 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:30.600689 28089 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.628317 28248 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:30.690779 26686 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:30.691931 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:30.713511 26683 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:30.713584 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 168978us
I20260709 13:07:30.628872 28211 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:30.662398 28105 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.722611 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.681512 28252 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.686415 28139 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:30.716370 28032 raft_consensus.cc:2764] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:07:30.690400 28077 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.746143 28200 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.757241 28248 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:30.757594 28264 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:30.715117 27949 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:30.758755 28227 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:30.759629 28282 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.328s	user 0.000s	sys 0.003s
I20260709 13:07:30.759964 28240 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 13:07:30.762141 28259 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.000s
W20260709 13:07:30.763175 26758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 695) took 1761 ms (client timeout 2052 ms). Trace:
W20260709 13:07:30.821570 26758 rpcz_store.cc:269] 0709 13:07:29.001754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.014060 (+ 12306us) service_pool.cc:224] Handling call
0709 13:07:30.762915 (+1748855us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b540011c6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:30.763093 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720371072}
I20260709 13:07:30.765618 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:30.823164 26679 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.767163 27313 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.721534 28053 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.828238 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 250) took 1024 ms. Trace:
I20260709 13:07:30.828140 28053 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.828706 27313 rpcz_store.cc:276] 0709 13:07:29.803788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.827793 (+ 24005us) service_pool.cc:224] Handling call
0709 13:07:30.766593 (+938800us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:30.766816 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.827952 (+ 61136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.828177 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11622144}
I20260709 13:07:30.830735 28053 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.657666 28197 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:30.771590 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49066.4us
W20260709 13:07:30.771929 28250 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.087s	user 0.003s	sys 0.000s
I20260709 13:07:30.831919 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.832902 28197 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.833104 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.834327 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:30.719515 28018 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.712743 28286 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:30.835807 28018 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.835896 28286 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:30.779218 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64668.9us
I20260709 13:07:30.777488 28248 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.837903 28018 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.838054 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.838821 28105 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.839293 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.841209 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:30.842212 26650 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3.
I20260709 13:07:30.842530 26650 leader_election.cc:403] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:30.660924 26755 rpcz_store.cc:276] 0709 13:07:29.135556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.491110 (+355554us) service_pool.cc:224] Handling call
0709 13:07:29.552512 (+ 61402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.568700 (+ 16188us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:29.685705 (+117005us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.541320 (+855615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.545731 (+  4411us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:30.564229 (+ 18498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.564343 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.577980 (+ 13637us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126249,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":52777,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":885018,"threads_started":2}
I20260709 13:07:30.843333 28098 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.839847 28248 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:30.843613 28227 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.842212 28053 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.844621 28053 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.839530 28105 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.840297 28286 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.840794 28197 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:30.846351 28197 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:30.754367 28139 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:30.846534 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.851651 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:30.850477 26679 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:30.842613 28018 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.849123 28197 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:30.812099 27949 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:30.850819 28279 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:07:30.846642 28053 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.849066 28286 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3.
I20260709 13:07:30.850124 28105 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:30.912457 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70433us
I20260709 13:07:30.780463 28077 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.853132 28229 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.853278 27819 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.848912 28139 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:30.933900 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.019s	sys 0.037s
W20260709 13:07:30.938210 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.020s	sys 0.037s
W20260709 13:07:30.938710 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.942322 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 83908us
I20260709 13:07:30.943120 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:30.948994 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:30.860752 28178 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.903735 28098 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.950779 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:30.948616 28229 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.952836 28288 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:30.958977 28089 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:30.952711 28267 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:30.962093 28053 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:30.931697 28248 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.962925 28082 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.850s	user 0.007s	sys 0.004s
I20260709 13:07:30.849606 28259 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.661581 26678 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:30.985456 28202 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:30.952888 28240 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:07:30.956054 28283 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:07:30.944541 28293 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:30.953395 28112 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:30.998553 28288 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:30.956601 28284 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:07:30.973482 28178 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.955603 28018 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:30.952708 27819 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:30.992262 28277 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:31.012739 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74395.8us
I20260709 13:07:31.059034 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:31.013690 28247 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.326s	user 0.004s	sys 0.000s
W20260709 13:07:30.992250 28281 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:07:30.955741 28211 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:07:31.028172 28286 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:31.057088 28248 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:30.984305 28098 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.071801 28082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39266 (request call id 225) took 5784 ms. Trace:
I20260709 13:07:31.026362 28267 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:31.081228 28229 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.082216 28211 consensus_queue.cc:1243] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:31.082697 28211 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.083092 28211 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.050014 28053 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:31.073060 27949 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:31.078083 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 114774us
I20260709 13:07:31.050411 28293 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.088354 27819 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:31.059715 28018 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.093624 28259 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.085234 28211 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.089597 28178 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:31.088356 28098 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.083616 28267 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.100612 28252 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:31.141366 28240 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.157502 28128 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.105846 27849 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:31.144737 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 293166us
I20260709 13:07:31.146179 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:31.149443 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 710) took 1898 ms (client timeout 2240 ms). Trace:
I20260709 13:07:31.149922 26754 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:31.150427 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47266.1us
I20260709 13:07:31.163154 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.151117 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.143472 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:31.085111 28139 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.185158 28139 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
W20260709 13:07:31.154604 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.188701 28293 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.163972 26758 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:31.109323 28286 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.102931 28287 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:31.143556 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:31.111325 28300 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:31.181941 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:31.182775 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:31.157513 28240 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:31.203886 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2024) took 1612 ms. Trace:
I20260709 13:07:31.204413 26681 rpcz_store.cc:276] 0709 13:07:29.591872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.744642 (+152770us) service_pool.cc:224] Handling call
0709 13:07:29.765284 (+ 20642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.765536 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:29.797542 (+ 32006us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.197992 (+1400450us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b180043daa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:07:31.203449 (+  5457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.203517 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:31.203572 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.203655 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.203821 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5183,"prepare.queue_time_us":33691,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":2743040,"thread_start_us":3959,"threads_started":1,"wal-append.queue_time_us":46853}
I20260709 13:07:31.184954 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:31.162853 26680 rpcz_store.cc:269] 0709 13:07:29.250929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.253274 (+  2345us) service_pool.cc:224] Handling call
0709 13:07:31.149192 (+1895918us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400187754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:31.149371 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220906752}
W20260709 13:07:31.192996 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 60735.7us
I20260709 13:07:31.084373 28053 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:31.211761 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48027.2us
I20260709 13:07:31.212756 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:31.159297 28128 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:31.194317 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.164446 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.164423 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:31.220639 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56288.7us
I20260709 13:07:31.201404 26679 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.221336 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:31.183109 28018 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.222123 26680 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.194164 28077 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:31.199816 28295 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:07:31.080469 28082 rpcz_store.cc:276] 0709 13:07:25.287441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.287591 (+   150us) service_pool.cc:224] Handling call
0709 13:07:25.510118 (+222527us) ts_tablet_manager.cc:934] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
0709 13:07:29.403695 (+3893577us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:30.112825 (+709130us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:30.112959 (+   134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:31.070803 (+957844us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:31.071158 (+   355us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:31.071546 (+   388us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:31.071682 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":17092,"tablet-copy.queue_time_us":105494,"thread_start_us":678074,"threads_started":2}
I20260709 13:07:31.232270 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.233064 26681 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:31.236182 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 691) took 2295 ms. Trace:
I20260709 13:07:31.236915 28077 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:31.237076 28128 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:31.237351 28112 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:31.237737 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.238085 28112 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.240624 26679 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:31.237408 28077 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.236590 26756 rpcz_store.cc:276] 0709 13:07:28.940948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.378936 (+437988us) service_pool.cc:224] Handling call
0709 13:07:29.379357 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.612561 (+1233204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.235956 (+623395us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540011cbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:31.236126 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2799906048}
I20260709 13:07:31.240767 28293 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.253742 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.255735 26679 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:31.256000 26756 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:31.241631 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.198025 28286 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.254663 28077 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.258963 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.229357 28229 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.261121 28082 tablet_copy_client.cc:806] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:31.237636 28128 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.271184 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:31.274122 26680 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 13:07:31.275045 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:31.278443 28112 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.285755 26756 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:31.279448 28275 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.976s	user 0.009s	sys 0.004s
I20260709 13:07:31.281363 28082 tablet_copy_client.cc:670] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:31.291280 28320 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.280539 28287 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.296392 26575 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:31.293413 28320 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.296811 28229 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:31.297863 28316 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.298132 28229 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.298559 28316 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.302372 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 730) took 1009 ms. Trace:
I20260709 13:07:31.303128 28316 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.302816 26687 rpcz_store.cc:276] 0709 13:07:30.292778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.295465 (+  2687us) service_pool.cc:224] Handling call
0709 13:07:30.313508 (+ 18043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.313774 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.313813 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.314406 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.856874 (+542468us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:30.856911 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.856980 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.302101 (+445121us) raft_consensus.cc:1685] finished
0709 13:07:31.302129 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.302312 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":485611,"threads_started":1,"wal-append.queue_time_us":674427}
I20260709 13:07:31.259924 28293 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:31.310508 28309 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:31.312974 28300 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.313529 28300 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.288275 28288 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:31.306237 28089 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.312995 28310 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:31.328684 28320 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.262841 28240 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:31.372514 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 226863us
I20260709 13:07:31.318912 28286 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.429833 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:31.430703 26680 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.296480 28287 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.454031 28323 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.456274 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2025) took 1857 ms. Trace:
I20260709 13:07:31.456782 26684 rpcz_store.cc:276] 0709 13:07:29.598928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.756328 (+157400us) service_pool.cc:224] Handling call
0709 13:07:29.756742 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.756974 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.756998 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.764801 (+  7803us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.078511 (+313710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.078546 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.078616 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.261841 (+1183225us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:31.430057 (+168216us) raft_consensus.cc:1685] finished
0709 13:07:31.430079 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.456200 (+ 26121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10413824,"thread_start_us":270787,"threads_started":1,"wal-append.queue_time_us":416080}
I20260709 13:07:31.456050 28323 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.514945 26680 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:31.325147 28089 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:31.541719 26577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.240s (SENT) [suppressed 18 similar messages]
I20260709 13:07:31.411374 28315 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.558363 26680 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:31.593984 28323 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:31.556823 28197 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.007s
I20260709 13:07:31.602712 28197 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.604223 26687 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:31.606443 28197 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:31.563822 28032 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.609181 26680 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:31.610245 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2025) took 1238 ms. Trace:
I20260709 13:07:31.596391 28211 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.595878 28264 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:31.719607 26611 rpcz_store.cc:276] 0709 13:07:30.371388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.387321 (+ 15933us) service_pool.cc:224] Handling call
0709 13:07:30.387616 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.855911 (+468295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.855946 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.859046 (+  3100us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.099683 (+240637us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:31.099753 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.099851 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.609949 (+510098us) raft_consensus.cc:1685] finished
0709 13:07:31.609978 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.610156 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198790,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11805,"thread_start_us":618395,"threads_started":2,"wal-append.queue_time_us":237460}
I20260709 13:07:31.591432 28266 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.630489 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 238) took 2513 ms. Trace:
I20260709 13:07:31.559191 28077 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.601809 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1060) took 1480 ms. Trace:
I20260709 13:07:31.724252 27321 rpcz_store.cc:276] 0709 13:07:29.098322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.101787 (+  3465us) service_pool.cc:224] Handling call
0709 13:07:29.102107 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.699319 (+597212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.611304 (+1911985us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54004268d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:31.611519 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137858816}
I20260709 13:07:31.738258 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:31.739343 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.044s	sys 0.057s
W20260709 13:07:31.742350 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.044s	sys 0.057s
I20260709 13:07:31.597985 28315 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.749832 28316 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.750517 28316 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.753181 28316 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.755270 28316 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:31.755899 28316 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.758446 28316 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.760488 28139 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.761088 28139 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.763590 28139 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.764690 28139 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.765690 28139 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.769809 28139 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.772605 28316 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.776741 28266 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:31.779515 28112 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.780941 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:31.819749 26653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.012s	sys 0.021s
W20260709 13:07:31.820238 26653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.012s	sys 0.021s
I20260709 13:07:31.821611 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.822413 26680 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:31.722779 28211 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:31.829964 27849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.021s
I20260709 13:07:31.780159 28112 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.847419 28293 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:31.851251 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.014s	sys 0.018s
I20260709 13:07:31.852164 26680 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.776770 28315 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:31.773669 28316 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.806468 28266 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:31.867408 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.782336 28300 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:31.870368 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.012s	sys 0.041s
W20260709 13:07:31.912340 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.012s	sys 0.041s
W20260709 13:07:31.912796 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 810431us
I20260709 13:07:31.870474 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:31.737382 28032 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:31.899133 27807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.010s	sys 0.049s
I20260709 13:07:31.819259 28286 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:31.839864 28174 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:31.864436 28154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.013s	sys 0.034s
I20260709 13:07:31.888656 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.894287 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:31.963873 26682 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:31.963954 26680 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:31.895301 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.014s	sys 0.018s
W20260709 13:07:31.879876 26604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.008s	sys 0.021s
W20260709 13:07:31.909346 26679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.030s
W20260709 13:07:31.975611 26679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.031s
W20260709 13:07:31.893553 27849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.012s	sys 0.021s
W20260709 13:07:31.784008 28277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.009s	sys 0.023s
W20260709 13:07:31.902550 28128 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
I20260709 13:07:31.922019 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:31.979301 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57541.7us
W20260709 13:07:31.951133 27807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.010s	sys 0.053s
W20260709 13:07:31.893746 28149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.006s	sys 0.030s
W20260709 13:07:31.951548 26755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.029s	sys 0.060s
I20260709 13:07:31.964797 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:31.968926 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2022) took 1669 ms. Trace:
W20260709 13:07:31.956462 26681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.024s
W20260709 13:07:32.015744 26681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.024s
I20260709 13:07:32.015555 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:32.020569 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:32.021533 26682 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.032967 26680 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:32.011430 28128 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:32.034067 28329 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:32.037134 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 91) took 1021 ms. Trace:
I20260709 13:07:32.044054 28327 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:31.951840 28211 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:31.946820 28325 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:32.002627 28277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.009s	sys 0.024s
I20260709 13:07:32.045387 28277 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:32.045708 28338 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:07:32.014811 28149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.007s	sys 0.030s
W20260709 13:07:32.046180 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 833435us
I20260709 13:07:32.047199 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.015612 26608 rpcz_store.cc:276] 0709 13:07:30.299281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.299403 (+   122us) service_pool.cc:224] Handling call
0709 13:07:30.299710 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.586710 (+287000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.586752 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.586796 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:30.586827 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.968621 (+1381794us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54001f6154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:31.968706 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.968860 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658350848}
I20260709 13:07:31.908870 28266 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:32.043545 26681 rpcz_store.cc:276] 0709 13:07:31.015845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.282400 (+266555us) service_pool.cc:224] Handling call
0709 13:07:31.295757 (+ 13357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.295955 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:31.325415 (+ 29460us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.036679 (+711264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.036752 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.036812 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.036902 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.037059 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20393,"prepare.queue_time_us":20002,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":20638,"thread_start_us":690393,"threads_started":1}
I20260709 13:07:31.979038 28315 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.970703 28154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.013s	sys 0.034s
I20260709 13:07:31.959612 28174 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:32.020134 26604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.009s	sys 0.022s
W20260709 13:07:32.023605 26755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.029s	sys 0.061s
I20260709 13:07:32.045414 28211 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.969581 28286 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.063639 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.068087 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.068795 26680 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:32.069737 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.072049 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.102497 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55415.2us
I20260709 13:07:32.054767 28287 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.056576 28266 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.046310 28277 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.104833 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.075867 28229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.013s	sys 0.031s
W20260709 13:07:32.066555 28027 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.020s	sys 0.059s
I20260709 13:07:32.117439 26684 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:32.116264 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.117596 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.134047 26680 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.122661 26682 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:32.135530 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.136410 26682 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:32.066200 28089 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.055823 28315 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.058199 28325 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:32.133010 28229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.014s	sys 0.032s
I20260709 13:07:32.107905 28149 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.133324 28027 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.020s	sys 0.059s
I20260709 13:07:32.114861 28197 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.118193 28330 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.152371 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.156028 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.139424 28077 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.160499 26680 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:32.161309 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45170.3us
I20260709 13:07:32.163153 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.154405 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 111) took 1038 ms. Trace:
I20260709 13:07:32.160257 28333 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:32.163131 28172 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.160933 28330 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:32.191421 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:31.783593 26757 rpcz_store.cc:276] 0709 13:07:30.121548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.495882 (+374334us) service_pool.cc:224] Handling call
0709 13:07:30.578049 (+ 82167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.586925 (+  8876us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:30.974416 (+387491us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.503613 (+529197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.554297 (+ 50684us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:31.561305 (+  7008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.589864 (+ 28559us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.599796 (+  9932us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":454218,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":107599,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6515,"thread_start_us":733525,"threads_started":3,"wal-append.queue_time_us":142464}
W20260709 13:07:32.149654 27316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.028s	sys 0.067s
I20260709 13:07:32.188819 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.162101 26682 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:32.189523 26577 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.014s	sys 0.024s
I20260709 13:07:32.149811 28334 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:32.193347 26577 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.014s	sys 0.024s
I20260709 13:07:32.193547 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.150437 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 220547us
I20260709 13:07:32.190492 28197 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:32.203359 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.194959 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 652982us
W20260709 13:07:32.198439 28322 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:07:32.194941 27316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.030s	sys 0.068s
I20260709 13:07:32.190800 28149 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.188270 26755 rpcz_store.cc:276] 0709 13:07:31.116026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.128176 (+ 12150us) service_pool.cc:224] Handling call
0709 13:07:31.198597 (+ 70421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.257462 (+ 58865us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:31.290312 (+ 32850us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.116598 (+826286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.121124 (+  4526us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.135255 (+ 14131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.141490 (+  6235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.151511 (+ 10021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68389,"prepare.queue_time_us":21525,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":115235,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":12792,"thread_start_us":733600,"threads_started":1,"wal-append.queue_time_us":891650}
I20260709 13:07:32.200709 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.199869 26682 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.242067 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:32.218914 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2027) took 1278 ms. Trace:
I20260709 13:07:32.160028 28174 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:32.193857 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 100) took 2576 ms (client timeout 2077 ms). Trace:
I20260709 13:07:32.242753 26682 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.194252 28333 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.289817 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.219261 28328 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.302726 26608 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.291388 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:32.219830 28343 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:07:32.292737 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.281293 26679 rpcz_store.cc:276] 0709 13:07:30.941092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.256481 (+315389us) service_pool.cc:224] Handling call
0709 13:07:31.256788 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.257450 (+   662us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:31.976126 (+718676us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.218501 (+242375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.218550 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:32.218593 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.218659 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.218859 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37578,"prepare.queue_time_us":24258,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":20628,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":17685,"thread_start_us":919519,"threads_started":2}
I20260709 13:07:32.224088 28229 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.302403 26682 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:32.301044 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.290158 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.301887 26611 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.326120 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.315297 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.244266 28032 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.303050 26610 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 4. Ops: []
I20260709 13:07:32.305214 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:32.323496 26680 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.330858 26603 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.324136 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.292903 28271 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.292740 28334 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.325225 28154 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:32.333120 28341 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:32.346180 26603 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:32.295923 28213 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.294492 28246 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.300364 28287 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:32.360901 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.307960 28174 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:32.295025 26753 rpcz_store.cc:269] 0709 13:07:29.616656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.108612 (+491956us) service_pool.cc:224] Handling call
0709 13:07:32.186440 (+2077828us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002dc3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:32.191395 (+  4955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415727872}
I20260709 13:07:32.341055 26610 pending_rounds.cc:85] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 1
I20260709 13:07:32.362661 26610 pending_rounds.cc:107] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:32.363081 26610 raft_consensus.cc:2889] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.340600 28154 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.341382 28271 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.343489 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.352557 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.366628 26609 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:07:32.332139 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.333120 28342 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:32.331997 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.334582 28328 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:32.345176 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.373598 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:32.374446 26680 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.376022 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.376922 26609 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
W20260709 13:07:32.378846 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.355456 28213 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:32.289340 28330 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.358193 28286 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.331732 28229 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.390277 26682 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:32.379978 28336 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:07:32.343394 28266 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.370553 28315 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.400373 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.344121 28334 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.402360 26609 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:32.336330 28197 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.406663 26683 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:32.408403 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.368062 28287 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:32.385489 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 268458us
I20260709 13:07:32.405247 28330 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.429553 26680 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:32.430727 26680 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.431051 26680 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:32.433176 26683 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:32.436163 26680 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.412302 28337 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:32.458580 28337 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.447100 28286 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.445207 28149 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.469767 28286 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.472457 28334 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.473672 28286 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.471340 28229 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:32.463467 28350 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:32.474032 28154 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.474836 28149 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.451253 28328 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.475437 28149 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.475873 28337 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.496932 26686 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:32.508155 26686 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:32.512873 26686 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.468266 28152 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:32.413818 28213 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.522982 28154 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:32.523926 28154 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:32.528378 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2029) took 2155 ms. Trace:
I20260709 13:07:32.528890 26604 rpcz_store.cc:276] 0709 13:07:30.372624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.389849 (+ 17225us) service_pool.cc:224] Handling call
0709 13:07:30.506185 (+116336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.506558 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:31.155676 (+649118us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.061005 (+905329us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.142312 (+ 81307us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.155559 (+ 13247us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:32.159126 (+  3567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.163788 (+  4662us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.516240 (+352452us) raft_consensus.cc:1685] finished
0709 13:07:32.520666 (+  4426us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.528279 (+  7613us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86499,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5353,"thread_start_us":896724,"threads_started":1,"wal-append.queue_time_us":945766}
I20260709 13:07:32.497255 28266 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.518141 26686 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:32.536836 28349 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.164s	user 0.001s	sys 0.003s
I20260709 13:07:32.542008 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.544091 26686 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:32.545121 28027 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:07:32.533154 26650 connection.cc:256] RPC call timeout handler was delayed by -4.1926332599998659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:07:32.532936 28154 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.534709 28271 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.550398 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.551115 26609 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:32.540989 28213 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.553021 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.549165 26686 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.531972 28152 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.559652 28152 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.560767 28093 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.569468 28149 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.572021 28287 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.557063 26761 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.575512 26761 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:32.583441 26686 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.552202 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 228) took 1228 ms. Trace:
I20260709 13:07:32.576359 26761 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.585772 28248 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:32.588411 27286 connection.cc:256] RPC call timeout handler was delayed by -1.1581230629999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:07:32.603247 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.590618 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.592522 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2031) took 1213 ms. Trace:
I20260709 13:07:32.593438 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:32.594767 28333 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.611800 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.612284 26605 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.612499 27317 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:32.613794 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.614176 28211 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.614861 27319 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:32.614782 28211 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.615809 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:32.617218 28211 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.619084 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:32.619720 26759 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:32.620970 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.621372 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.621981 26753 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:32.622926 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.594864 26609 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:32.598287 28107 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.624037 28107 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.605696 26687 rpcz_store.cc:276] 0709 13:07:31.379379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.405812 (+ 26433us) service_pool.cc:224] Handling call
0709 13:07:31.455702 (+ 49890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.604676 (+148974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.592289 (+987613us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003c1754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:32.592461 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341012224}
I20260709 13:07:32.599903 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.613715 28152 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.598729 27321 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.625104 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:32.626590 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.628196 27320 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:32.628648 26759 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:32.634605 28107 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.657747 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.634791 28356 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:32.635342 28345 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:07:32.623482 26753 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.662981 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.638717 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.557794 28154 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:32.641417 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:32.660320 26576 connection.cc:256] RPC call timeout handler was delayed by -1.7688261449999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:07:32.678943 26576 connection.cc:256] RPC call timeout handler was delayed by -1.2527134539999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:07:32.679273 26576 connection.cc:256] RPC call timeout handler was delayed by -1.1818420349999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 13:07:32.679385 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:32.679584 26576 connection.cc:256] RPC call timeout handler was delayed by -1.1229747529999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:07:32.661799 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.680874 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.681108 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.681746 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.681951 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.682691 26609 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:32.663508 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:32.673432 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.686328 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.640972 28227 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.674192 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.644975 28152 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:32.674602 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:32.674801 28229 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.675418 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.674855 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.676352 28107 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:32.677332 26756 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:32.731930 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.732932 26759 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:32.732762 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:32.733404 26756 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.733806 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.734391 26759 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:32.735141 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.677395 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:32.735870 26607 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:32.737730 28298 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.775s	user 0.003s	sys 0.010s
I20260709 13:07:32.739753 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:32.739966 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.730350 27319 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:32.740646 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.677983 28361 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.740939 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:32.741238 28361 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:32.741678 28361 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.741982 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:32.742846 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.743528 26611 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:32.629031 28246 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:32.696885 26603 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.659060 28337 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.730592 28093 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:32.731535 28107 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.755721 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.756425 26607 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.757272 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.758286 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.758903 26607 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:32.744894 26609 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:32.753082 28370 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.743762 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.761108 26608 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.641126 28201 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:32.743055 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.752014 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:32.753237 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.688248 28266 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:32.755865 28107 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:32.760403 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.760443 26756 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:32.745220 26759 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.759573 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.764783 26603 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.766510 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:32.766940 26611 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:32.713763 26686 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:07:32.777587 26686 pending_rounds.cc:85] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:07:32.778010 26686 pending_rounds.cc:107] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:32.777801 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.778584 26686 raft_consensus.cc:2889] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.778872 26606 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:32.781963 26603 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 13:07:32.769182 26609 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:32.769562 26608 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:32.784405 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:32.768266 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.760908 28337 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.696600 28227 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.744012 28229 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.772156 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:32.713157 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.689373 28027 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.786367 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.785629 27317 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.790359 26605 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:32.790601 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.791570 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.792944 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.798820 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.770483 28277 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.686036 28334 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:07:32.794884 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.797178 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.798633 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.803347 26608 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:32.803550 26759 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:32.799448 26606 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:32.792985 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:32.804997 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 117085us
I20260709 13:07:32.808308 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:32.793691 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 78676.8us
I20260709 13:07:32.698391 28152 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.809981 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:32.823374 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:32.862082 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69154.5us
I20260709 13:07:32.792052 28333 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:32.863135 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:32.865540 26603 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:07:32.867199 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57330.5us
I20260709 13:07:32.814747 28370 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:32.802428 28317 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:32.818109 28369 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:32.887023 27321 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.815302 28082 tablet_copy_client.cc:538] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:32.792477 28197 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:07:32.905678 28197 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.906064 28197 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:32.906920 28197 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.899168 26608 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:32.936540 28344 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.570s	user 0.000s	sys 0.001s
I20260709 13:07:32.936793 28197 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.900794 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:32.938175 27778 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.938525 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:32.938959 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.939462 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 253) took 1751 ms. Trace:
I20260709 13:07:32.886611 28271 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.940323 28246 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:32.940618 28271 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.940444 28172 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:32.941077 28271 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.941277 28172 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:32.942195 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.886817 28174 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.943406 28096 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.943651 28174 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.939586 26756 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.945796 28174 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.902927 28370 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.945988 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.820927 28089 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.946677 26756 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:32.800874 28201 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.948706 28201 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.904189 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 734) took 2610 ms. Trace:
I20260709 13:07:32.819761 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:32.949779 26761 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.950277 28152 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.950726 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.951967 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:32.952682 28354 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:07:32.899020 26753 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:32.907760 28027 tablet_bootstrap.cc:492] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:32.820534 28227 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.802740 28287 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:07:32.822333 28277 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:32.956682 28277 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.908100 28211 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:32.961164 28210 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:32.939925 27316 rpcz_store.cc:276] 0709 13:07:31.188518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.197019 (+  8501us) service_pool.cc:224] Handling call
0709 13:07:31.197462 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.199718 (+  2256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.199750 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.212834 (+ 13084us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.242933 (+1030099us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:32.288562 (+ 45629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.294893 (+  6331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.935982 (+641089us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:32.939180 (+  3198us) raft_consensus.cc:1685] finished
0709 13:07:32.939200 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.939405 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":45664512,"thread_start_us":1008888,"threads_started":1,"wal-append.queue_time_us":1113083}
I20260709 13:07:32.965637 28325 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:32.965929 27314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.682s	user 0.014s	sys 0.032s
W20260709 13:07:32.966328 27314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.682s	user 0.014s	sys 0.032s
I20260709 13:07:32.887580 28317 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:32.968062 28317 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.949321 26685 rpcz_store.cc:276] 0709 13:07:30.293973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.238646 (+944673us) service_pool.cc:224] Handling call
0709 13:07:31.238941 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.239131 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.239155 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.598815 (+1359660us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:07:32.599292 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.724274 (+124982us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.724318 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.724389 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.903867 (+179478us) raft_consensus.cc:1685] finished
0709 13:07:32.903891 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.904124 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7737216,"thread_start_us":124543,"threads_started":1,"wal-append.queue_time_us":100222}
I20260709 13:07:32.971190 28112 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:32.601604 27313 rpcz_store.cc:276] 0709 13:07:31.321248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.323221 (+  1973us) service_pool.cc:224] Handling call
0709 13:07:31.471539 (+148318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.564529 (+ 92990us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:32.220854 (+656325us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.532502 (+311648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.535588 (+  3086us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.536642 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.544542 (+  7900us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.549621 (+  5079us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":763994,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":20450,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":27537664,"thread_start_us":694089,"threads_started":2,"wal-append.queue_time_us":283252}
W20260709 13:07:32.903414 28331 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.603s	user 0.001s	sys 0.002s
I20260709 13:07:32.910972 26752 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.973963 26752 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:32.974889 26752 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.976202 26752 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.896982 28333 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:32.912878 28357 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
W20260709 13:07:32.914204 28360 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.391s	user 0.002s	sys 0.000s
I20260709 13:07:32.918501 28361 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.983268 26610 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:33.016610 26605 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:32.770538 28107 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:32.925004 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.032299 26755 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:33.033373 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.927516 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:32.887418 27902 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:33.034300 27902 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.034713 27902 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.036032 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.930053 28077 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:32.931154 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:33.037957 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.038683 27321 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:32.931962 28154 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:33.039551 28154 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.040611 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.041320 26755 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
W20260709 13:07:33.041549 26510 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 211) took 11375 ms (client timeout 15000 ms). Trace:
I20260709 13:07:33.041909 28154 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.899014 28356 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:32.900257 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:33.043152 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 142944us
I20260709 13:07:33.044126 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:32.932724 27849 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:33.045010 27849 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.045316 28271 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.045871 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.045975 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.046523 26755 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.046820 26760 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:33.047322 27849 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.933467 28264 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:33.047876 28264 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.051594 28210 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:32.933519 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:33.052282 28210 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.052656 26603 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:32.935837 28339 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.581s	user 0.000s	sys 0.002s
I20260709 13:07:32.817341 28337 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:32.939556 26758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1069) took 1756 ms (client timeout 1764 ms). Trace:
I20260709 13:07:32.909691 28229 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:32.961223 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 114) took 1112 ms. Trace:
I20260709 13:07:33.054731 28329 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.054543 26754 rpcz_store.cc:276] 0709 13:07:31.848848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.964048 (+115200us) service_pool.cc:224] Handling call
0709 13:07:32.013875 (+ 49827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.157257 (+143382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.157290 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.157328 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.157354 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.960996 (+803642us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400226854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:32.961059 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.961173 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329346304}
I20260709 13:07:33.056530 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.983702 28361 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:32.984334 27320 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.989524 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2040) took 1041 ms. Trace:
I20260709 13:07:33.058459 28286 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:33.058879 28286 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:33.058221 26681 rpcz_store.cc:276] 0709 13:07:31.948508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.102465 (+153957us) service_pool.cc:224] Handling call
0709 13:07:32.989308 (+886843us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54001289d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:32.989458 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454185216}
I20260709 13:07:33.059541 28271 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.038057 28077 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:33.055316 28329 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.061781 28329 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.062036 28361 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.062615 28361 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.064400 28265 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.064791 28265 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.064853 28361 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.065240 28265 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.066269 28327 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.066768 28327 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.068063 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.068142 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.068898 28327 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.069339 28117 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.069708 28117 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.069872 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.995141 28027 ts_tablet_manager.cc:1403] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 3.129s	user 0.049s	sys 0.084s
I20260709 13:07:32.995587 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.995908 28172 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:32.996601 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:32.996878 28316 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:32.997573 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 200475us
I20260709 13:07:33.087000 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:33.087936 26610 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.088627 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:32.999699 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:32.947504 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.996595 28333 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:33.006071 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.006451 26761 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:32.910403 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:32.919986 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:33.019137 28317 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:32.922173 28082 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:07:33.020650 26752 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:33.024859 26611 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:33.029616 28240 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.927382 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2026) took 3272 ms. Trace:
W20260709 13:07:33.054194 26758 rpcz_store.cc:269] 0709 13:07:31.183513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.192389 (+  8876us) service_pool.cc:224] Handling call
0709 13:07:32.939390 (+1747001us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:32.939503 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3349359360}
I20260709 13:07:33.070066 28117 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.072391 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:32.994073 28152 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:33.075690 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 190388us
I20260709 13:07:33.105568 26754 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:33.075803 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.079844 28263 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.080538 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.081745 26507 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:33.084528 28332 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.753s	user 0.003s	sys 0.001s
I20260709 13:07:33.074959 28286 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.115242 28172 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:33.042155 26510 rpcz_store.cc:269] 0709 13:07:21.666036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.666171 (+   135us) service_pool.cc:224] Handling call
0709 13:07:22.282142 (+615971us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:33.041305 (+10759163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:28.708478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:28.913025 (+204547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:28.913087 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:07:28.913116 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:28.913908 (+   792us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:28.913985 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:28.914012 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:28.914675 (+   663us) tablet.cc:701] Row locks acquired
0709 13:07:28.914725 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:07:28.914889 (+   164us) write_op.cc:270] Start()
0709 13:07:28.915037 (+   148us) write_op.cc:276] Timestamp: P: 1783602448914832 usec, L: 0
0709 13:07:28.915073 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:07:28.962449 (+ 47376us) log.cc:844] Serialized 2108 byte log entry
0709 13:07:29.319399 (+356950us) op_driver.cc:464] REPLICATION: finished
0709 13:07:29.469547 (+150148us) write_op.cc:301] APPLY: starting
0709 13:07:29.478661 (+  9114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:29.484056 (+  5395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:29.487169 (+  3113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:29.695749 (+208580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:29.747808 (+ 52059us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:07:29.747866 (+    58us) write_op.cc:312] APPLY: finished
0709 13:07:29.748182 (+   316us) log.cc:844] Serialized 46 byte log entry
0709 13:07:29.748383 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.748485 (+   102us) write_op.cc:454] Released schema lock
0709 13:07:29.748544 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:29.748928 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.748957 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":317205,"reported_tablets":9,"spinlock_wait_cycles":176493952,"child_traces":[["op",{"apply.queue_time_us":105108,"apply.run_cpu_time_us":4255,"apply.run_wall_time_us":288772,"num_ops":5,"prepare.queue_time_us":717879,"prepare.run_cpu_time_us":23221,"prepare.run_wall_time_us":413909,"raft.queue_time_us":201515,"raft.run_cpu_time_us":4218,"raft.run_wall_time_us":93850,"replication_time_us":383694,"spinlock_wait_cycles":31488,"thread_start_us":749375,"threads_started":4,"wal-append.queue_time_us":103642,"wal-append.run_cpu_time_us":29760,"wal-append.run_wall_time_us":1678376}]]}
I20260709 13:07:33.115598 26753 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:33.115820 28286 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.116938 26753 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.117409 28107 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.118341 26753 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.113090 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.119432 28027 raft_consensus.cc:359] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:33.120273 28027 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:07:33.120936 28027 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:33.123391 28027 ts_tablet_manager.cc:1434] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:07:33.121780 27902 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.126243 28210 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.127337 26758 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.129515 28333 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.129909 28333 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:33.092873 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 166918us
I20260709 13:07:33.093189 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.093947 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 102) took 3474 ms. Trace:
W20260709 13:07:33.097975 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.086777 28077 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.092348 28053 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:33.103350 28036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:33.094012 27849 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:33.098409 28045 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:33.098847 28325 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:33.090636 28277 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:07:33.089859 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90228us
I20260709 13:07:33.136066 26761 rpcz_store.cc:276] 0709 13:07:29.617256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.236920 (+619664us) service_pool.cc:224] Handling call
0709 13:07:32.556819 (+2319899us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:32.556972 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.949572 (+392600us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b58005105d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4
0709 13:07:33.091281 (+141709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.091493 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809738368}
I20260709 13:07:33.163365 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.163573 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.164216 26686 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:33.137157 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.164150 26679 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:33.141458 28286 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:33.174070 28286 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:33.174775 28286 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.156055 26507 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 3, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 3 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.157970 28096 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.174962 28361 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:33.175413 28096 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.175849 28096 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.175982 26507 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:33.176802 28210 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.122622 28329 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.159309 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.177585 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.178241 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.094084 28327 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.130724 28333 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.158392 27849 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:33.203986 27849 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.204213 26760 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:33.205552 28329 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.161007 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.208127 26687 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:33.209020 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.209185 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 220) took 3343 ms. Trace:
I20260709 13:07:33.210157 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.210754 26687 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:33.161075 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.211966 26681 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:33.159627 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.216681 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:33.216956 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57390.2us
I20260709 13:07:33.217643 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.218669 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.165704 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:33.141783 26754 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:33.169689 26755 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:33.170372 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.170915 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:33.219440 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53786.8us
I20260709 13:07:33.219825 28172 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.220323 28172 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:33.172083 28374 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.172273 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.219437 26754 pending_rounds.cc:85] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 1
I20260709 13:07:33.214568 28286 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:33.173089 28265 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.174400 28117 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.209573 27314 rpcz_store.cc:276] 0709 13:07:29.866266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.873330 (+  7064us) service_pool.cc:224] Handling call
0709 13:07:29.873652 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.283348 (+409696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.283382 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.283905 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.820531 (+2536626us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:07:32.966692 (+146161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.966742 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.208871 (+242129us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54004b78d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:33.208921 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.208964 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:33.208975 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.209132 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1571,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":992963840,"thread_start_us":2682390,"threads_started":1,"wal-append.queue_time_us":2613187}
I20260709 13:07:33.232191 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.178610 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.179513 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.158347 26759 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:33.179983 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 239835us
I20260709 13:07:33.181437 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:33.235160 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53830.7us
I20260709 13:07:33.236078 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.184623 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.185603 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-c04d1d6cb7c54df78a1746de67ce6198 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:07:33.186543 28371 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.188133 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:33.193064 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.193822 28333 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.131515 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 107) took 3023 ms. Trace:
I20260709 13:07:33.186975 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.194742 28317 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.195299 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.227907 28328 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.160501 28053 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:33.102375 26678 rpcz_store.cc:276] 0709 13:07:29.655196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.807580 (+152384us) service_pool.cc:224] Handling call
0709 13:07:29.832239 (+ 24659us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.834603 (+  2364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.835890 (+  1287us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:30.286466 (+450576us) log.cc:844] Serialized 539 byte log entry
0709 13:07:30.639066 (+352600us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:31.100256 (+461190us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.926825 (+1826569us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b1800319de0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:07:32.926947 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.927025 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.927076 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:32.927177 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.927309 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6885,"raft.queue_time_us":11317,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":21898,"spinlock_wait_cycles":11737984,"thread_start_us":357940,"threads_started":2,"wal-append.queue_time_us":560585,"wal-append.run_cpu_time_us":3079,"wal-append.run_wall_time_us":1311430}
I20260709 13:07:33.207414 28200 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.221208 26754 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:33.246061 28077 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:33.224246 26684 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:33.224969 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.203074 28264 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.200951 27902 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.229707 28265 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:33.237190 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52690.2us
W20260709 13:07:33.285074 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 60204.5us
I20260709 13:07:33.285696 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.286667 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.278625 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-c04d1d6cb7c54df78a1746de67ce6198 on tablet c04d1d6cb7c54df78a1746de67ce6198 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:33.239334 28096 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.241106 27849 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:33.237198 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.225258 28378 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.297392 28378 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.297802 28378 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.254632 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.298563 27849 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.299181 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.299997 26756 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:33.226194 28093 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.272773 26758 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.301082 26756 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.196043 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.227212 28036 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.302842 28036 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.254345 28319 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:33.303850 28319 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:33.304272 28319 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.304894 28264 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.305037 28036 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.275750 26681 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:33.290156 28201 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.172731 28356 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:33.306035 28201 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.279605 26754 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.306507 28201 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.308146 26686 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:33.235270 28152 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:33.262054 28154 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:33.272225 28107 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:33.235163 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:33.324693 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 89606.9us
I20260709 13:07:33.325839 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.327225 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:33.327847 28264 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.328270 28264 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.328644 28264 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.329094 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 116) took 1479 ms. Trace:
I20260709 13:07:33.329486 26757 rpcz_store.cc:276] 0709 13:07:31.849368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.210494 (+361126us) service_pool.cc:224] Handling call
0709 13:07:32.218818 (+  8324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.193584 (+974766us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:33.193615 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.193657 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:33.193685 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.328857 (+135172us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54002e95d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:33.328922 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.329043 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23655,"raft.queue_time_us":24098,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":2185418496}
I20260709 13:07:33.308665 28197 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:33.331908 28197 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.332294 28197 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.333173 28317 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.275000 28328 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.293974 26683 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:07:33.336092 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:33.294037 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56909.1us
I20260709 13:07:33.293267 28096 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.341418 28378 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:33.257814 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 70912.4us
I20260709 13:07:33.344895 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.223137 28172 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.278462 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.311132 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:33.280529 28117 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:33.313373 26756 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:33.321296 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:33.322104 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.323489 26606 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:33.335155 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:33.280948 28077 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.287777 28233 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.338479 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.371191 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.389832 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.323850 28154 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.343521 28378 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:33.393111 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.333765 28317 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:33.395624 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57224.2us
I20260709 13:07:33.345974 28265 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:33.335121 28371 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:07:33.430852 26759 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.343864 28328 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.379914 28096 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.424039 27849 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:33.424108 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.323311 28089 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:07:33.256949 26752 rpcz_store.cc:276] 0709 13:07:30.090891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.282065 (+191174us) service_pool.cc:224] Handling call
0709 13:07:30.282406 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.910860 (+2628454us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001e7420. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:07:33.098817 (+187957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.113674 (+ 14857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245695744}
I20260709 13:07:33.423148 27902 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.386546 28077 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.393441 26758 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:33.437014 26612 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:33.379390 28361 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:33.323614 28374 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.439155 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:33.452176 26609 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:33.422024 28154 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.441921 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.453358 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:33.427569 28107 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:33.402570 28286 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.429979 28317 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.432300 26610 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:33.439909 27849 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.461253 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:33.444846 28356 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.457275 26759 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.457648 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:33.343883 28053 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.482826 26603 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:33.486703 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:33.471697 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.489086 26759 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.452158 28361 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.460073 28152 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.509248 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.510701 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.514873 26759 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:33.484010 27849 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.516961 26685 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:33.470227 28107 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:33.518229 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.494052 28370 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.481788 28356 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.457648 28287 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:07:33.495028 28361 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.544915 26679 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.547199 26607 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
W20260709 13:07:33.555080 28394 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:33.555481 27318 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:33.482004 28128 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:33.560459 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.560537 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.563055 26759 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.522589 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.561381 28149 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.568578 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.568457 28149 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.569850 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:33.574013 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.574723 26754 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.513695 28152 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.548892 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.512941 28319 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:33.559752 28356 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.571347 28328 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.614804 26754 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:33.622547 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.612504 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 222761us
I20260709 13:07:33.625463 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.626637 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.626873 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:33.628890 26759 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:33.632113 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.608295 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 118627us
I20260709 13:07:33.622995 28286 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:33.634066 28286 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.634809 26761 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:33.634958 28319 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:33.646155 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.648663 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.577929 28201 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.654479 26682 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:33.609820 26752 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:33.600513 28152 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.649914 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:33.657285 26679 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:33.638175 28286 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.648005 28233 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.653487 28093 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:33.598968 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 149851us
I20260709 13:07:33.652532 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.661506 28371 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.676124 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 724) took 1043 ms. Trace:
I20260709 13:07:33.741654 26760 rpcz_store.cc:276] 0709 13:07:32.632203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.074548 (+442345us) service_pool.cc:224] Handling call
0709 13:07:33.675780 (+601232us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400225e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:33.676043 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224669952}
I20260709 13:07:33.695705 28248 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:33.698359 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.745471 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47351.1us
W20260709 13:07:33.745832 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.703171 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.709223 28036 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:33.670498 28402 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:33.709424 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 374316us
W20260709 13:07:33.725292 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 504161us
W20260709 13:07:33.746488 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.753665 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.732678 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:33.754079 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.656584 28227 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:33.740039 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65377.3us
W20260709 13:07:33.747336 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44246.8us
I20260709 13:07:33.751989 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:33.760210 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.730301 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 233) took 1093 ms. Trace:
I20260709 13:07:33.763530 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:33.763844 27318 rpcz_store.cc:276] 0709 13:07:32.637416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.637535 (+   119us) service_pool.cc:224] Handling call
0709 13:07:33.730031 (+1092496us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54004a38d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:33.730197 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016450304}
I20260709 13:07:33.776677 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:33.779207 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.745900 28392 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:33.784031 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:33.780746 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:33.741470 28233 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:33.773363 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:33.745182 28248 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:33.672266 28374 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:07:33.735677 28337 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:07:33.759611 28402 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:33.662801 28107 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.776962 28355 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:33.791849 28403 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.807449 28117 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:33.769361 28319 raft_consensus.cc:2764] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:33.775348 28371 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:33.796891 28036 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.797773 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:33.804723 28240 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.817901 26682 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:33.828634 28401 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.867632 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:33.775177 28405 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:07:33.802445 28245 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:33.900897 28036 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:33.862435 27315 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Advancing to term 2
I20260709 13:07:33.842140 28154 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.841813 28197 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.929951 28154 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.932502 28240 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:33.859238 28403 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:33.911500 27317 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:33.864336 28077 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:33.915975 28406 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:07:33.954371 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 160460us
I20260709 13:07:33.910710 28227 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:33.917284 28355 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.926282 28201 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:33.956708 28240 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.904708 28401 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:33.970669 28399 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:07:33.963689 28227 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.000113 28411 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:34.004565 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.006597 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.998427 28227 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.971558 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:33.925841 28233 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.009938 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 258025us
I20260709 13:07:34.020152 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.028049 26754 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.031051 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:33.922920 28248 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.034207 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.040620 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.045482 26754 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:34.011389 28036 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.063990 28414 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:33.964591 28402 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.059806 28117 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.065902 28402 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.066231 26757 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:34.067869 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.068536 28200 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.069149 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.069527 28328 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.070127 28328 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:34.070006 28200 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.070659 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.073781 26757 pending_rounds.cc:85] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:07:34.074328 26757 pending_rounds.cc:107] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:34.074841 26757 raft_consensus.cc:2889] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.078208 28245 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.078926 28245 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.080657 28245 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:34.082015 28393 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.377s	user 0.000s	sys 0.005s
I20260709 13:07:34.071856 28265 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:07:34.083875 28317 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.006s
I20260709 13:07:34.084290 28317 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.085153 26761 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:34.085505 26761 pending_rounds.cc:85] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:07:34.085711 26761 pending_rounds.cc:107] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:34.085928 26761 raft_consensus.cc:2889] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.086261 28317 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:34.086920 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.087155 26756 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:34.094069 28149 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:34.096647 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.098150 28319 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.098629 28319 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:34.098709 28149 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.099525 28319 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.107179 26761 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:34.109897 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.037022 28112 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:34.113835 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.071472 28200 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.070628 28328 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.120405 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 450639us
W20260709 13:07:34.113929 27849 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
W20260709 13:07:34.130487 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.111644 28333 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.004117 28371 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.040851 28361 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.133874 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:34.116994 28112 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:34.125592 28264 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:07:34.121850 28248 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.140163 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.173123 26754 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:34.180469 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2068) took 1006 ms. Trace:
I20260709 13:07:34.181046 26681 rpcz_store.cc:276] 0709 13:07:33.174059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.212566 (+ 38507us) service_pool.cc:224] Handling call
0709 13:07:33.212852 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.305777 (+ 92925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.180082 (+874305us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b54001dae54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:34.180372 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135362816}
I20260709 13:07:34.142359 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.113554 28240 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.189224 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46969.7us
I20260709 13:07:34.190518 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.191130 27320 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.170782 28112 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:34.221577 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.223430 26684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.016s	sys 0.033s
I20260709 13:07:34.182948 28337 consensus_queue.cc:1243] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:07:34.192600 28082 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:07:34.191977 28423 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.255133 28423 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.144611 28374 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:07:34.255604 28423 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.257782 28423 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:34.190478 28409 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:34.257799 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.261333 28361 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:34.263201 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.229349 26684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.016s	sys 0.033s
I20260709 13:07:34.235422 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.264389 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2071) took 1089 ms. Trace:
I20260709 13:07:34.264920 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.235623 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.265688 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2061) took 1099 ms. Trace:
I20260709 13:07:34.266511 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.184423 28425 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.192129 28197 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.267650 26679 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.264734 26683 rpcz_store.cc:276] 0709 13:07:33.174988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.220333 (+ 45345us) service_pool.cc:224] Handling call
0709 13:07:33.220651 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.337768 (+117117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.264154 (+926386us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:34.264329 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168106368}
I20260709 13:07:34.268894 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:34.269145 28152 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.001s
I20260709 13:07:34.269407 26683 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.269531 28152 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.266450 26686 rpcz_store.cc:276] 0709 13:07:33.169962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.170083 (+   121us) service_pool.cc:224] Handling call
0709 13:07:34.265502 (+1095419us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54001225d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:34.265635 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202780544}
I20260709 13:07:34.273737 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.140740 28053 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:07:34.243637 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.244153 28403 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.245378 28328 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.246933 28240 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:34.248413 28426 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.249773 26678 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.190456 28287 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.224728 28378 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.266813 28401 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.133188 27849 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.275898 26682 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:34.280728 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.223330 28355 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:34.284960 26679 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:34.263653 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.225901 28077 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.183041 28264 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.243253 28422 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:34.291263 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.271605 28152 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:34.298731 28356 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
W20260709 13:07:34.302593 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 241598us
I20260709 13:07:34.314417 26608 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.301292 26683 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:34.307852 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.315809 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.316210 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.308506 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.308709 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.317137 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.309562 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.317533 26611 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:34.318558 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.319227 26612 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.313752 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:34.334375 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 200575us
I20260709 13:07:34.335457 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:34.335482 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.336740 26611 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:34.340391 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.340929 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.341946 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.349627 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.350603 28426 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.352491 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.358827 26606 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:34.360195 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.361148 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.362176 26610 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:34.281304 28425 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.364658 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.364969 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.351495 28152 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.367359 26687 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:34.377230 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:34.377611 26612 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:34.341892 26753 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:34.422695 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58178.4us
I20260709 13:07:34.422755 26687 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.361542 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.429040 26686 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.338987 28356 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.369819 28317 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.367043 28329 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.419361 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.417011 28401 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:34.420017 28426 raft_consensus.cc:2764] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:34.420913 28045 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.454737 26685 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:34.447392 28082 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:34.426633 28328 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:34.449231 26687 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:34.361865 28227 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.426971 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.445816 26686 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:34.438405 28053 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:34.416944 28355 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.449998 26678 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:34.468397 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 352996us
I20260709 13:07:34.458397 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:34.480813 26608 raft_consensus.cc:2368] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:34.461584 28328 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:34.455368 28317 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:07:34.503594 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.504706 26682 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:34.505729 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.506295 28428 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:34.484356 28128 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:34.460872 28112 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.491097 28420 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:07:34.510823 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.459625 28045 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.491400 28328 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.515412 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.470391 28053 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.514792 28082 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:07:34.490906 28319 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.491430 27314 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:34.525269 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 749) took 1004 ms. Trace:
I20260709 13:07:34.525653 26760 rpcz_store.cc:276] 0709 13:07:33.520809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.742736 (+221927us) service_pool.cc:224] Handling call
0709 13:07:33.743100 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.743444 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.743475 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.752018 (+  8543us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.972104 (+220086us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:33.972364 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.972565 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.525046 (+552481us) raft_consensus.cc:1685] finished
0709 13:07:34.525071 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.525206 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11703,"raft.queue_time_us":606,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":23661,"thread_start_us":156646,"threads_started":1,"wal-append.queue_time_us":341061}
I20260709 13:07:34.527417 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:34.511875 28128 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:34.528366 26760 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:34.528777 28128 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.529868 28128 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.524358 28319 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.529237 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.531322 26760 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.532646 28227 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:34.533234 28227 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.533560 28227 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.533900 28227 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.535123 28319 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:34.523586 27849 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.537181 28425 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.541005 28356 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.544682 28433 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:34.545116 28433 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:34.529729 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.546056 28433 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:34.546715 28356 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.547348 28356 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.547565 26758 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.547765 28356 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.524253 28112 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:34.548683 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 122) took 1386 ms. Trace:
I20260709 13:07:34.549150 26756 rpcz_store.cc:276] 0709 13:07:33.162369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.384804 (+222435us) service_pool.cc:224] Handling call
0709 13:07:33.385264 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.087498 (+702234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.547621 (+460123us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001108d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:34.548626 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613624704}
I20260709 13:07:34.550244 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.550922 26756 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:34.551762 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.552284 26756 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.531373 26681 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:34.509223 28373 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:34.558739 26760 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:34.561968 26756 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:34.562497 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:34.563450 26760 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:34.565006 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.572597 28045 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:34.576197 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:34.577483 28432 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:34.579882 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.579643 28227 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.580399 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:34.577848 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:34.578155 28082 ts_tablet_manager.cc:1403] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 1.656s	user 0.028s	sys 0.015s
I20260709 13:07:34.582585 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:34.583439 26760 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:34.584630 26756 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:34.582036 28227 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.588640 26760 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.495843 28438 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:07:34.555124 28264 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:34.605851 28082 raft_consensus.cc:359] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:34.603219 26758 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.514344 28374 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
W20260709 13:07:34.609427 28436 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:34.570549 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:34.617981 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 197506us
W20260709 13:07:34.618224 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55842.8us
I20260709 13:07:34.597541 28112 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.618656 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.611547 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.624773 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.550896 28378 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.517441 28361 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:07:34.615950 28082 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
W20260709 13:07:34.628959 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.618651 28374 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:34.584589 28373 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:34.638118 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.646040 28373 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:34.643790 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 215414us
I20260709 13:07:34.609854 28248 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:07:34.628644 28438 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:34.650964 26757 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.653431 27320 raft_consensus.cc:1217] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:07:34.634214 26678 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.654100 27320 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:34.627866 26758 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:34.632450 28417 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.630098 28337 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:34.630506 28112 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.637105 26753 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:34.618774 28045 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:34.780334 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.781577 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:34.778617 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123798us
I20260709 13:07:34.777284 27320 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.785645 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.634874 28319 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:34.639756 28440 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:34.656250 28425 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.802721 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.657519 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:34.819818 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.791567 26609 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:34.792160 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 281408us
I20260709 13:07:34.794628 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.795012 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:34.828670 26606 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.795751 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.643170 28152 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:07:34.833681 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.799634 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.804739 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:34.805488 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.840801 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.805330 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.802534 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:34.830479 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.841512 28128 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.852165 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.806063 28407 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:34.869261 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.870728 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.870935 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.842221 26612 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:34.834476 26610 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:34.786352 28438 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:34.846577 28233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.024s	sys 0.037s
I20260709 13:07:34.874017 26606 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:34.831524 28401 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:34.875768 26724 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.878782 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:34.861831 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57172us
I20260709 13:07:34.852173 28128 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.874166 28287 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:34.860546 27849 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:07:34.853631 28439 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:07:34.877774 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.788746 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:34.822180 28429 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:07:34.876472 28329 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.846894 28437 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:07:34.861519 28337 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.871938 28407 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:34.789803 28082 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:34.875371 28036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.010s	sys 0.015s
I20260709 13:07:34.861922 28423 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:34.845564 26609 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:34.880474 26606 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: [1.2-2.3]
I20260709 13:07:34.872519 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.882560 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:34.853202 27312 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 2: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:34.900228 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:34.894317 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.877352 28233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.024s	sys 0.038s
I20260709 13:07:34.889196 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.889746 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2074) took 1386 ms. Trace:
I20260709 13:07:34.884469 28417 raft_consensus.cc:476] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:34.900139 28409 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:34.876874 28446 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.896041 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.887583 28441 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:34.893221 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.888899 27317 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:34.879065 28201 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.873311 28425 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:34.885018 28402 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 13:07:34.896883 28378 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:34.881013 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.879310 26612 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.907651 26752 raft_consensus.cc:606] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:07:34.892884 28412 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.828s	user 0.001s	sys 0.001s
I20260709 13:07:34.892956 28082 ts_tablet_manager.cc:1434] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.310s	user 0.008s	sys 0.000s
I20260709 13:07:34.881958 28128 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.906854 26684 rpcz_store.cc:276] 0709 13:07:33.506498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.518455 (+ 11957us) service_pool.cc:224] Handling call
0709 13:07:33.518854 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.653033 (+134179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.653062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.653518 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.264020 (+610502us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:34.266054 (+  2034us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.266231 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.266297 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.889569 (+623272us) raft_consensus.cc:1685] finished
0709 13:07:34.889587 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.889692 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1290,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":61249,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":26410,"spinlock_wait_cycles":11136,"thread_start_us":725333,"threads_started":2,"wal-append.queue_time_us":790592}
I20260709 13:07:34.960999 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:34.892657 28036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.015s
I20260709 13:07:34.940495 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:34.896862 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.943917 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:34.888913 28329 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:34.953356 27315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.016s
I20260709 13:07:34.946782 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:34.906023 26683 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:34.887799 28053 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:34.890290 28112 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:34.947263 26605 raft_consensus.cc:2368] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:34.891336 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:34.903623 28265 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.960026 28402 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:34.958120 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 77165.8us
I20260709 13:07:34.959486 28378 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:34.891548 28337 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.974851 26611 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.003722 26611 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:34.901551 28371 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:34.984318 26754 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:34.994964 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:34.954066 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:35.009317 26609 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:34.997090 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:35.009999 26610 raft_consensus.cc:2376] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4. Re-sending same reply.
I20260709 13:07:34.997538 26682 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:35.011718 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:34.999508 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:35.014331 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.887115 28356 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.012424 26682 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:34.892176 28407 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.000948 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:34.989292 27315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.009s	sys 0.016s
I20260709 13:07:35.037807 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:34.974170 28089 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:35.002526 28201 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:35.017863 28077 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:34.938181 28446 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:34.998704 27902 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:34.956183 28403 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:35.055984 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:35.034394 28426 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.049114 26612 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:35.021039 28286 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:35.006043 28053 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:07:35.032685 28402 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:34.999220 28036 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:35.043341 26611 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.073345 28426 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.076604 26611 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.064184 26608 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:07:35.045881 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6 received from {username='slave'} at 127.0.0.1:47704
W20260709 13:07:35.050634 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 110254us
I20260709 13:07:35.078151 28426 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:35.078594 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:35.078204 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6 on tablet 272d473e821e4c15a9f3fa0471adfdc6 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:35.001019 28265 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.080832 26758 pending_rounds.cc:85] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 1
I20260709 13:07:35.081123 26758 pending_rounds.cc:107] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:35.081382 26758 raft_consensus.cc:2889] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.075904 26756 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:35.081271 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:35.058959 28407 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.118067 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 742) took 1622 ms. Trace:
I20260709 13:07:35.118952 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:34.992250 28438 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.042948 28287 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:07:35.148422 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.154582 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:35.059130 28422 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:35.051604 28077 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:35.152951 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.134801 26759 rpcz_store.cc:276] 0709 13:07:33.495499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.629770 (+134271us) service_pool.cc:224] Handling call
0709 13:07:33.630189 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.699418 (+ 69229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.699455 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.700069 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.790926 (+ 90857us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:33.832938 (+ 42012us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.833132 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.833212 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.892178 (+1058966us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:35.117782 (+225604us) raft_consensus.cc:1685] finished
0709 13:07:35.117863 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.118009 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68764,"prepare.queue_time_us":42072,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":3339,"raft.queue_time_us":80984,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":6354,"spinlock_wait_cycles":92439808,"thread_start_us":90078,"threads_started":1,"wal-append.queue_time_us":316349}
I20260709 13:07:35.172845 26756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:35.173506 26756 raft_consensus.cc:606] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:35.173867 26756 raft_consensus.cc:614] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:35.174043 28433 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.053156 28425 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.176434 28152 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.176889 28152 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:35.177662 28152 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.181135 28373 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:35.182035 28418 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:35.184168 28450 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:07:35.185462 28077 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:35.188442 28449 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:07:35.189671 28451 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:07:35.189879 26680 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:07:35.190932 28453 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:07:35.191550 26684 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:35.134975 28443 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.231s	user 0.003s	sys 0.001s
W20260709 13:07:35.133165 28406 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:07:35.140257 28462 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:35.050351 28089 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:35.141534 28374 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:35.213404 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 60583.7us
I20260709 13:07:35.218631 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.138665 28446 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:35.145098 28337 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:35.137283 28356 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:35.170043 28422 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.202232 28077 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.223106 28045 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:35.136286 28470 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:35.254405 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.215855 28265 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:35.119290 28378 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.312659 26759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:35.321707 26759 raft_consensus.cc:606] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.317132 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 773) took 1080 ms. Trace:
I20260709 13:07:35.230120 28422 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.337790 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 238) took 1590 ms. Trace:
I20260709 13:07:35.225951 28371 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:35.217345 28374 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:35.226544 28417 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:35.322772 26686 rpcz_store.cc:276] 0709 13:07:34.236748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.273509 (+ 36761us) service_pool.cc:224] Handling call
0709 13:07:35.312580 (+1039071us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000140d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:35.317062 (+  4482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356017408}
W20260709 13:07:35.324306 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.329247 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74925us
I20260709 13:07:35.367199 26686 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:35.367352 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.329989 28446 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:35.230882 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:35.346985 26680 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:35.373464 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 750) took 3241 ms. Trace:
I20260709 13:07:35.373935 26680 rpcz_store.cc:276] 0709 13:07:32.132092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.430337 (+298245us) service_pool.cc:224] Handling call
0709 13:07:32.430608 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.699541 (+1268933us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b1800270b40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32cb646 00007f40f320558e 00007f40f3286f9e 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4
0709 13:07:35.183213 (+1483672us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b580040bbd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4
0709 13:07:35.373068 (+189855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.373405 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5045346048}
I20260709 13:07:35.374856 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.369738 26686 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:35.257529 28045 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:35.376012 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.382606 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.383973 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.384907 26686 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:35.388109 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 312089us
I20260709 13:07:35.391299 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.391224 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:35.392648 26756 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:35.395109 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:35.396185 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.398149 26756 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.373188 28154 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.410392 26724 leader_election.cc:400] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:35.380920 28470 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:35.387894 28466 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:35.431223 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:35.436566 26686 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:07:35.444303 26756 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:35.437783 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:35.429665 26724 leader_election.cc:403] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.386534 28459 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:35.388741 28317 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:35.453190 28317 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:35.453424 27849 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:35.453724 28317 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.453884 27849 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.454360 27849 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.387633 28329 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:35.448580 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:35.450760 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:35.396449 28265 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.484192 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:35.378516 28417 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.428437 28465 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.440702 28446 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:35.389657 28319 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:07:35.440356 28356 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.449723 28463 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:35.508625 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.511744 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:35.498540 26760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:35.484915 26686 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:35.494095 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:35.537588 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 86906.6us
I20260709 13:07:35.549207 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:35.588270 26612 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:35.592617 26759 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:35.455870 28036 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
W20260709 13:07:35.589277 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77637.3us
I20260709 13:07:35.597983 26760 raft_consensus.cc:606] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:35.338389 27315 rpcz_store.cc:276] 0709 13:07:33.747174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.750362 (+  3188us) service_pool.cc:224] Handling call
0709 13:07:33.843172 (+ 92810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.144697 (+301525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.168946 (+ 24249us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.280258 (+111312us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.536152 (+255894us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:07:35.039274 (+503122us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:35.256281 (+217007us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.337267 (+ 80986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.337377 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.337431 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:35.337538 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.337712 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4209,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":32011,"spinlock_wait_cycles":12496256,"thread_start_us":861293,"threads_started":2,"wal-append.queue_time_us":709634}
I20260709 13:07:35.601017 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1076) took 1288 ms. Trace:
I20260709 13:07:35.498202 26755 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 4. Ops: []
I20260709 13:07:35.506227 28240 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:35.540365 28265 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:35.540654 28465 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:35.508131 27902 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:35.536767 28470 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.585124 28468 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.501077 28469 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.445089 28467 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:07:35.609876 28287 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.446599 28154 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:35.609409 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 745) took 2105 ms (client timeout 1855 ms). Trace:
I20260709 13:07:35.510679 28089 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:35.651760 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:35.650825 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 786) took 1087 ms. Trace:
I20260709 13:07:35.587626 28356 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.500131 28487 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:07:35.598747 26761 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:35.610149 28482 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:35.728256 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 136649us
I20260709 13:07:35.741333 26681 rpcz_store.cc:276] 0709 13:07:34.563562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.144672 (+581110us) service_pool.cc:224] Handling call
0709 13:07:35.145005 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.145202 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:35.381512 (+236310us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.650471 (+268959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.650523 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.650566 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.650628 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.650755 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2619,"prepare.queue_time_us":316140,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":15592,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":40870,"thread_start_us":488909,"threads_started":2,"wal-append.queue_time_us":359055}
W20260709 13:07:35.742870 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 621976us
W20260709 13:07:35.743352 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 91739.1us
I20260709 13:07:35.492887 28417 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:35.643682 26603 rpcz_store.cc:276] 0709 13:07:34.313052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.358609 (+ 45557us) service_pool.cc:224] Handling call
0709 13:07:34.567742 (+209133us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:34.567932 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.596285 (+ 28353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.596329 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.609516 (+ 13187us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.045651 (+436135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:35.370632 (+324981us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.536415 (+165783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.536501 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.536541 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:35.600807 (+ 64266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.600960 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192221,"prepare.queue_time_us":149759,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":356620,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5204,"spinlock_wait_cycles":20910976,"thread_start_us":705538,"threads_started":2,"wal-append.queue_time_us":605338}
W20260709 13:07:35.749487 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 630586us
W20260709 13:07:35.646557 28328 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.089s	user 0.006s	sys 0.005s
I20260709 13:07:35.449908 28374 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.756403 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:35.759924 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:07:35.728474 28373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.010s	sys 0.009s
I20260709 13:07:35.727922 28469 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:35.771098 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:35.499135 28371 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.709583 28053 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.770211 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:35.763726 28448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.028s
I20260709 13:07:35.774967 28328 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:35.733244 26753 rpcz_store.cc:269] 0709 13:07:33.496438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.615997 (+119559us) service_pool.cc:224] Handling call
0709 13:07:35.586584 (+1970587us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400081e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:35.602007 (+ 15423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376937728}
I20260709 13:07:35.642640 28472 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 13:07:35.780988 28482 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:35.846951 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87143us
I20260709 13:07:35.847962 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:35.849359 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:35.850438 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.775745 28089 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.753000 28036 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:35.666810 28240 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:35.866641 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:35.779645 28373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.010s
I20260709 13:07:35.811203 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:35.814911 27285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.028s	sys 0.024s
W20260709 13:07:35.787429 28425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.035s
I20260709 13:07:35.749837 28287 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:35.788120 28417 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:35.822592 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 217930us
I20260709 13:07:35.853475 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:35.820647 28448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.015s	sys 0.028s
I20260709 13:07:35.800611 28467 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:35.642077 28477 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:35.709379 28470 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:35.872609 27285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.028s	sys 0.024s
W20260709 13:07:35.878329 28483 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:07:35.883701 28036 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:07:35.885486 28464 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.702s	user 0.001s	sys 0.008s
I20260709 13:07:35.818086 28265 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.868242 28481 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:35.868997 28409 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:35.807145 27902 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.880138 28503 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:35.867462 28201 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:35.882531 28482 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.886379 28474 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:35.869834 26687 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
W20260709 13:07:35.897627 28494 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:07:35.875135 28425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.036s
I20260709 13:07:35.927764 28373 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.870783 28227 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:35.908702 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 745251us
I20260709 13:07:35.913044 27849 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:35.919349 28461 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.792s	user 0.000s	sys 0.004s
I20260709 13:07:35.889520 28286 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.821647 28053 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.895999 28472 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.865955 28089 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:35.916774 28422 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:07:35.898804 28417 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.943204 28474 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:35.839542 28465 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:35.866236 28416 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:35.919770 28467 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.009910 26679 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:36.001474 28286 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:36.044323 28497 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:07:36.000813 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57091.9us
I20260709 13:07:35.909353 28469 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:35.987977 28502 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:07:35.938902 28240 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:36.148603 26610 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:36.094585 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 106) took 1101 ms. Trace:
I20260709 13:07:35.944752 28201 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.113823 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2088) took 1624 ms. Trace:
W20260709 13:07:36.066033 28172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.010s	sys 0.007s
I20260709 13:07:35.985914 28481 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 13:07:36.162758 26685 rpcz_store.cc:276] 0709 13:07:34.489808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.608523 (+118715us) service_pool.cc:224] Handling call
0709 13:07:36.105727 (+1497204us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:36.106014 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.106254 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.106292 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.106352 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:36.106391 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.113540 (+  7149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.113747 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5134720}
I20260709 13:07:36.008679 28227 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:36.164261 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 174633us
W20260709 13:07:36.093021 28407 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.000s
I20260709 13:07:36.149456 26607 rpcz_store.cc:276] 0709 13:07:34.993236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.998987 (+  5751us) service_pool.cc:224] Handling call
0709 13:07:35.016394 (+ 17407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.225571 (+209177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.225621 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.254174 (+ 28553us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.601876 (+347702us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.646219 (+ 44343us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.734675 (+ 88456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.734791 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.094307 (+359516us) raft_consensus.cc:1685] finished
0709 13:07:36.094332 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.094515 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115259,"prepare.queue_time_us":44139,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":4647,"raft.queue_time_us":603701,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":12013952,"thread_start_us":392928,"threads_started":2,"wal-append.queue_time_us":583895}
I20260709 13:07:36.045300 28402 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.984517 28409 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:36.160362 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 266770us
I20260709 13:07:36.181658 28319 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.074664 28417 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.999176 28496 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
W20260709 13:07:36.188170 28492 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:07:36.088867 28487 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:35.987818 28477 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
I20260709 13:07:35.997262 28373 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:35.938395 28503 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.196266 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 109) took 1196 ms. Trace:
I20260709 13:07:36.148633 28425 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.213425 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:36.218143 26609 rpcz_store.cc:276] 0709 13:07:34.999641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.010015 (+ 10374us) service_pool.cc:224] Handling call
0709 13:07:35.010363 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.232063 (+221700us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:35.249385 (+ 17322us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.769517 (+520132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.769583 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.769640 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.195988 (+426348us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400324954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:36.196043 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.196187 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227701,"prepare.queue_time_us":110255,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":189459,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8229,"spinlock_wait_cycles":509262592,"thread_start_us":340973,"threads_started":1,"wal-append.queue_time_us":588823}
I20260709 13:07:36.202184 28502 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.224862 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2097) took 1160 ms. Trace:
I20260709 13:07:36.231652 26680 rpcz_store.cc:276] 0709 13:07:35.064374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.375855 (+311481us) service_pool.cc:224] Handling call
0709 13:07:35.376302 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.380472 (+  4170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.380504 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.390243 (+  9739us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.743439 (+353196us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:35.743483 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.743545 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.224574 (+481029us) raft_consensus.cc:1685] finished
0709 13:07:36.224602 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.224799 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11611,"thread_start_us":262202,"threads_started":1,"wal-append.queue_time_us":431348}
I20260709 13:07:36.199935 28197 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.232664 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.234476 26609 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:36.205231 28469 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.208755 28446 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:36.218983 28240 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.106930 28036 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.188375 28286 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.091074 28474 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.064911 28422 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:36.236671 28077 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.001s
I20260709 13:07:36.208218 28402 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.210966 28319 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:36.259872 28488 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:07:36.266296 28264 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:36.222496 28487 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.284799 28500 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:36.299036 28501 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:36.299433 28491 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:07:36.300292 28505 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:07:36.300386 28402 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.229713 28425 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.239029 28502 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.239560 28197 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.248245 28506 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:07:36.324877 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 111541us
I20260709 13:07:36.288309 28286 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:36.309139 28489 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:07:36.260284 28446 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.295945 28470 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:36.310855 28508 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:36.306162 28474 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.331882 28523 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.332574 28053 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.332967 28516 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.335882 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 758) took 1259 ms. Trace:
I20260709 13:07:36.336268 28467 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.338081 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.303153 28264 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:36.309895 28477 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:36.340862 28248 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.311484 28501 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:36.285845 28227 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:36.366765 28373 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.480696 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.479115 28487 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:36.479970 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 108) took 1486 ms. Trace:
W20260709 13:07:36.482692 28468 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.003s
I20260709 13:07:36.520535 28468 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:36.492456 28319 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:36.487583 28433 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.313s	user 0.014s	sys 0.000s
W20260709 13:07:36.430222 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 230916us
I20260709 13:07:36.521109 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:36.511590 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 165319us
I20260709 13:07:36.497609 28503 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.520215 26606 rpcz_store.cc:276] 0709 13:07:34.993860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.033173 (+ 39313us) service_pool.cc:224] Handling call
0709 13:07:35.033603 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.536481 (+502878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.536512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.585725 (+ 49213us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.903040 (+317315us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.903160 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.903354 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.479748 (+576394us) raft_consensus.cc:1685] finished
0709 13:07:36.479780 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.479916 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26656,"raft.queue_time_us":476782,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":63,"thread_start_us":679794,"threads_started":2,"wal-append.queue_time_us":546876}
I20260709 13:07:36.522042 28371 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:36.521550 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.523511 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:36.524322 28531 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:36.524817 28531 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:36.525691 28531 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.526216 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:36.527196 28531 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.527951 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:36.412241 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 785) took 1849 ms. Trace:
I20260709 13:07:36.528641 26679 rpcz_store.cc:276] 0709 13:07:34.563273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.118939 (+555666us) service_pool.cc:224] Handling call
0709 13:07:35.119229 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.097868 (+978639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.411976 (+314108us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400187c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:36.412176 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047944064}
I20260709 13:07:36.374612 28514 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.530126 28514 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.516662 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1118) took 1893 ms. Trace:
I20260709 13:07:36.524896 27315 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.367079 28425 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.375994 28089 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.533906 28448 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:36.534430 28448 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:36.535315 28448 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.413060 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 752) took 2587 ms. Trace:
W20260709 13:07:36.524235 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.537003 26754 rpcz_store.cc:276] 0709 13:07:33.825722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.185984 (+360262us) service_pool.cc:224] Handling call
0709 13:07:34.187893 (+  1909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.007038 (+819145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.412817 (+1405779us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400225454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:36.412996 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808997248}
W20260709 13:07:36.543738 26650 leader_election.cc:336] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.525s (SENT)
I20260709 13:07:36.544319 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:36.409453 28317 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.955s	user 0.011s	sys 0.001s
I20260709 13:07:36.536689 26757 rpcz_store.cc:276] 0709 13:07:34.622783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.655366 (+ 32583us) service_pool.cc:224] Handling call
0709 13:07:34.655653 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.945816 (+290163us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:35.046980 (+101164us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.592586 (+545606us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.617580 (+ 24994us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.617771 (+   191us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:35.617819 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.617914 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.511806 (+893892us) raft_consensus.cc:1685] finished
0709 13:07:36.516465 (+  4659us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.516610 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175083,"prepare.queue_time_us":60763,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":178384,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":47830,"thread_start_us":701091,"threads_started":3,"wal-append.queue_time_us":676647}
I20260709 13:07:36.545132 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 761) took 1467 ms. Trace:
I20260709 13:07:36.494011 28446 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.547487 26758 rpcz_store.cc:276] 0709 13:07:35.077387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.077500 (+   113us) service_pool.cc:224] Handling call
0709 13:07:35.077832 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.146382 (+ 68550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.146412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.146947 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.667817 (+520870us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:35.667859 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.505044 (+837185us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5400083254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:36.515813 (+ 10769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.515871 (+    58us) raft_consensus.cc:1685] finished
0709 13:07:36.515888 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.545066 (+ 29178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105239,"raft.queue_time_us":96370,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":15887,"spinlock_wait_cycles":6390656,"thread_start_us":456005,"threads_started":1,"wal-append.queue_time_us":685572}
I20260709 13:07:36.460558 28201 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.411446 28152 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.479275 28502 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.545513 28248 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:36.555867 26650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.137s (SENT) [suppressed 19 similar messages]
I20260709 13:07:36.600143 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.555932 28448 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:36.602911 26687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 108) took 2116 ms (client timeout 1880 ms). Trace:
W20260709 13:07:36.667006 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 111160us
I20260709 13:07:36.581626 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.623754 28197 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.687978 28112 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.551113 28128 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:07:36.693914 28112 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:36.694566 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.611318 28154 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.593377 28264 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:36.696062 28112 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:36.575446 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.586707 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.546959 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 112) took 1488 ms. Trace:
W20260709 13:07:36.620824 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.571055 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.689175 26507 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 112) took 7729 ms. Trace:
W20260709 13:07:36.691330 26687 rpcz_store.cc:269] 0709 13:07:34.486099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.498195 (+ 12096us) service_pool.cc:224] Handling call
0709 13:07:36.602639 (+2104444us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400312ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:36.602795 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3109071232}
W20260709 13:07:36.606971 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.624421 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:36.599972 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.612699 28482 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.703735 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.703806 28482 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.615217 28426 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.603056 28417 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:36.705375 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 81058.8us
I20260709 13:07:36.546521 28425 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:36.710201 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:36.710951 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 232954us
I20260709 13:07:36.711975 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:36.606472 28472 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
W20260709 13:07:36.599573 28442 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.800s	user 0.002s	sys 0.002s
I20260709 13:07:36.713351 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:36.592419 28422 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.728268 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.715934 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.579967 27902 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.701762 26507 rpcz_store.cc:276] 0709 13:07:28.921961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.922172 (+   211us) service_pool.cc:224] Handling call
0709 13:07:29.155581 (+233409us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:36.650980 (+7495399us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:33.289099 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:33.289667 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:33.289698 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:07:33.289714 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:33.291471 (+  1757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:33.291551 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:33.291585 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:33.291951 (+   366us) tablet.cc:701] Row locks acquired
0709 13:07:33.291971 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:07:33.292119 (+   148us) write_op.cc:270] Start()
0709 13:07:33.292236 (+   117us) write_op.cc:276] Timestamp: P: 1783602453292074 usec, L: 0
0709 13:07:33.292274 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:33.292948 (+   674us) log.cc:844] Serialized 1374 byte log entry
0709 13:07:34.015842 (+722894us) op_driver.cc:464] REPLICATION: finished
0709 13:07:34.479717 (+463875us) write_op.cc:301] APPLY: starting
0709 13:07:34.484932 (+  5215us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:34.498248 (+ 13316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:34.521087 (+ 22839us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:34.636432 (+115345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:34.693838 (+ 57406us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:07:34.780702 (+ 86864us) write_op.cc:312] APPLY: finished
0709 13:07:34.804415 (+ 23713us) log.cc:844] Serialized 34 byte log entry
0709 13:07:34.983760 (+179345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:34.992895 (+  9135us) write_op.cc:454] Released schema lock
0709 13:07:34.999703 (+  6808us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:35.066758 (+ 67055us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.070406 (+  3648us) write_op.cc:454] Released schema lock
0709 13:07:35.883227 (+812821us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
Metrics: {"mutex_wait_us":34654,"reported_tablets":14,"spinlock_wait_cycles":397681920,"child_traces":[["op",{"apply.queue_time_us":439776,"apply.run_cpu_time_us":13374,"apply.run_wall_time_us":583977,"num_ops":3,"prepare.queue_time_us":102763,"prepare.run_cpu_time_us":77981,"prepare.run_wall_time_us":153077,"raft.queue_time_us":352138,"raft.run_cpu_time_us":11886,"raft.run_wall_time_us":313270,"replication_time_us":699342,"spinlock_wait_cycles":10287488,"thread_start_us":692646,"threads_started":5,"wal-append.queue_time_us":419024,"wal-append.run_cpu_time_us":62834,"wal-append.run_wall_time_us":1291363}]]}
I20260709 13:07:36.617660 28356 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.569345 28519 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:36.731017 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:36.574712 28328 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.575042 26678 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:36.563949 28477 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:36.730371 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:36.738391 27321 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:36.409415 28516 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.710705 28469 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:36.713757 28154 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:36.551322 28317 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.748472 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:36.751508 26757 raft_consensus.cc:2410] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:36.750514 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.753937 26758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:36.754582 26758 raft_consensus.cc:606] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:36.754513 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.756456 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:36.730675 28472 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:36.757088 26754 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:36.554055 28419 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.192s
I20260709 13:07:36.760601 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:36.728088 28286 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.766876 26760 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:36.760648 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.759145 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:36.769625 26607 raft_consensus.cc:2368] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:36.766880 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.750178 28154 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.779772 27318 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.717532 28426 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.391287 28523 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:36.785969 28452 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.638s	user 0.001s	sys 0.004s
I20260709 13:07:36.786298 28516 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.700482 26604 rpcz_store.cc:276] 0709 13:07:35.057915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.061139 (+  3224us) service_pool.cc:224] Handling call
0709 13:07:35.210721 (+149582us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.511508 (+300787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.511539 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.512256 (+   717us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.837268 (+325012us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.877190 (+ 39922us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.923483 (+ 46293us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.168006 (+244523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.186937 (+ 18931us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.337953 (+151016us) raft_consensus.cc:1685] finished
0709 13:07:36.340886 (+  2933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.545966 (+205080us) inbound_call.cc:177] Queueing success response
0709 13:07:36.576580 (+ 30614us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b1800302500. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1
0709 13:07:36.578355 (+  1775us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b1800302500. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
Metrics: {"mutex_wait_us":279919,"prepare.queue_time_us":31748,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":12842,"raft.queue_time_us":776294,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":140966,"spinlock_wait_cycles":163291520,"thread_start_us":453126,"threads_started":2,"wal-append.queue_time_us":773879}
I20260709 13:07:36.793241 28409 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.762753 28514 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:36.765214 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:36.797644 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.744957 27902 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.800040 26607 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3. Re-sending same reply.
I20260709 13:07:36.787441 28477 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.793493 28361 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:36.783115 28154 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.758389 28469 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.782470 28128 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.823937 28128 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.826081 28128 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.705550 28501 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.819746 27314 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:36.820619 28248 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:36.821138 28469 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.821821 28317 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:36.822587 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.828972 27902 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.516729 26752 rpcz_store.cc:276] 0709 13:07:35.076510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.079477 (+  2967us) service_pool.cc:224] Handling call
0709 13:07:35.164444 (+ 84967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.258893 (+ 94449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.320295 (+ 61402us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.397769 (+ 77474us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.779473 (+381704us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:35.779523 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.784577 (+  5054us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.335568 (+550991us) raft_consensus.cc:1685] finished
0709 13:07:36.335589 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.335813 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28114,"raft.queue_time_us":36724,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22876,"thread_start_us":229619,"threads_started":1,"wal-append.queue_time_us":554876}
I20260709 13:07:36.817513 28361 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:36.830067 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.831272 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.830950 28361 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.819473 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:36.752275 28519 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.834014 28154 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:36.779031 28286 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.842541 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:36.843238 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:36.844409 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:36.843600 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:36.875067 26683 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.844437 26684 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:36.845583 26612 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:36.841056 26679 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:36.876931 27318 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:36.841924 26680 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:36.845269 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:36.878631 26607 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:36.841493 28482 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.875427 26686 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
W20260709 13:07:36.842778 28498 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.681s	user 0.000s	sys 0.004s
I20260709 13:07:36.841409 28328 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:36.838759 28525 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:07:36.839788 28425 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:36.842038 28128 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:36.837517 28426 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.838836 28533 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.875155 28422 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:36.899786 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:36.980795 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 161387us
I20260709 13:07:36.899799 26606 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:36.993422 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:36.993182 26682 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:36.993523 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.005824 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.006111 26682 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:36.984985 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.006223 26686 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:37.009151 26683 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:37.010511 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:36.852615 28402 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:36.992865 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.014891 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.013156 26603 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:37.016098 26679 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:07:37.013000 26607 raft_consensus.cc:2368] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:37.015522 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:36.984153 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:37.017877 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.018024 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.018683 26683 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:36.887769 28361 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.012082 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:36.977128 28539 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:07:36.943555 28474 consensus_meta.cc:287] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.002s
I20260709 13:07:37.019093 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.021386 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.036831 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.022640 26686 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:37.025257 28485 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:36.984414 28286 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.951543 28417 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:37.025694 28227 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.025832 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:36.909637 28128 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.026427 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.017165 28477 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:07:36.985369 27849 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.013432 28422 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.017019 28409 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:37.032748 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.021032 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:36.888502 26604 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:37.034312 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:36.949100 28201 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:37.074759 28201 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:37.075887 28201 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.077227 28201 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.982066 28519 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.038030 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:37.081146 26650 leader_election.cc:400] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:37.082130 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.084578 27849 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:37.085412 27849 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:37.085958 27849 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:37.087148 27849 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:37.094022 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:37.095180 28545 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:37.095762 28545 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.096283 28545 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.896868 28482 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:36.983573 28154 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:36.987003 27315 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:37.016851 28426 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:37.046370 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.019903 28448 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:37.098129 28448 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:37.098006 28426 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.098533 28448 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.098706 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.016535 28416 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:37.099540 28416 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.100557 28426 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.101657 28416 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:36.913707 28533 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.909437 28425 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:36.896588 28328 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.105376 28328 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.020071 27902 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:37.061177 26609 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:37.048237 28356 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:37.036612 28373 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:37.097474 28482 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.056341 27314 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:37.110253 28425 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.110576 28482 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.117527 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.118196 27315 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:37.118296 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:37.118403 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.118408 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.120452 27317 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:37.121061 28482 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:37.121657 28482 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:37.122174 28482 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.123539 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:37.123711 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89467.6us
I20260709 13:07:37.054296 28544 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:37.119268 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:37.131131 26577 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:07:37.131460 26577 leader_election.cc:403] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.074257 28477 consensus_queue.cc:1243] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:37.131628 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:37.074298 28287 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.138576 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.130718 28227 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:37.132900 28402 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:37.145613 26683 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:37.140515 28477 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.146469 26650 leader_election.cc:400] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:37.152518 26650 leader_election.cc:403] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.144315 28402 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:37.155365 28402 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.156463 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.157554 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.158627 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.160188 28128 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.162427 28402 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.164542 28409 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.164925 28402 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.166083 26687 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:37.170568 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.159611 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.146425 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.146659 28227 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:37.182734 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.149225 28287 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:37.175297 28544 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:37.184636 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:37.189707 26726 connection.cc:256] RPC call timeout handler was delayed by -1.2203942810000399s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 13:07:37.154091 28523 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:37.192065 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.191731 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.187561 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:37.192701 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:37.194370 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.144140 28448 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.182585 28423 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.185745 28036 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:37.189198 28317 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:37.190995 28128 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:37.191233 28469 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:37.215529 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.193678 28248 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.189782 28287 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:37.202133 28544 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:37.246109 28544 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.246683 28544 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.248629 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.250535 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.198258 28112 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.183837 28409 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:07:37.219059 28403 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:37.206439 28423 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.223034 28248 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.224049 28287 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.226850 28448 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.240329 28227 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.230373 28374 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.260166 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.261117 28422 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:37.276410 26726 connection.cc:256] RPC call timeout handler was delayed by -1.1186942810001028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:07:37.263775 28403 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:37.287464 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:37.288332 26609 raft_consensus.cc:2410] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:37.278034 26726 connection.cc:256] RPC call timeout handler was delayed by -1.105194281000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:07:37.256125 28469 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.272540 28425 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.218317 28317 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.294375 26609 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:07:37.298465 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.280721 28541 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.464s	user 0.001s	sys 0.003s
W20260709 13:07:37.281915 28540 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 13:07:37.303934 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:37.279261 28549 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.263569 28112 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.313373 28469 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:37.314121 28240 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:37.313796 28425 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:37.315553 28248 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.280236 28403 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.321664 28473 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:37.323380 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.341566 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:37.325613 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.215461 28036 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:37.278803 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:37.333855 26757 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:37.335088 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.335400 26680 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:37.329617 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.324597 26754 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:37.296800 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:37.344892 28473 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:37.349442 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.344388 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.344552 26603 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:07:37.345077 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:37.343421 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.351540 27318 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:37.351468 26684 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:37.336517 28551 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.354036 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.350682 26680 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:37.357383 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.358042 26680 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:37.358722 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.359217 26680 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:37.360752 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:37.361694 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:37.339037 28152 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.342109 28286 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.337556 28422 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.338861 28402 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:37.365381 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.365546 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.365998 26684 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:37.366942 26684 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:37.367673 28403 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.349735 28473 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.340449 27849 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:37.355365 27317 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:37.371181 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:37.368713 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.374667 26610 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:37.380684 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:37.345175 28240 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.368368 28328 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.338274 28549 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.371081 28426 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.388451 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.396062 28545 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.378041 28154 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.370476 28286 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.427654 27318 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Advancing to term 4
I20260709 13:07:37.371551 28422 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:37.373608 28402 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.401814 28473 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.364538 28551 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:37.371349 28152 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:37.383344 27849 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.444396 27318 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 4 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:37.453222 26680 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.485127 26684 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:37.485325 26680 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:37.443132 28499 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.443876 28248 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.432516 28469 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:37.477959 28112 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:37.512683 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 124722us
W20260709 13:07:37.557169 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.576113 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.553843 28508 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:37.632683 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:37.633894 26761 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:37.635068 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:37.546495 28317 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.645049 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:37.544571 28499 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:37.548635 28248 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:37.685143 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.646879 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:37.864711 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:37.865631 26761 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:37.712142 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.891269 26682 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:37.754848 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.642022 28328 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.936305 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:37.936678 28507 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.850615 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.713191 26678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2091) took 3092 ms (client timeout 1643 ms). Trace:
I20260709 13:07:37.944254 26611 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:37.961313 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.964139 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.685194 28317 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.715387 28551 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:37.641938 28036 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:37.649384 28425 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.712074 28240 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:37.939728 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.973275 26758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.059s
W20260709 13:07:37.982791 27317 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.594s	user 0.001s	sys 0.005s
W20260709 13:07:37.975288 26678 rpcz_store.cc:269] 0709 13:07:34.620804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.891086 (+270282us) service_pool.cc:224] Handling call
0709 13:07:37.713012 (+2821926us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000b4d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:37.713123 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130183552}
I20260709 13:07:37.984233 27849 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:37.933370 28549 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:37.985991 28564 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.988046 28402 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:37.988194 28374 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.002s
W20260709 13:07:37.983490 28403 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.002s
W20260709 13:07:37.990654 28544 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.003s
I20260709 13:07:37.712460 28469 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.253s
I20260709 13:07:37.933233 28545 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:37.991767 28286 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:37.993534 28287 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.000s
W20260709 13:07:38.004335 26758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.019s	sys 0.059s
I20260709 13:07:38.004711 28036 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.977011 28507 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.018321 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.041718 26761 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:38.020219 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 388189us
I20260709 13:07:38.004747 27317 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:38.011361 26605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.012s
I20260709 13:07:37.998454 28317 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.014684 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.008587 28571 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.048285 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:38.057829 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.050411 26608 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:38.052908 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.036800 28477 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.000s
I20260709 13:07:37.971608 28328 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.060632 26761 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:38.062300 28552 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.018636 28564 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:38.063726 28448 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:38.052004 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.059728 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.068014 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:38.060518 26605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.013s
I20260709 13:07:38.034955 28544 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.070066 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.097048 28248 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.065291 28286 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.118155 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.048868 28287 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.089725 28501 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.065026 28409 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:38.069425 28477 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:07:38.073392 28403 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.084978 28448 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.076650 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.009s
I20260709 13:07:38.106778 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.080780 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.118069 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1125) took 1411 ms. Trace:
I20260709 13:07:38.080579 26761 raft_consensus.cc:2376] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5. Re-sending same reply.
W20260709 13:07:38.102941 28473 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 13:07:38.087423 28499 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.054891 28036 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.058687 28549 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.094937 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:38.103742 28548 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.735s	user 0.005s	sys 0.006s
W20260709 13:07:38.107268 28560 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.399s	user 0.000s	sys 0.000s
W20260709 13:07:38.087987 28482 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.965s	user 0.005s	sys 0.009s
I20260709 13:07:38.116313 28562 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:38.096218 28564 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.115568 28577 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:38.101914 28507 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.105971 28317 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:38.169339 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.009s
I20260709 13:07:38.178499 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.182166 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.160930 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.072330 28571 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.219931 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.167786 28403 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.220885 28403 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.163573 28286 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.098719 28328 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.171424 26758 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.170675 26755 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:38.171813 26760 rpcz_store.cc:276] 0709 13:07:36.707149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.707339 (+   190us) service_pool.cc:224] Handling call
0709 13:07:36.707745 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.768295 (+ 60550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.117828 (+1349533us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b54000db6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:38.118011 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135534464}
I20260709 13:07:38.204634 26678 raft_consensus.cc:2368] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4.
I20260709 13:07:38.206544 28036 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.207381 28482 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.237702 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.238754 26678 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:38.239576 28482 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.240484 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.241112 26682 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:38.241333 26758 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.209314 28549 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.244354 28549 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:38.163169 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93087.4us
I20260709 13:07:38.247079 28513 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.165983 28409 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.177009 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:38.210888 26609 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:38.174114 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.193933 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.167064 28287 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.211493 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.167433 28477 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:38.228956 28286 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.218945 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.251266 26761 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.252848 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.219022 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.255009 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.225726 28571 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:38.231160 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 674383us
I20260709 13:07:38.257100 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.259042 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.259806 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.236446 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.262064 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1081) took 1682 ms (client timeout 1659 ms). Trace:
I20260709 13:07:38.262084 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.262614 26608 rpcz_store.cc:269] 0709 13:07:36.579743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.581368 (+  1625us) service_pool.cc:224] Handling call
0709 13:07:38.261611 (+1680243us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.261813 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048811776}
I20260709 13:07:38.252782 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.263916 26756 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.264634 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1078) took 1694 ms. Trace:
I20260709 13:07:38.265174 28422 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.265663 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.126211 28423 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.248238 26609 pending_rounds.cc:85] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 2
W20260709 13:07:38.248860 26576 leader_election.cc:336] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.855s (SENT)
I20260709 13:07:38.249626 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.171682 28544 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.265046 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.265028 26612 rpcz_store.cc:276] 0709 13:07:36.570374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.570788 (+   414us) service_pool.cc:224] Handling call
0709 13:07:38.264206 (+1693418us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400284bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.264455 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303665024}
I20260709 13:07:38.251268 28409 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.276157 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.277159 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.277468 26757 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
W20260709 13:07:38.277875 26724 connection.cc:256] RPC call timeout handler was delayed by -1.0095825670000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:07:38.280296 28562 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.281256 28562 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.284292 27902 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:38.285387 27902 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.285916 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:38.289242 28459 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.289295 28562 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.290424 28562 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:38.267838 28448 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.251302 28477 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:38.292229 28477 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:38.293413 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:38.294651 28473 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.295246 28473 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.272735 28571 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.269680 26609 pending_rounds.cc:107] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:38.299124 26609 raft_consensus.cc:2889] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.248780 28513 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.302963 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.302659 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.295629 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:38.297895 28571 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:38.295782 28473 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.317374 26611 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.310838 28571 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.315187 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.321413 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.322198 28571 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.324379 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.325155 27314 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:38.325714 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 259) took 1209 ms. Trace:
I20260709 13:07:38.326047 27314 rpcz_store.cc:276] 0709 13:07:37.116759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.117223 (+   464us) service_pool.cc:224] Handling call
0709 13:07:38.324075 (+1206852us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:38.325645 (+  1570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3617152}
I20260709 13:07:38.320140 28409 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.329879 26756 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:38.290057 28459 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.318475 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:38.337968 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.339223 28466 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:38.339684 28466 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.340063 28466 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:38.340480 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1084) took 1735 ms (client timeout 2137 ms). Trace:
I20260709 13:07:38.341086 28513 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.341835 26612 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 1.
I20260709 13:07:38.343144 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:38.335127 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:38.343873 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.344444 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:38.344792 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.345317 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 135) took 1049 ms. Trace:
W20260709 13:07:38.340870 26606 rpcz_store.cc:269] 0709 13:07:36.604649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.715601 (+110952us) service_pool.cc:224] Handling call
0709 13:07:38.340162 (+1624561us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400353254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.340306 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392578432}
I20260709 13:07:38.346233 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.330792 27902 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.351006 27320 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Advancing to term 3
I20260709 13:07:38.351341 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.352075 26606 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:38.352550 26684 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:38.352893 26684 pending_rounds.cc:85] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 2
I20260709 13:07:38.353222 26684 pending_rounds.cc:107] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:38.352938 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.353488 26684 raft_consensus.cc:2889] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.354008 26606 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:38.354533 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66906us
I20260709 13:07:38.354987 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.356020 28549 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:38.356258 26760 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:38.356462 28549 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:38.356995 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 138) took 1024 ms. Trace:
I20260709 13:07:38.357008 28549 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.357586 26760 rpcz_store.cc:276] 0709 13:07:37.332944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.313077 (+980133us) service_pool.cc:224] Handling call
0709 13:07:38.335028 (+ 21951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.356704 (+ 21676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.356925 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.360368 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:38.361109 27312 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.361450 28459 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.364666 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.365620 26685 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
W20260709 13:07:38.366082 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 802) took 1468 ms (client timeout 1911 ms). Trace:
W20260709 13:07:38.366460 26685 rpcz_store.cc:269] 0709 13:07:36.897744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.981594 (+ 83850us) service_pool.cc:224] Handling call
0709 13:07:38.364225 (+1382631us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:38.365999 (+  1774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28338432}
I20260709 13:07:38.345795 26752 rpcz_store.cc:276] 0709 13:07:37.295652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.298382 (+  2730us) service_pool.cc:224] Handling call
0709 13:07:37.304874 (+  6492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.349101 (+ 44227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.421261 (+ 72160us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.455869 (+ 34608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.476736 (+ 20867us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.479337 (+  2601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.309841 (+830504us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b180037d1a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:38.344790 (+ 34949us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54000dc0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:38.344840 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.345093 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24853,"prepare.queue_time_us":133750,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":1972,"raft.queue_time_us":200786,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":261740032,"thread_start_us":64865,"threads_started":2,"wal-append.queue_time_us":85543}
I20260709 13:07:38.368570 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.347265 26612 raft_consensus.cc:2376] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5. Re-sending same reply.
I20260709 13:07:38.369681 27314 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:38.371102 26760 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:38.372094 26606 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:38.373247 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.373360 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 770) took 1029 ms. Trace:
I20260709 13:07:38.374204 26606 raft_consensus.cc:2410] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:38.374548 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79100.7us
I20260709 13:07:38.370251 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.363149 26611 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:38.377367 28474 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:38.383215 26758 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:38.383790 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1136) took 1036 ms. Trace:
I20260709 13:07:38.373770 26756 rpcz_store.cc:276] 0709 13:07:37.346500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.372070 (+1025570us) service_pool.cc:224] Handling call
0709 13:07:38.372467 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.372921 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.372949 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.373012 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:38.373083 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.373171 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.373283 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.386765 27320 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:07:38.376820 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.384136 26758 rpcz_store.cc:276] 0709 13:07:37.347010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.240030 (+893020us) service_pool.cc:224] Handling call
0709 13:07:38.383738 (+143708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.391213 26758 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:38.391844 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 779) took 1031 ms. Trace:
I20260709 13:07:38.392200 26758 rpcz_store.cc:276] 0709 13:07:37.360275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.390357 (+1030082us) service_pool.cc:224] Handling call
0709 13:07:38.390751 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.391581 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.391771 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.387247 27320 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 2
I20260709 13:07:38.397310 27320 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:07:38.397643 27320 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.333923 28562 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.415877 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:38.396397 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.421443 26604 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 1.
I20260709 13:07:38.423272 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 769) took 1082 ms. Trace:
W20260709 13:07:38.423781 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.423719 26761 rpcz_store.cc:276] 0709 13:07:37.340418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.315888 (+975470us) service_pool.cc:224] Handling call
0709 13:07:38.370718 (+ 54830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.371120 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:38.371487 (+   367us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.422863 (+ 51376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.422952 (+    89us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:38.422996 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.423073 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.423197 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4798,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":158,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":48054,"threads_started":1}
I20260709 13:07:38.425000 28533 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.426355 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 142) took 1062 ms. Trace:
I20260709 13:07:38.427520 28428 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:38.428849 27312 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:38.429669 28513 raft_consensus.cc:1064] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:38.426798 26761 rpcz_store.cc:276] 0709 13:07:37.363921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.425366 (+1061445us) service_pool.cc:224] Handling call
0709 13:07:38.425794 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.426019 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.426051 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.426106 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:38.426132 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.426186 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.426284 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.431658 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:38.432938 28513 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.382705 28474 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:38.433714 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:38.440985 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.449164 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:38.450734 28152 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.452232 28053 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.452793 28053 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:38.453307 28053 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.398706 28473 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:38.429430 27312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 255) took 1691 ms (client timeout 1816 ms). Trace:
I20260709 13:07:38.465883 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 139) took 1119 ms. Trace:
I20260709 13:07:38.468008 28469 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.468458 28469 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:38.468843 28469 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.466325 26757 rpcz_store.cc:276] 0709 13:07:37.346694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.378314 (+1031620us) service_pool.cc:224] Handling call
0709 13:07:38.417534 (+ 39220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.459496 (+ 41962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.459537 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.465606 (+  6069us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.465647 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.465710 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.465827 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.474615 28466 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.476145 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67152.1us
I20260709 13:07:38.477044 28466 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.410331 28577 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:07:38.479067 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 797) took 1634 ms. Trace:
W20260709 13:07:38.479892 28554 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.935s	user 0.000s	sys 0.004s
I20260709 13:07:38.480449 28474 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.481709 28474 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.479436 26681 rpcz_store.cc:276] 0709 13:07:36.844197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.888928 (+ 44731us) service_pool.cc:224] Handling call
0709 13:07:38.341964 (+1453036us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:38.342290 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.342871 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.342896 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.343505 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.397273 (+ 53768us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:38.397324 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.397414 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.478631 (+ 81217us) raft_consensus.cc:1685] finished
0709 13:07:38.478652 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.478889 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4745,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":49296,"spinlock_wait_cycles":20905856,"thread_start_us":47862,"threads_started":1,"wal-append.queue_time_us":133305}
W20260709 13:07:38.489079 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.489683 28328 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.489111 26678 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:38.490303 28328 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.483153 28403 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.491818 26686 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:38.491907 26678 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:38.492617 28328 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.492744 26681 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:38.493629 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 117098us
I20260709 13:07:38.494553 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:38.496559 28519 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.497068 28519 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.489066 28562 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.505847 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 143) took 1136 ms. Trace:
I20260709 13:07:38.497560 28519 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.510756 28552 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:38.511821 28564 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.512136 28240 raft_consensus.cc:993] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:07:38.512614 28240 raft_consensus.cc:1081] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Signalling peer 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:07:38.511329 28117 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.507324 26761 rpcz_store.cc:276] 0709 13:07:37.369135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.430579 (+1061444us) service_pool.cc:224] Handling call
0709 13:07:38.430929 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.431203 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:38.431601 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.505524 (+ 73923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.505575 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.505610 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.505686 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.505795 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35284,"prepare.queue_time_us":426,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":36561,"thread_start_us":37882,"threads_started":1}
I20260709 13:07:38.517005 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:38.500028 28403 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.520259 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:38.520663 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:38.521229 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:38.521478 28555 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.184s	user 0.003s	sys 0.008s
I20260709 13:07:38.511343 28552 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.521525 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1115) took 1704 ms. Trace:
I20260709 13:07:38.521901 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 776) took 1162 ms. Trace:
I20260709 13:07:38.522871 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:07:38.550032 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 116434us
I20260709 13:07:38.548933 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 141) took 1187 ms. Trace:
W20260709 13:07:38.465564 27312 rpcz_store.cc:269] 0709 13:07:36.738307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.739253 (+   946us) service_pool.cc:224] Handling call
0709 13:07:38.360055 (+1620802us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:38.429369 (+ 69314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10142464}
I20260709 13:07:38.554237 27902 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.554874 28201 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:07:38.556232 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.557610 26756 rpcz_store.cc:276] 0709 13:07:37.362043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.410952 (+1048909us) service_pool.cc:224] Handling call
0709 13:07:38.444354 (+ 33402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.528504 (+ 84150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.528546 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.548739 (+ 20193us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.548767 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.548808 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.548883 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.561602 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 782) took 1191 ms. Trace:
I20260709 13:07:38.563226 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2110) took 1226 ms. Trace:
I20260709 13:07:38.563588 26680 rpcz_store.cc:276] 0709 13:07:37.336877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.361499 (+ 24622us) service_pool.cc:224] Handling call
0709 13:07:38.545993 (+1184494us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540025ce54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.563047 (+ 17054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209330560}
I20260709 13:07:38.568615 26761 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:38.577383 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.580170 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1141) took 1207 ms. Trace:
I20260709 13:07:38.580646 26761 rpcz_store.cc:276] 0709 13:07:37.373231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.524530 (+1151299us) service_pool.cc:224] Handling call
0709 13:07:38.559186 (+ 34656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.579888 (+ 20702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.580109 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.562397 26757 rpcz_store.cc:276] 0709 13:07:37.370596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.470565 (+1099969us) service_pool.cc:224] Handling call
0709 13:07:38.515246 (+ 44681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.515591 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:38.515994 (+   403us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.561257 (+ 45263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.561314 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:38.561360 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.561431 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.561547 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39243,"prepare.queue_time_us":2526,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":6250,"thread_start_us":41868,"threads_started":1}
I20260709 13:07:38.563951 28549 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.603073 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 126225us
I20260709 13:07:38.605397 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.610767 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:38.611229 26761 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.611927 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 783) took 1232 ms. Trace:
I20260709 13:07:38.612476 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:38.612476 26761 rpcz_store.cc:276] 0709 13:07:37.379352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.608002 (+1228650us) service_pool.cc:224] Handling call
0709 13:07:38.611027 (+  3025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.611641 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.611841 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.614241 26761 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:38.614814 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1144) took 1230 ms. Trace:
I20260709 13:07:38.615121 26761 rpcz_store.cc:276] 0709 13:07:37.384688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.613441 (+1228753us) service_pool.cc:224] Handling call
0709 13:07:38.613794 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.614548 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.614753 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.615557 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47856.1us
I20260709 13:07:38.616120 28328 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:38.616804 28583 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:07:38.616726 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.616997 28544 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.617751 26757 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:38.617861 26761 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:38.618953 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 785) took 1229 ms. Trace:
I20260709 13:07:38.619177 26757 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:38.619279 26753 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:38.619475 26761 rpcz_store.cc:276] 0709 13:07:37.389524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.616426 (+1226902us) service_pool.cc:224] Handling call
0709 13:07:38.617190 (+   764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.618552 (+  1362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.618826 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.615756 28529 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.620903 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.609157 26754 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:38.627874 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1134) took 1280 ms. Trace:
I20260709 13:07:38.629359 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.615428 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:38.628271 26754 rpcz_store.cc:276] 0709 13:07:37.341542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.347757 (+  6215us) service_pool.cc:224] Handling call
0709 13:07:38.551081 (+1203324us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:38.622112 (+ 71031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10297216}
I20260709 13:07:38.633731 26754 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:38.550134 26605 rpcz_store.cc:276] 0709 13:07:36.815208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.305218 (+490010us) service_pool.cc:224] Handling call
0709 13:07:37.305628 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.306096 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.306139 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.306764 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.373527 (+ 66763us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:38.159681 (+786154us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.160440 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.160619 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.435513 (+274894us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:38.497684 (+ 62171us) raft_consensus.cc:1685] finished
0709 13:07:38.499449 (+  1765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.519467 (+ 20018us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":304785,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9709,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":478,"spinlock_wait_cycles":285914496,"thread_start_us":782774,"threads_started":2,"wal-append.queue_time_us":125709}
I20260709 13:07:38.633847 26678 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:38.631867 28403 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.636075 26680 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:38.636909 28529 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.639621 28473 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.640399 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 772) took 1282 ms. Trace:
W20260709 13:07:38.640727 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.640862 26760 rpcz_store.cc:276] 0709 13:07:37.358421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.359044 (+1000623us) service_pool.cc:224] Handling call
0709 13:07:38.359476 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.371568 (+ 12092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.640131 (+268563us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5400139054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:38.640326 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26206976}
I20260709 13:07:38.642634 26760 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:38.642495 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:38.635185 28403 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.630084 28466 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.644017 28466 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:38.644439 28466 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.645416 28403 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.646260 26759 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.646761 27315 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:38.647692 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 764) took 1322 ms. Trace:
I20260709 13:07:38.648140 26753 rpcz_store.cc:276] 0709 13:07:37.325499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.329759 (+  4260us) service_pool.cc:224] Handling call
0709 13:07:38.618643 (+1288884us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:38.618920 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.619815 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.632282 (+ 12467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26766080}
I20260709 13:07:38.551147 26752 rpcz_store.cc:276] 0709 13:07:37.359475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.369201 (+1009726us) service_pool.cc:224] Handling call
0709 13:07:38.369700 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.370416 (+   716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.370454 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.371018 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.420108 (+ 49090us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:38.437069 (+ 16961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.441844 (+  4775us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.515376 (+ 73532us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001e6520. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3205dbe 00007f40f3210930 00007f40f32108d8 00007f40f3210858 00007f40f3210813 00007f40f320fa9c 00007f40f90fb626 00007f40f90f5dd8 00007f40f324c7cb 00007f40f324f2c0
0709 13:07:38.516535 (+  1159us) raft_consensus.cc:1685] finished
0709 13:07:38.518434 (+  1899us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.521822 (+  3388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36121472,"thread_start_us":37462,"threads_started":1,"wal-append.queue_time_us":50451}
I20260709 13:07:38.610374 28571 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.651032 28550 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.169s	user 0.005s	sys 0.008s
I20260709 13:07:38.652366 28571 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.655023 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 809) took 1516 ms. Trace:
I20260709 13:07:38.655365 26683 rpcz_store.cc:276] 0709 13:07:37.138466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.155375 (+ 16909us) service_pool.cc:224] Handling call
0709 13:07:37.155718 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.186831 (+ 31113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.186881 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.187471 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.369539 (+182068us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:37.369576 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.369636 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.648979 (+1279343us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:38.654564 (+  5585us) raft_consensus.cc:1685] finished
0709 13:07:38.654581 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.654868 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26041,"raft.queue_time_us":26246,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6360,"spinlock_wait_cycles":386132352,"thread_start_us":162395,"threads_started":1,"wal-append.queue_time_us":230732}
I20260709 13:07:38.657645 26761 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:38.657593 28053 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.659650 28264 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:38.626852 28469 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.646867 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 767) took 1320 ms. Trace:
I20260709 13:07:38.664094 26754 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:38.662213 26759 rpcz_store.cc:276] 0709 13:07:37.326436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.337850 (+ 11414us) service_pool.cc:224] Handling call
0709 13:07:38.645671 (+1307821us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:38.645934 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.646634 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.646821 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8184192}
I20260709 13:07:38.665234 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:38.677855 27286 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.880s (SENT)
I20260709 13:07:38.678464 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.680991 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.681753 28533 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.682834 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.683655 26679 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.657513 28371 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:38.681830 26680 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:38.701722 26757 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.632100 28477 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.706100 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.684442 28317 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.692324 27902 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.689352 28371 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:38.713572 26611 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.700767 28053 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:38.715101 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51247.4us
W20260709 13:07:38.715404 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.727023 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:38.719331 28417 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:38.734740 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 119420us
I20260709 13:07:38.736639 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 117) took 1349 ms. Trace:
I20260709 13:07:38.737061 26687 rpcz_store.cc:276] 0709 13:07:37.377769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.377914 (+   145us) service_pool.cc:224] Handling call
0709 13:07:37.397622 (+ 19708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.455508 (+ 57886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.455552 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.455609 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:37.455651 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.719258 (+1263607us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54000c53d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:38.719335 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.727351 (+  8016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132630272}
I20260709 13:07:38.719168 28197 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:38.740034 28585 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:07:38.719206 27902 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.751842 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:38.770442 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.772073 28423 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:38.764248 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.782330 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.797358 26680 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.727851 28317 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:38.799819 28587 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 13:07:38.799950 28590 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.801076 26683 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.801903 28469 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.802245 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.815538 26760 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.817112 28485 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.817795 28485 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.802345 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 75460.3us
I20260709 13:07:38.803125 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.820052 26604 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:07:38.806792 28559 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.087s	user 0.004s	sys 0.000s
I20260709 13:07:38.822096 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.822206 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.822800 26756 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.822927 26752 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.812525 28053 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:38.823899 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.824312 28053 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.825042 28529 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.825547 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 121) took 1716 ms. Trace:
I20260709 13:07:38.825973 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.826766 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.808081 28533 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.828068 28533 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:38.828423 28533 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:38.828760 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.829762 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:38.829416 28533 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.830341 27902 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.830695 28533 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.830916 28197 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.831686 28197 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.832253 28197 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.834156 28503 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:38.834892 28197 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:38.810889 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1086) took 2204 ms (client timeout 2373 ms). Trace:
I20260709 13:07:38.812494 28590 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:38.850976 26610 rpcz_store.cc:269] 0709 13:07:36.605105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.098492 (+493387us) service_pool.cc:224] Handling call
0709 13:07:38.809539 (+1711047us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.809765 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631316352}
I20260709 13:07:38.826817 26761 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 2.
I20260709 13:07:38.753750 28549 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.807102 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1114) took 1992 ms. Trace:
I20260709 13:07:38.840020 28378 raft_consensus.cc:1064] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:07:38.839313 28563 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.294s	user 0.002s	sys 0.000s
I20260709 13:07:38.829406 26686 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:38.822712 26759 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:38.853078 26609 rpcz_store.cc:276] 0709 13:07:36.814926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.324053 (+509127us) service_pool.cc:224] Handling call
0709 13:07:37.332294 (+  8241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.315488 (+983194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.806787 (+491299us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400163354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:38.807048 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938966912}
W20260709 13:07:38.840523 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80482.2us
W20260709 13:07:38.841017 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 89364.4us
I20260709 13:07:38.825034 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.825903 26603 rpcz_store.cc:276] 0709 13:07:37.109450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.358768 (+249318us) service_pool.cc:224] Handling call
0709 13:07:37.359078 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.359397 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.359438 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.359898 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.614668 (+254770us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:37.614729 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.614815 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.805766 (+1190951us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:38.825098 (+ 19332us) raft_consensus.cc:1685] finished
0709 13:07:38.825120 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.825383 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":898,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":6595,"spinlock_wait_cycles":172620544,"thread_start_us":254397,"threads_started":1,"wal-append.queue_time_us":359417}
I20260709 13:07:38.851419 26760 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:38.826345 28053 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.857833 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:38.857630 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:38.866201 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.867054 26756 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:38.868618 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 124441us
I20260709 13:07:38.853739 28590 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.871892 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:38.861764 28378 raft_consensus.cc:1068] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:38.868018 28577 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.877633 28472 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.877992 28485 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.877789 28371 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.880064 28317 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.854164 28519 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:38.891330 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62445.4us
I20260709 13:07:38.895519 28112 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.896938 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:38.897480 28248 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:38.897960 26680 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:38.898190 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:38.898352 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.902367 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.896733 28112 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:38.895712 28371 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:38.906415 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48605.9us
I20260709 13:07:38.905400 26760 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:38.910521 28472 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.912919 28472 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.914608 28544 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.915355 28549 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:38.915938 28549 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:38.916010 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:38.917109 28549 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.919775 28485 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.908263 28529 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.920543 28529 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.920903 28529 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.906121 26752 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:38.926112 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:38.926757 26607 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.904949 28477 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:38.943764 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:38.944479 28556 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.509s	user 0.008s	sys 0.003s
I20260709 13:07:38.945188 28469 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:38.945726 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.945672 28469 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:38.945331 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.946228 28469 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.946964 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:38.903007 28552 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:38.909499 28317 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:38.949427 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:38.956584 28588 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.165s	user 0.003s	sys 0.001s
I20260709 13:07:38.957199 26755 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:38.957726 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.958055 28551 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.949021 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.958921 26757 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:38.958607 28551 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:38.949810 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.955224 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:38.950759 28552 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:38.963459 28469 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:38.963967 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95509.9us
I20260709 13:07:38.947649 28590 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:38.968798 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.970136 28469 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:38.926143 28417 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:38.972386 27286 leader_election.cc:400] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4.
I20260709 13:07:38.973629 27286 leader_election.cc:403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.973800 26756 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:38.975281 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:38.973197 28112 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.979127 28112 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.979518 28112 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:38.956584 26752 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:38.975984 28562 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:38.984105 28562 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.984483 28562 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.985260 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.986114 26608 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:38.980159 28485 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:07:38.989003 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.989557 26608 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:38.991968 26608 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:38.994280 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:38.994571 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.979326 28053 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:07:38.996387 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:38.997141 26605 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:38.976404 28317 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:38.998708 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 777) took 1639 ms. Trace:
I20260709 13:07:38.998955 28317 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.000517 27315 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:39.001403 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.002264 26605 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:39.005704 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.006467 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:39.006505 26509 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 4, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.008188 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.012081 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:39.056545 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 85039.3us
W20260709 13:07:39.063925 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 155186us
I20260709 13:07:39.063570 28590 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.014389 26605 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:39.067024 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:38.999125 26755 rpcz_store.cc:276] 0709 13:07:37.359762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.261518 (+901756us) service_pool.cc:224] Handling call
0709 13:07:38.998484 (+736966us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400082d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:38.998652 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595442944}
I20260709 13:07:39.072441 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:39.082887 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 76102.7us
I20260709 13:07:39.084136 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.086026 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.086913 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:39.080494 28509 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4.
I20260709 13:07:38.982419 28466 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.087826 28513 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:39.089680 28466 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.090080 28485 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.090262 28513 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.090687 28485 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.091125 28485 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.092162 28378 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:39.087872 26753 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:07:39.092700 28378 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:39.092944 26753 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 2
I20260709 13:07:39.093287 26753 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:07:39.093565 26753 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.091995 28501 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.093678 28378 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.075960 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.097747 26756 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:39.072652 26509 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 3, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:39.113396 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 107074us
I20260709 13:07:39.115324 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.115219 26612 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:39.114902 26509 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.087877 28472 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.081216 28240 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.119431 26509 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 3, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:39.120239 28519 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:39.120693 28403 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:39.121883 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.122478 28473 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:39.125505 27285 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.981s (SENT)
I20260709 13:07:39.131806 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.110313 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.130354 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:39.132503 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.074595 27902 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:07:39.134714 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.135982 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.117743 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.140089 26752 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:39.143862 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:39.110286 28562 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.142124 26509 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.106920 28484 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:39.130941 28053 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.138662 28403 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:39.075114 26603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:49434
I20260709 13:07:39.153918 26603 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.154050 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:39.154305 26603 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.154520 26509 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 3, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 3 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.128073 28474 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:39.137980 28428 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.156646 28472 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:07:39.158304 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47148.7us
I20260709 13:07:39.157581 26509 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.152302 28036 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.152318 28509 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.161506 28496 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.161604 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:39.163864 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.155133 28577 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.145269 28409 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:07:39.159812 28240 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.171314 28509 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:39.160717 28428 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:39.189388 26607 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:39.180953 28551 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.156165 28371 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:07:39.182072 28509 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.197777 26509 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 3, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.260612 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:39.262305 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86645.4us
I20260709 13:07:39.177887 28378 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.196065 28428 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.271762 28403 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.272234 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.267902 28378 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:39.272822 28240 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.273551 28503 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.192484 28472 consensus_queue.cc:1243] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:39.267373 26603 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.281428 26607 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.283939 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.183063 28529 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.278249 26509 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:07:39.284642 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104375us
W20260709 13:07:39.286218 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 131169us
I20260709 13:07:39.288168 26603 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.275911 28551 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.287544 26509 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.278487 28378 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.279697 28036 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.289659 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:39.264834 28112 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.297485 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.298642 28248 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.300397 28533 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:39.304121 28562 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.304519 26752 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:39.305272 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.290191 28474 raft_consensus.cc:2764] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:39.306490 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:39.275501 27902 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:07:39.310192 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.318233 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.290418 28551 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.324280 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:39.328200 26509 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 3, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.295442 28036 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.303300 28485 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.330996 28529 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.304569 28371 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:39.342598 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.336869 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:39.337189 28473 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.340173 26754 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:39.321574 28248 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.344475 28529 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.344550 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.347406 26752 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:39.348065 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.349255 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.350018 28552 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.350276 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.350553 28552 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.351809 28264 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.352257 28264 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.353938 28485 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.354491 28485 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.355525 28371 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.355881 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.341470 28036 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.356612 28473 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.357195 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.357376 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.357954 26604 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:39.358549 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.358799 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.339562 28551 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.362603 26684 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:39.355530 26610 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:39.365051 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.341614 28513 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.356259 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.370349 28513 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.371423 26603 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:39.372440 28513 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.365785 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.373813 26610 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:39.366568 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.377674 26612 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:39.383635 26754 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.359496 26604 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.358721 28473 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.378258 28514 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.355899 28371 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:39.378489 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:39.391832 26609 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:39.393050 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.398168 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.406275 26612 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.390810 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.407152 26608 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:39.407553 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123705us
I20260709 13:07:39.413949 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:39.392688 26753 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:39.414608 26758 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.417392 28264 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.418401 28529 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.392174 28514 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.419461 28514 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.420006 28544 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.420642 28544 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.422817 28544 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:39.426249 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.426863 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.428176 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.411052 26509 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:07:39.430358 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51293.2us
I20260709 13:07:39.432523 26686 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
W20260709 13:07:39.435000 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 465415us
I20260709 13:07:39.392844 28371 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.445772 28371 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.415695 28509 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.450112 28509 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.428884 28473 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:07:39.452375 28603 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.283s	user 0.009s	sys 0.012s
I20260709 13:07:39.460908 26758 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:39.462543 26612 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:39.464068 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 133939us
I20260709 13:07:39.469811 26509 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 4, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 4 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.471316 26681 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:39.471192 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:39.483959 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.487124 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.487962 26686 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.490213 26577 leader_election.cc:400] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:07:39.490566 26577 leader_election.cc:403] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:39.405022 28428 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.494429 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.480209 28036 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.480176 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.500424 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:39.504683 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.455734 28378 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.508181 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.447515 28551 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.525002 28551 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.490327 28509 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:07:39.527091 28604 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:07:39.527690 26755 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:39.490477 28562 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:39.519940 26678 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:39.528741 28562 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:39.529119 28562 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:39.529577 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.530288 26678 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.529978 28562 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.531183 28562 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.519804 28265 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:39.492311 26509 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to <none>, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:39.532099 28265 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:39.532308 28616 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.532739 28616 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:39.533056 28265 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.533578 28616 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.534792 27320 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:39.534889 28616 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.535965 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:39.519004 26684 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:39.521405 28477 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.505596 28469 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:39.545056 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.546500 26608 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.545385 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:39.518078 28264 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:39.562621 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:39.562191 26509 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.581275 26509 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.586247 26612 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:39.542088 28477 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:39.588275 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.589480 26684 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:39.583290 26509 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 3 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.559559 28428 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:39.605286 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 150668us
I20260709 13:07:39.613457 26608 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:39.602523 27318 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:39.586030 28264 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:39.610458 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.630522 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.630720 28248 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:39.640067 28531 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:39.637401 28622 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.664389 28448 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:39.667411 26684 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:39.615370 28590 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:39.668685 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.672629 28378 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.676620 26604 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
W20260709 13:07:39.716796 28621 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:07:39.718806 28485 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:07:39.677100 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.678521 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.682857 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:39.720806 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.721894 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.722391 26683 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.642215 28264 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.724057 26682 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:07:39.706209 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 96818.9us
I20260709 13:07:39.709174 28531 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.729216 28531 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.729462 26683 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:39.730332 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53787us
I20260709 13:07:39.632194 26509 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 2, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 2 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.713357 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:39.689906 26686 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:39.730722 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:39.731087 28328 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:39.732610 26509 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.740625 26509 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:39.742401 28622 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.742107 26509 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 4, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 4 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:07:39.742888 28622 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:39.743285 28622 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.743920 28514 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.746513 27320 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:39.707296 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 111634us
I20260709 13:07:39.752525 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.754485 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:39.755764 28328 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.756342 28328 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:39.756891 28328 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:39.759119 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.766647 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:39.766512 28152 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:39.770442 26683 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:39.711370 28448 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:39.781129 26608 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.790846 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.792182 26611 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.806452 26604 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:39.812330 28448 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.814075 28448 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.816699 28248 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:39.819959 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53436us
I20260709 13:07:39.820884 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.824952 28112 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:39.801390 28514 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.789275 28633 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:39.837412 28633 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:39.837880 28633 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.784672 28469 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:39.843194 26682 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:39.848083 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:39.857923 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 355370us
I20260709 13:07:39.815294 26678 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:39.849587 28469 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.870946 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.873114 26608 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.856926 28197 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.875411 26612 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.880501 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.866142 28469 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.854766 28622 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:39.914987 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49861.4us
I20260709 13:07:39.913707 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.942087 26604 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.942337 26611 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:39.943578 26608 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
W20260709 13:07:39.921483 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47943.1us
I20260709 13:07:39.947922 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:39.950552 28622 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.951854 28531 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.952419 28477 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.953476 28477 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.954234 28531 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:39.874543 28417 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:07:39.885355 28503 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.949551 28053 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:39.913838 28328 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:39.952077 28619 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:39.957037 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.958253 28619 consensus_queue.cc:1243] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:39.960814 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79121.9us
I20260709 13:07:39.962946 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:39.961726 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.921397 26606 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.965854 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:39.965771 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.972301 27321 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:39.972759 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:39.976083 26757 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:39.976572 26681 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.962393 26605 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.962476 28635 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:39.983803 26687 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.984344 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:39.985714 26604 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:39.983489 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:39.990710 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.991473 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:39.990446 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:39.975502 28531 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:39.968003 28622 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:39.996970 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:39.986116 28403 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:39.987888 28496 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.989580 28551 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:39.989965 28409 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:39.999907 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:40.057045 26681 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.062219 28248 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:40.068994 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:39.995249 28503 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.995532 28644 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:07:39.991966 28428 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:40.069948 26761 raft_consensus.cc:606] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:39.997606 28197 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:39.994814 28531 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.073027 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97732.3us
I20260709 13:07:39.999347 26678 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:40.119076 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:40.122835 26761 raft_consensus.cc:606] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:40.123327 26761 raft_consensus.cc:614] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.070097 27321 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.998327 28635 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:40.063067 28248 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:39.998108 28473 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:40.100502 28531 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.105654 28622 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:40.111249 28551 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:40.098439 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:40.099125 28632 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.993619 28577 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:07:40.122035 27318 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:40.056087 28112 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:40.049160 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52240.4us
I20260709 13:07:40.067121 28264 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:40.095551 28409 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:40.200536 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 205761us
W20260709 13:07:40.243175 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 144812us
I20260709 13:07:40.250357 27318 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:40.254858 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:40.121522 26678 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:40.284060 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.168253 28197 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:40.244472 28632 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:40.231971 28328 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.068027 28496 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.242817 28544 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:40.293475 26651 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:40.294495 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 282444us
I20260709 13:07:40.241122 28473 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:40.235080 28503 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:07:40.296249 27318 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.303491 27318 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.280159 28112 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:40.245503 28469 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.285954 28264 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:40.306027 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:40.291461 28428 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:40.293116 28632 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:40.294746 28544 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:40.311964 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:40.242630 28551 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:40.325461 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 243745us
I20260709 13:07:40.326570 26681 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:40.364413 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52583.1us
I20260709 13:07:40.308538 28152 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:40.384766 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:40.325227 28622 raft_consensus.cc:2764] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:40.325078 28544 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.397826 28112 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:40.491223 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.379163 28152 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.595640 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 217273us
I20260709 13:07:40.613858 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:40.615407 28496 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.319053 26678 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.616640 26678 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.617420 28448 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.618057 28448 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.619928 28651 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.620633 28651 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.596330 28649 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.623235 28651 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.460615 28264 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:40.458300 28477 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.002s
I20260709 13:07:40.625784 28448 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.398975 28469 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:40.464267 28328 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:40.570962 27318 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:40.459077 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e89d788bee4a128b18985e582217d9"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:07:40.673067 28509 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:40.629428 28152 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.666982 28629 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:40.399572 28632 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.394712 28197 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.381404 28409 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:40.702162 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.674631 28328 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.709203 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 413846us
I20260709 13:07:40.676611 28622 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:40.679327 26755 raft_consensus.cc:606] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:40.673451 28667 raft_consensus.cc:2764] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:40.678040 28629 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:40.709899 28633 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.003s
I20260709 13:07:40.453509 28428 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.458660 28473 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.675762 28531 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.714196 28622 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:40.712356 28328 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.376202 28635 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.715456 28248 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:40.787542 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69695.8us
W20260709 13:07:40.790503 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.716235 26755 raft_consensus.cc:614] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.715148 28649 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:40.800917 28654 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.801561 28654 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.807169 28036 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:40.808871 28577 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:40.810685 28544 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.811053 28469 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:40.814280 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 286) took 1220 ms. Trace:
I20260709 13:07:40.825848 27320 rpcz_store.cc:276] 0709 13:07:39.592804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.593139 (+   335us) service_pool.cc:224] Handling call
0709 13:07:39.593529 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.747040 (+153511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.812515 (+1065475us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540052f8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:40.812664 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351325952}
I20260709 13:07:40.749104 28632 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.785899 28622 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:40.814618 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.827646 28469 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.835249 26678 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:40.837123 28552 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:40.814845 28636 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:40.798154 28663 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:40.836066 28661 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:40.831959 28577 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.844059 28552 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:40.844977 28629 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.848280 28653 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:40.848349 28544 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.851940 28668 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.852630 28403 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.853948 28531 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:40.855332 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:40.855600 28622 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.856561 28328 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:40.858528 28654 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:40.757687 28633 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:40.860304 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:40.960119 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 470858us
I20260709 13:07:40.997359 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.073349 26678 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:40.999401 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.073868 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:41.074105 26756 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:41.059154 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.33049e+06us
I20260709 13:07:41.069468 27321 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:41.011814 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 397993us
W20260709 13:07:40.904497 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.078646 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:40.836457 28652 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.373s	user 0.004s	sys 0.000s
I20260709 13:07:41.079990 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:41.084460 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.085237 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:41.090833 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.091599 26683 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:41.094329 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:41.095125 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:41.097234 26759 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:41.061851 28478 raft_consensus.cc:1064] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:07:40.873185 28417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.001s	sys 0.009s
I20260709 13:07:41.103719 26686 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:41.106305 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:41.107985 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.110532 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.116057 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:41.116845 26683 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.021600 28240 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.043728 28514 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.004655 28551 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.077732 28632 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.145437 26754 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:41.114012 28417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.001s	sys 0.030s
W20260709 13:07:41.125344 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52607.9us
I20260709 13:07:41.123771 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:41.128923 26759 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:41.077674 28650 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.148473 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:41.100108 26755 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:41.064821 28664 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:41.103785 28112 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.154563 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.152325 26684 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:41.156545 26759 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:41.107540 28264 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:41.153208 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:41.125960 28240 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:41.081511 28552 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.080725 28403 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.155354 26755 raft_consensus.cc:614] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:41.219503 26754 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:41.081136 28636 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.134079 28544 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:41.158138 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:41.223734 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 117497us
W20260709 13:07:41.245113 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92029.3us
I20260709 13:07:41.163358 28635 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.149672 28514 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.152360 28632 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.146018 28653 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.216255 26683 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:41.161460 28629 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:41.162462 28669 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:41.164095 28663 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:41.149895 28551 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.270160 26754 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:41.211891 28496 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.278978 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:41.258412 28197 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:41.258153 28477 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:41.216192 28650 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:41.165493 28264 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.269820 28670 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.292747 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2129) took 2275 ms (client timeout 1641 ms). Trace:
W20260709 13:07:41.293359 26609 rpcz_store.cc:269] 0709 13:07:39.009372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.009516 (+   144us) service_pool.cc:224] Handling call
0709 13:07:41.285025 (+2275509us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b5400100ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:41.285156 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133174016}
I20260709 13:07:41.162922 28112 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:41.304387 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.276415 28669 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:41.265293 28668 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:41.275983 28663 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.425698 26757 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:41.435400 26758 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:41.407002 28477 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:41.437938 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 191453us
I20260709 13:07:41.445863 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:41.440454 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:41.447974 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:41.272900 28635 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.454972 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:41.426491 28663 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.419401 28669 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.289603 28378 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:41.407496 28240 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.439988 28197 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:41.295192 28496 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.419123 28670 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.499822 26678 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:41.521215 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60592.8us
W20260709 13:07:41.552099 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.455037 28577 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:41.459954 28328 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:41.576133 26678 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:41.478077 28549 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:41.624167 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 357644us
I20260709 13:07:41.629673 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:41.479864 28531 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:41.475867 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:41.537740 28240 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.459614 28409 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:07:41.489957 28544 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:41.488793 28685 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.633631 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.669003 28544 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.680480 28685 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:41.648316 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.651986 26726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.167s (SENT) [suppressed 28 similar messages]
I20260709 13:07:41.631229 28477 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.658454 28403 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:41.658299 28416 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.363s
I20260709 13:07:41.574864 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.628991 28549 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:41.659427 26755 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:41.662004 28533 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:41.477936 28197 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.636615 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:41.679782 28227 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:41.649670 28485 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.629714 28633 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:41.645850 28679 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:07:41.731633 26759 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.000s
I20260709 13:07:41.739791 26759 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:41.695218 28681 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:07:41.694790 28678 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:07:41.750133 26756 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 13:07:41.751307 26756 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:41.753098 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:41.754019 27318 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:41.754700 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 118171us
W20260709 13:07:41.716037 28152 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.000s
I20260709 13:07:41.761868 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.760313 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.763042 26756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:41.695992 28328 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:41.712219 28227 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.724356 26753 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.779479 26684 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:41.741676 28662 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.759621 28531 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:41.788780 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.788642 28514 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:41.794610 28409 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.794795 28403 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.795109 28409 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:41.795231 28403 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:41.794710 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:41.792090 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.026s	sys 0.089s
W20260709 13:07:41.796377 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.027s	sys 0.089s
I20260709 13:07:41.796052 28403 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.741510 28552 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:41.748683 28632 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:41.723822 28485 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:41.965606 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.996352 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.762276 28633 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:41.935489 26680 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:41.865200 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:41.869985 26576 connection.cc:256] RPC call timeout handler was delayed by -1.2007769960000587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:07:41.862879 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:41.932634 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.784155 28709 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.948637 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.797045 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 720245us
W20260709 13:07:41.810181 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 97627.2us
W20260709 13:07:41.961839 28672 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
W20260709 13:07:41.874593 28673 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
I20260709 13:07:41.831270 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 133) took 2213 ms. Trace:
I20260709 13:07:42.070580 26752 raft_consensus.cc:2410] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:42.070868 26685 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:42.071085 26754 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:41.873240 28649 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.933682 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:41.962148 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2151) took 1998 ms. Trace:
I20260709 13:07:41.877193 28509 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:41.878568 28680 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.301s	user 0.000s	sys 0.000s
I20260709 13:07:41.796121 26759 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:41.861408 28674 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.405s	user 0.000s	sys 0.003s
W20260709 13:07:41.879930 28682 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:07:41.826864 28619 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.066625 28632 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.784036 28653 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.074451 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:41.796005 28409 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.888109 28662 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.784298 28227 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.081799 28700 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.962606 28694 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:07:41.790892 28328 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:41.868048 28657 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:41.780249 28152 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:42.082100 27320 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:41.932747 28691 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.932988 28496 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.078661 26686 rpcz_store.cc:276] 0709 13:07:39.617691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.786881 (+169190us) service_pool.cc:224] Handling call
0709 13:07:39.787595 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.106173 (+1318578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.830926 (+724753us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003c1c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:41.831186 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026151680}
I20260709 13:07:42.089313 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 822) took 1016 ms. Trace:
I20260709 13:07:41.844496 28654 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:41.934432 28665 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:07:42.071848 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.097611 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.098057 28685 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:41.842742 28469 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:42.100258 28670 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.100803 28669 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.000s
I20260709 13:07:42.047019 28636 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.094929 26612 rpcz_store.cc:276] 0709 13:07:39.963738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.963957 (+   219us) service_pool.cc:224] Handling call
0709 13:07:39.964399 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.977833 (+ 13434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.977854 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:39.983004 (+  5150us) log.cc:844] Serialized 52 byte log entry
0709 13:07:40.298800 (+315796us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:40.308995 (+ 10195us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.309136 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.309224 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.833251 (+1524027us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800094120. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:41.935849 (+102598us) raft_consensus.cc:1685] finished
0709 13:07:41.961845 (+ 25996us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.962062 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13967,"prepare.queue_time_us":10003,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":6178,"raft.queue_time_us":327431,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":4448,"spinlock_wait_cycles":34867072,"thread_start_us":250273,"threads_started":1,"wal-append.queue_time_us":385434}
I20260709 13:07:42.078855 28531 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:41.907918 28264 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:41.995373 28112 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:42.103407 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.007345 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2150) took 2106 ms. Trace:
I20260709 13:07:42.078169 28544 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:41.797363 28403 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.133383 28632 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:42.117264 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.071884 28633 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.083636 28649 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:42.137750 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.141870 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:42.143169 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.143586 28646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.717s	user 0.017s	sys 0.016s
I20260709 13:07:42.098534 28704 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.145879 26759 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:42.142688 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:42.128054 28668 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.155473 26752 rpcz_store.cc:276] 0709 13:07:41.072457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.086451 (+ 13994us) service_pool.cc:224] Handling call
0709 13:07:41.865004 (+778553us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:42.089214 (+224210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4252032}
I20260709 13:07:42.144106 28053 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.158910 28653 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.934132 28549 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.114044 26755 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
W20260709 13:07:42.192487 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.200681 26684 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:42.079469 28709 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:42.261405 28646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.018s	sys 0.016s
W20260709 13:07:42.190799 28682 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:42.149802 28657 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:41.875658 28622 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.151958 28409 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.160554 28477 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.290843 28477 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.293068 28477 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.295814 28696 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.296427 28696 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.297214 28633 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.298429 28696 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.284623 28549 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.301035 28709 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.304315 28715 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:42.191561 28654 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:42.191205 28691 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:42.311607 28629 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.037s	user 0.011s	sys 0.000s
I20260709 13:07:42.311951 28722 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.312533 28722 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.313380 28691 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.253458 28706 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.253830 28635 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:42.239971 26605 rpcz_store.cc:276] 0709 13:07:39.872277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.882663 (+ 10386us) service_pool.cc:224] Handling call
0709 13:07:39.924219 (+ 41556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.989997 (+ 65778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.935459 (+1945462us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54000311d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:41.978425 (+ 42966us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75955456}
I20260709 13:07:42.254431 28485 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.255640 28711 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:42.255897 28544 raft_consensus.cc:2764] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:07:42.341867 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 828) took 1227 ms. Trace:
I20260709 13:07:42.314976 28706 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.342272 26758 rpcz_store.cc:276] 0709 13:07:41.114631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.115087 (+   456us) service_pool.cc:224] Handling call
0709 13:07:41.146189 (+ 31102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.436020 (+289831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.341661 (+905641us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400200b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:42.341813 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663998720}
I20260709 13:07:42.256083 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.209419 28670 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.261549 26685 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:42.261552 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:42.264619 26678 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:42.266861 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 186097us
I20260709 13:07:42.268929 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:42.274125 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.204280 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:42.150141 28700 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.215714 28669 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.295076 28227 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.272184 28668 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.309100 28632 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.279636 28328 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.286055 28662 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.310182 26753 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:42.272349 28653 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.270387 28704 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.325865 28717 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.315081 28722 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.334287 28378 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.004s
I20260709 13:07:42.321895 28622 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.393884 28622 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.326189 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:42.396023 26752 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:42.330693 28152 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.331858 28657 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.337392 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 823) took 1264 ms. Trace:
W20260709 13:07:42.315012 28240 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.002s
I20260709 13:07:42.340140 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:42.345616 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.346151 28695 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.346774 28723 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.347030 28649 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.348707 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 154) took 1245 ms. Trace:
I20260709 13:07:42.431981 26604 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:42.343549 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:42.355448 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:42.357790 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:42.432279 26757 rpcz_store.cc:276] 0709 13:07:41.103455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.107413 (+  3958us) service_pool.cc:224] Handling call
0709 13:07:42.348554 (+1241141us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400138154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:42.348655 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626287360}
I20260709 13:07:42.433053 26758 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.433143 26678 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.433374 26680 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:42.275312 28053 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.359506 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.366246 26759 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:42.367507 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.436281 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1164) took 1005 ms. Trace:
I20260709 13:07:42.398077 28706 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.370690 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.372869 26753 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:42.373903 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.439950 27321 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:42.436625 26759 rpcz_store.cc:276] 0709 13:07:41.430496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.356579 (+926083us) service_pool.cc:224] Handling call
0709 13:07:42.365917 (+  9338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.435651 (+ 69734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.436228 (+   577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:42.440651 28714 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.441197 28714 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.391343 28717 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.443262 28714 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.439453 26685 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:42.374526 28544 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:07:42.377260 26683 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:42.363653 28551 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:42.449509 28328 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.438481 28695 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.450095 28328 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.430766 28657 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.451752 28728 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:42.452335 28728 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.447736 28622 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.454399 28649 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.380453 28700 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.456082 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.456779 26687 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:42.457353 26653 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55252 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:07:42.457716 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.390228 28197 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.463472 28227 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.390985 28704 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.357079 28696 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.399091 26752 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:42.464305 28696 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.465060 28668 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.432268 26755 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:42.466626 28696 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.466784 28669 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.400238 26760 rpcz_store.cc:276] 0709 13:07:41.072717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.072835 (+   118us) service_pool.cc:224] Handling call
0709 13:07:41.096408 (+ 23573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.112099 (+ 15691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.112144 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.127698 (+ 15554us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.427386 (+299688us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:41.427441 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.427534 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.337158 (+909624us) raft_consensus.cc:1685] finished
0709 13:07:42.337180 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.337330 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13941,"thread_start_us":265203,"threads_started":1,"wal-append.queue_time_us":1055684}
I20260709 13:07:42.469228 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.469343 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:42.470052 28714 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.470507 28714 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.436529 28654 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.472395 28714 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.472245 28654 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.458429 28409 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.474159 28409 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.474936 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:42.475823 28662 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.476190 28662 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.476588 28662 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.427112 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.478056 28661 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.352319 26686 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:42.478438 28661 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.367748 26754 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:42.479377 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1162) took 1055 ms. Trace:
I20260709 13:07:42.479709 26754 rpcz_store.cc:276] 0709 13:07:41.424309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.350295 (+925986us) service_pool.cc:224] Handling call
0709 13:07:42.365362 (+ 15067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.479147 (+113785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.479324 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:42.364627 28670 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:42.482517 28670 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.476240 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.446010 26759 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:42.447328 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 87901.4us
I20260709 13:07:42.447854 26758 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:42.448865 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.489632 28695 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.438695 28723 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.456671 28473 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:42.490588 28473 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:42.389320 28653 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.491871 28723 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.492102 28544 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.492620 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.425666 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:42.491899 28473 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.495020 26679 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.495193 28704 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:42.495383 28473 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.496065 28704 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.496739 28704 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:42.497054 28704 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:42.446640 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:42.462767 28717 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.449553 28152 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:42.497854 28704 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.463878 28328 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:42.362744 28663 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.887s	user 0.004s	sys 0.008s
I20260709 13:07:42.478811 28661 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.463130 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 869) took 1387 ms. Trace:
I20260709 13:07:42.486685 28053 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.499351 26681 rpcz_store.cc:276] 0709 13:07:41.075818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.075959 (+   141us) service_pool.cc:224] Handling call
0709 13:07:41.076324 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.076583 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:41.276454 (+199871us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.462623 (+1186169us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800368980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:07:42.462819 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.462866 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:42.462911 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.462972 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.463078 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17749,"prepare.queue_time_us":396108,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":21852,"raft.queue_time_us":756,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":4587904,"thread_start_us":520507,"threads_started":2,"wal-append.queue_time_us":1061628}
I20260709 13:07:42.498306 28152 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:42.501755 28152 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.499073 28663 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.504040 28663 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.504307 28704 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.460369 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.522049 26678 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:42.470696 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:42.523993 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.525156 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.525799 27318 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:42.526582 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:42.527407 26759 raft_consensus.cc:2410] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:42.527470 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.532330 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.533118 26679 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:07:42.533928 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 74330.1us
I20260709 13:07:42.535504 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 865) took 1463 ms. Trace:
W20260709 13:07:42.537072 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66456.5us
I20260709 13:07:42.537084 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.537778 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.537988 26609 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:42.539274 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:42.539806 27320 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:42.540901 26679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 859) took 2568 ms (client timeout 1557 ms). Trace:
I20260709 13:07:42.541544 26608 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:42.536101 26682 rpcz_store.cc:276] 0709 13:07:41.071883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.072018 (+   135us) service_pool.cc:224] Handling call
0709 13:07:41.093489 (+ 21471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.093758 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:41.244142 (+150384us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.886783 (+642641us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.393404 (+506621us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b1800368b00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:07:42.535186 (+141782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.535233 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.535275 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.535354 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.535453 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55306,"prepare.queue_time_us":653249,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":114,"raft.queue_time_us":829899,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":9209,"spinlock_wait_cycles":46177664,"thread_start_us":771370,"threads_started":3,"wal-append.queue_time_us":898100}
I20260709 13:07:42.544436 28240 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.544975 28240 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.546449 28240 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:42.547235 26724 connection.cc:256] RPC call timeout handler was delayed by -2.0613446460000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:07:42.541368 26679 rpcz_store.cc:269] 0709 13:07:39.965685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.966837 (+  1152us) service_pool.cc:224] Handling call
0709 13:07:42.425459 (+2458622us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:42.533712 (+108253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6235008}
I20260709 13:07:42.513509 26761 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:42.548657 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.549093 26756 raft_consensus.cc:606] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:42.549465 26756 raft_consensus.cc:614] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:42.552147 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.552587 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.552914 26606 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:42.554706 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.476161 28409 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.556927 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.557053 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.540562 28667 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:42.538166 28053 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.572387 28700 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:42.558463 28549 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:42.537971 28551 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:42.573473 28197 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:42.590521 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55781.7us
I20260709 13:07:42.573935 28630 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.576787 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.591810 26609 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:42.551570 28533 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.585106 26606 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:42.559012 28544 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:42.588294 26610 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:42.588886 27320 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:42.593050 27318 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:42.594478 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:42.598388 27286 leader_election.cc:336] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.703s (SENT)
I20260709 13:07:42.604357 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.604435 26609 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:42.556241 28240 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:42.579627 28622 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:42.600751 26603 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:42.602115 26607 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:42.597621 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.582304 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.604976 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.611627 26606 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:42.586524 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:42.614300 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.591259 28700 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.595345 28549 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.614288 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:42.613787 28650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.017s	sys 0.041s
I20260709 13:07:42.595247 28533 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:42.625636 28650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.018s	sys 0.041s
I20260709 13:07:42.626159 28533 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:42.626842 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.627444 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.628582 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.600174 28551 consensus_queue.cc:1243] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:42.620806 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.628772 28735 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.629841 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.630967 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.631836 28636 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:42.632324 28636 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.632382 28693 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:07:42.633333 28693 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:42.633659 28240 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:42.634047 28693 consensus_queue.cc:1243] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:42.634059 28240 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.634683 28551 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:42.635083 28551 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.457653 26653 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55252 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 887)
I20260709 13:07:42.635388 28240 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.635936 28551 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.637512 28551 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.637387 28240 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.640165 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:42.640834 27316 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.642189 28708 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.633337 28636 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.631345 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.600036 28197 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:42.645030 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:42.652187 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.653211 26606 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:42.654331 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.637451 26653 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55264 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 887)
W20260709 13:07:42.659590 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.629076 28669 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:42.646833 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:42.604116 28630 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.625640 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.591411 28661 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.669082 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.624413 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.664835 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:42.614115 28707 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:42.612702 28544 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:42.683939 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.647696 28691 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:42.622943 28112 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:42.648485 28328 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:42.663903 28469 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:42.690029 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:42.664362 28630 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.614292 28622 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.691648 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.670861 28714 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:07:42.666190 28053 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.703312 26610 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:42.704409 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.682898 28663 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.651316 28378 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:42.711009 28533 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.683123 28735 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.709748 28700 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:42.714721 28734 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:42.689265 28691 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.682874 28649 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:42.707348 28663 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.716765 28663 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.722326 28662 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.723852 26607 raft_consensus.cc:2368] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:42.664664 28693 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:42.689137 28112 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:42.687587 28328 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:42.735524 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36840 (request call id 19) took 1184 ms. Trace:
I20260709 13:07:42.715512 28691 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.699321 28469 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:42.736047 26756 rpcz_store.cc:276] 0709 13:07:41.540140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.762891 (+222751us) service_pool.cc:224] Handling call
0709 13:07:42.724388 (+961497us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b5400225454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328a853 00007f40f825860a 00007f40f17de7d4 00007f40f17de762 00007f40f17de691 00007f40f17de60c 00007f40f17dd8c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:42.724523 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805968640}
I20260709 13:07:42.731770 28669 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:42.747084 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102538us
W20260709 13:07:42.747929 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 63049.8us
I20260709 13:07:42.743410 28328 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.737761 28735 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.771466 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:42.755852 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:42.769755 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:42.790198 28708 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.751930 28469 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.794323 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:42.797757 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:42.807916 26756 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.796975 28662 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.755069 28197 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.815416 26756 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:42.821487 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:42.824820 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 55214.5us
I20260709 13:07:42.796687 28533 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.753767 28663 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.797449 28669 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:42.751247 28549 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:42.847133 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 489421us
I20260709 13:07:42.885517 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:42.886981 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.887916 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:42.889063 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 818) took 1892 ms (client timeout 1680 ms). Trace:
W20260709 13:07:42.889632 26761 rpcz_store.cc:269] 0709 13:07:40.996815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.996976 (+   161us) service_pool.cc:224] Handling call
0709 13:07:42.888887 (+1891911us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400225454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:42.888996 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117731072}
I20260709 13:07:42.890985 28328 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.892011 28663 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.894706 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:42.895505 28712 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.720s	user 0.008s	sys 0.000s
I20260709 13:07:42.887326 26604 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:42.877386 28723 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.887946 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.898226 28747 raft_consensus.cc:2764] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:42.889115 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.935227 27315 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:42.935442 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.936290 27312 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:07:42.937745 28739 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:07:42.938619 28667 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:42.939239 28667 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.939595 28622 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:42.799297 28112 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.900556 26608 raft_consensus.cc:1217] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:07:42.944593 26608 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:42.901739 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.945207 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:42.945649 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:42.902746 27314 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:42.946151 28469 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.843813 28632 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:42.905159 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.794548 28544 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.911763 28728 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.872207 28707 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:42.950477 26611 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:42.950937 28707 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:42.951056 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:42.951901 28707 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.952787 28723 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.955261 28661 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:42.912242 28669 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:42.957608 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:42.959070 28473 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.959718 28473 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:42.960656 26756 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:42.912662 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 143765us
W20260709 13:07:42.919606 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.815864 28700 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:07:42.804909 28735 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:43.008939 28747 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.009263 28630 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:43.011560 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.012413 26681 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:43.014232 28741 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:07:43.014959 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.009164 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.022734 26606 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:42.930589 27316 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:07:43.044602 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.088685 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.133038 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.166884 28622 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.167680 28622 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:43.041903 28661 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:07:43.162276 28632 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:43.223827 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:43.239866 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:43.203125 28708 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:43.215613 28112 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:43.263801 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.265818 26759 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:43.245329 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.267455 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.267505 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.267853 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.289397 26758 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:07:43.276789 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.283463 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:43.230805 28700 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:43.286161 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.286978 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.297196 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.297480 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.297837 26759 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:43.298049 26679 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:43.286506 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.297224 28663 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.300665 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.287047 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.237771 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:43.275002 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 835) took 1384 ms. Trace:
I20260709 13:07:43.229707 28240 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:07:43.301741 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64086.5us
I20260709 13:07:43.301685 26757 rpcz_store.cc:276] 0709 13:07:41.890920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.433472 (+542552us) service_pool.cc:224] Handling call
0709 13:07:42.459979 (+ 26507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.484335 (+ 24356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.484380 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.484926 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.580238 (+ 95312us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.682448 (+102210us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.755615 (+ 73167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.755762 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.937098 (+181336us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:42.939229 (+  2131us) raft_consensus.cc:1685] finished
0709 13:07:42.939329 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.274923 (+335594us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127197,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":239320,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":233,"spinlock_wait_cycles":23938432,"thread_start_us":258435,"threads_started":3,"wal-append.queue_time_us":247942}
I20260709 13:07:43.230818 28747 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:07:43.266031 28328 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:43.285495 28514 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.310874 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.230037 28632 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:43.313215 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.308641 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.320067 26678 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.320055 26679 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.320990 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.314009 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.316741 26682 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:43.322335 26756 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:43.309886 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:43.294627 28700 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.320320 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.324354 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.324530 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2152) took 1028 ms. Trace:
I20260709 13:07:43.325057 26682 rpcz_store.cc:276] 0709 13:07:42.307872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.293474 (+985602us) service_pool.cc:224] Handling call
0709 13:07:43.324434 (+ 30960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.326426 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.312736 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.328251 26687 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.329258 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.331465 26612 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:43.332659 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.333887 26609 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:43.334127 26678 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.340059 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.340948 26679 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.342139 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.343420 26679 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:43.345423 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.346304 26679 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:43.349810 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.359148 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.369833 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.312991 28469 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:43.273419 28708 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:43.398581 26612 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:07:43.372992 26726 leader_election.cc:336] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.509s (SENT)
I20260709 13:07:43.681640 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 883) took 1257 ms. Trace:
I20260709 13:07:43.681974 26609 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:43.682813 26679 rpcz_store.cc:276] 0709 13:07:42.424073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.345109 (+921036us) service_pool.cc:224] Handling call
0709 13:07:43.681583 (+336474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.683509 26603 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:43.679978 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.676205 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.565266 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:43.684501 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 885) took 1255 ms. Trace:
I20260709 13:07:43.684870 26682 rpcz_store.cc:276] 0709 13:07:42.429501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.325888 (+896387us) service_pool.cc:224] Handling call
0709 13:07:43.684447 (+358559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.370708 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:43.681036 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.421792 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.638335 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.403024 26678 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:43.682013 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:43.387928 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.308138 28756 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:43.681206 26758 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:43.688457 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.689450 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2143) took 1396 ms. Trace:
I20260709 13:07:43.689800 26678 rpcz_store.cc:276] 0709 13:07:42.293385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.320759 (+1027374us) service_pool.cc:224] Handling call
0709 13:07:43.689397 (+368638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.692894 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:43.694756 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:43.696717 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.698323 26610 raft_consensus.cc:2368] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
W20260709 13:07:43.700038 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.705092 27319 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 1 LEARNER]: Advancing to term 3
W20260709 13:07:43.706547 28667 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.000s
I20260709 13:07:43.706995 28667 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:43.708032 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.714593 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:43.715238 26759 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:43.716188 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 343219us
I20260709 13:07:43.715797 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.713613 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.336295 28700 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.717612 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:43.486306 28197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.032s	sys 0.045s
W20260709 13:07:43.720122 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.721750 26678 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.331414 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.725313 26756 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:43.718561 26682 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.733570 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.733534 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.374764 28689 raft_consensus.cc:2764] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:43.732589 26726 leader_election.cc:336] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.548s (SENT)
I20260709 13:07:43.816057 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:43.738866 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:43.817842 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:43.818374 26758 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.818209 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.819164 26682 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:43.776640 26609 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.613801 28735 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:43.777971 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.820591 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.822182 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.822607 28632 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:43.824869 26609 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:43.693706 28750 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:43.726951 28704 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.179s	user 0.009s	sys 0.011s
W20260709 13:07:43.731715 28197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.032s	sys 0.056s
I20260709 13:07:43.780674 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.549728 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2154) took 1027 ms. Trace:
I20260709 13:07:43.373814 28663 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:43.783878 26759 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.839757 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.840378 26683 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:43.826589 28691 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.071s	user 0.009s	sys 0.002s
I20260709 13:07:43.779306 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.692564 28756 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:43.713366 28667 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:43.844048 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.731930 28469 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:43.724045 28754 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:43.805871 28264 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:43.787588 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.845798 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:43.807641 26678 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:43.846517 26759 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:43.828101 26603 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.847368 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.848477 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.830482 28763 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:43.831210 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2169) took 1220 ms. Trace:
I20260709 13:07:43.838454 26610 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.317880 28748 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.401s
I20260709 13:07:43.863370 26607 rpcz_store.cc:276] 0709 13:07:42.611075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.616235 (+  5160us) service_pool.cc:224] Handling call
0709 13:07:43.830961 (+1214726us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b540017aa54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:43.831133 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120988544}
W20260709 13:07:43.840859 26683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2165) took 1454 ms (client timeout 1555 ms). Trace:
W20260709 13:07:43.872439 26683 rpcz_store.cc:269] 0709 13:07:42.386505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.827449 (+1440944us) service_pool.cc:224] Handling call
0709 13:07:43.840806 (+ 13357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.693265 28240 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.844178 26612 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:43.323843 28514 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:43.844674 26609 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.811825 26679 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:43.846450 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2151) took 1551 ms. Trace:
I20260709 13:07:43.819787 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 892) took 1183 ms. Trace:
I20260709 13:07:43.839192 28689 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:43.874636 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.891115 26612 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
W20260709 13:07:43.892187 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.838083 28690 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.830835 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:43.895262 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.895431 26756 raft_consensus.cc:2376] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5. Re-sending same reply.
I20260709 13:07:43.896003 26609 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:43.849330 26604 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.847970 26603 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.875649 26682 rpcz_store.cc:276] 0709 13:07:42.637048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.817865 (+1180817us) service_pool.cc:224] Handling call
0709 13:07:43.819715 (+  1850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.875023 26678 rpcz_store.cc:276] 0709 13:07:42.295443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.712283 (+1416840us) service_pool.cc:224] Handling call
0709 13:07:43.846396 (+134113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.898141 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.899055 26678 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:43.861045 26611 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:43.873504 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.870971 26759 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:43.899889 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.900429 26678 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:43.875057 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2141) took 1582 ms. Trace:
I20260709 13:07:43.847631 28756 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.901085 26679 rpcz_store.cc:276] 0709 13:07:42.292847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.696478 (+1403631us) service_pool.cc:224] Handling call
0709 13:07:43.874996 (+178518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.901389 26683 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:43.901974 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.849651 28264 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:43.907279 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.908216 26679 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:43.908638 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 138) took 1476 ms. Trace:
I20260709 13:07:43.908998 26679 rpcz_store.cc:276] 0709 13:07:42.432657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.906992 (+1474335us) service_pool.cc:224] Handling call
0709 13:07:43.908572 (+  1580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.909983 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.910900 26678 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:43.912107 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.912829 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2146) took 1618 ms. Trace:
I20260709 13:07:43.913166 26679 rpcz_store.cc:276] 0709 13:07:42.294100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.911874 (+1617774us) service_pool.cc:224] Handling call
0709 13:07:43.912778 (+   904us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:43.917781 26687 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 13:07:43.918283 26687 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:43.918954 26687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2138) took 1626 ms (client timeout 2117 ms). Trace:
W20260709 13:07:43.919342 26687 rpcz_store.cc:269] 0709 13:07:42.292085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.293525 (+1001440us) service_pool.cc:224] Handling call
0709 13:07:43.918878 (+625353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.920651 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.921295 26603 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:43.922058 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2148) took 1627 ms. Trace:
I20260709 13:07:43.922492 26678 rpcz_store.cc:276] 0709 13:07:42.294584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.909708 (+1615124us) service_pool.cc:224] Handling call
0709 13:07:43.922003 (+ 12295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.923370 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.924067 26678 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:43.924537 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2142) took 1631 ms. Trace:
I20260709 13:07:43.924865 26678 rpcz_store.cc:276] 0709 13:07:42.293134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.923145 (+1630011us) service_pool.cc:224] Handling call
0709 13:07:43.924489 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.925694 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.926291 26678 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.890491 28766 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:43.928093 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.944900 26687 raft_consensus.cc:2376] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:43.851985 28691 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:43.930397 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.947162 26682 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:43.929652 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.933863 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.937505 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.947716 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2160) took 1562 ms. Trace:
I20260709 13:07:43.948709 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2127) took 1956 ms. Trace:
I20260709 13:07:43.948679 26682 rpcz_store.cc:276] 0709 13:07:42.385232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.903647 (+1518415us) service_pool.cc:224] Handling call
0709 13:07:43.947647 (+ 44000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.949163 26679 rpcz_store.cc:276] 0709 13:07:41.992345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.933640 (+1941295us) service_pool.cc:224] Handling call
0709 13:07:43.948657 (+ 15017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.949784 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.950071 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.950640 26679 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:43.950661 26682 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:43.951601 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2121) took 2018 ms. Trace:
I20260709 13:07:43.951637 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.952147 26682 rpcz_store.cc:276] 0709 13:07:41.933622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.949526 (+2015904us) service_pool.cc:224] Handling call
0709 13:07:43.951545 (+  2019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.952510 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 139) took 1512 ms. Trace:
I20260709 13:07:43.928287 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.953086 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.953459 26683 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.953868 26682 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:43.954306 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2129) took 1860 ms. Trace:
I20260709 13:07:43.954632 26682 rpcz_store.cc:276] 0709 13:07:42.094234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.952838 (+1858604us) service_pool.cc:224] Handling call
0709 13:07:43.954257 (+  1419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.947697 26758 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:43.949817 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:43.941231 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:43.945544 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2130) took 1814 ms. Trace:
I20260709 13:07:43.955734 28765 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:43.955789 26687 rpcz_store.cc:276] 0709 13:07:42.131573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.927808 (+1796235us) service_pool.cc:224] Handling call
0709 13:07:43.945491 (+ 17683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.956342 28765 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.956782 28765 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.956912 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:43.958220 26687 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:43.958699 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2128) took 1911 ms. Trace:
W20260709 13:07:43.940374 27286 leader_election.cc:336] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.747s (SENT)
I20260709 13:07:43.952890 26679 rpcz_store.cc:276] 0709 13:07:42.439808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.951359 (+1511551us) service_pool.cc:224] Handling call
0709 13:07:43.952465 (+  1106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:43.948345 26686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 889) took 1492 ms (client timeout 1823 ms). Trace:
W20260709 13:07:43.960134 26686 rpcz_store.cc:269] 0709 13:07:42.456447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.937155 (+1480708us) service_pool.cc:224] Handling call
0709 13:07:43.948291 (+ 11136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.893224 28240 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:43.960589 26679 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:43.955485 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:43.961218 26686 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:43.961562 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2149) took 1666 ms. Trace:
I20260709 13:07:43.961846 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2134) took 1683 ms. Trace:
I20260709 13:07:43.962023 26682 rpcz_store.cc:276] 0709 13:07:42.294853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.955252 (+1660399us) service_pool.cc:224] Handling call
0709 13:07:43.961494 (+  6242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.962265 26686 rpcz_store.cc:276] 0709 13:07:42.278279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.960793 (+1682514us) service_pool.cc:224] Handling call
0709 13:07:43.961048 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.961632 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.961797 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.964733 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2132) took 1756 ms. Trace:
I20260709 13:07:43.965131 26679 rpcz_store.cc:276] 0709 13:07:42.208509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.959994 (+1751485us) service_pool.cc:224] Handling call
0709 13:07:43.960324 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.963708 (+  3384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.964668 (+   960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.959689 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:43.965844 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:43.966359 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2137) took 1671 ms. Trace:
I20260709 13:07:43.966495 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 897) took 1003 ms. Trace:
I20260709 13:07:43.959012 26687 rpcz_store.cc:276] 0709 13:07:42.047025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.957745 (+1910720us) service_pool.cc:224] Handling call
0709 13:07:43.958025 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.958495 (+   470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.958655 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.966835 26683 rpcz_store.cc:276] 0709 13:07:42.963186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.902006 (+938820us) service_pool.cc:224] Handling call
0709 13:07:43.966443 (+ 64437us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:43.967036 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 234474us
W20260709 13:07:43.968148 26726 leader_election.cc:336] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.555s (SENT)
I20260709 13:07:43.968660 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:43.969220 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2147) took 1674 ms. Trace:
I20260709 13:07:43.970628 26687 rpcz_store.cc:276] 0709 13:07:42.294346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.967642 (+1673296us) service_pool.cc:224] Handling call
0709 13:07:43.968009 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.968160 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.968195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.968248 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:43.968310 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.968380 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.968494 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4096}
I20260709 13:07:43.933960 27316 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:43.874940 28763 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:43.903422 28690 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.009379 26760 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:44.018399 28761 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:07:44.019519 28773 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:44.020991 28773 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.021799 28773 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.024732 28748 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:44.027483 28759 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:07:44.029681 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 275) took 1159 ms. Trace:
I20260709 13:07:44.030146 27315 rpcz_store.cc:276] 0709 13:07:42.869911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.935930 (+ 66019us) service_pool.cc:224] Handling call
0709 13:07:43.306788 (+370858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.792380 (+485592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.796469 (+  4089us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.804181 (+  7712us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.921120 (+116939us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:43.927545 (+  6425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.932551 (+  5006us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.029429 (+ 96878us) raft_consensus.cc:1685] finished
0709 13:07:44.029457 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.029616 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":477425,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5700,"thread_start_us":467833,"threads_started":2,"wal-append.queue_time_us":200131}
I20260709 13:07:43.973001 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:44.046483 27320 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.013523 26611 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:44.041579 28691 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:44.041958 28690 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:43.839582 26605 rpcz_store.cc:276] 0709 13:07:42.522622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.532122 (+  9500us) service_pool.cc:224] Handling call
0709 13:07:42.575832 (+ 43710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.576073 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:42.752197 (+176124us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.324364 (+572167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.331624 (+  7260us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:43.359008 (+ 27384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.387815 (+ 28807us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.487964 (+100149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14569,"prepare.queue_time_us":161773,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":772,"raft.queue_time_us":42048,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":25343,"spinlock_wait_cycles":7760768,"thread_start_us":640577,"threads_started":2,"wal-append.queue_time_us":547694}
I20260709 13:07:44.043601 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:43.946657 28689 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.081230 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 294) took 1526 ms. Trace:
W20260709 13:07:43.972504 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 277798us
I20260709 13:07:44.051929 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:44.054169 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 113816us
I20260709 13:07:43.972811 26679 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:44.085203 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 878) took 1730 ms. Trace:
I20260709 13:07:44.085659 26679 rpcz_store.cc:276] 0709 13:07:42.354467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.968788 (+1614321us) service_pool.cc:224] Handling call
0709 13:07:43.969120 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.084870 (+115750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.085132 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.059744 26610 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:43.966806 26682 rpcz_store.cc:276] 0709 13:07:42.291815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.962813 (+1670998us) service_pool.cc:224] Handling call
0709 13:07:43.963135 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.963325 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.963360 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.963410 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:43.963456 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.963522 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.963636 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:44.068073 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99961.2us
I20260709 13:07:44.074575 26678 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:44.088492 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 881) took 1711 ms. Trace:
I20260709 13:07:43.968155 26683 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.086961 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.081637 27321 rpcz_store.cc:276] 0709 13:07:42.554605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.554807 (+   202us) service_pool.cc:224] Handling call
0709 13:07:44.043442 (+1488635us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:44.081168 (+ 37726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32802176}
I20260709 13:07:44.100991 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2150) took 1805 ms. Trace:
I20260709 13:07:44.101742 26679 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:44.051754 28773 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:44.017139 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 284) took 1345 ms. Trace:
I20260709 13:07:44.105504 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:43.960681 28708 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.103636 26682 rpcz_store.cc:276] 0709 13:07:42.377317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.087735 (+1710418us) service_pool.cc:224] Handling call
0709 13:07:44.088038 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.088210 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.088234 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.088273 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.088301 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.088350 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.088442 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:43.932924 28663 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.088667 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2158) took 1704 ms. Trace:
I20260709 13:07:44.154050 26678 rpcz_store.cc:276] 0709 13:07:42.384707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.925489 (+1540782us) service_pool.cc:224] Handling call
0709 13:07:44.088596 (+163107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.118731 27320 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:44.120729 26682 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:44.122872 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.125319 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.126833 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.156850 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.156930 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.104326 26683 rpcz_store.cc:276] 0709 13:07:42.295166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.967759 (+1672593us) service_pool.cc:224] Handling call
0709 13:07:43.968002 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.100653 (+132651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.100915 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.133428 26679 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.156550 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2156) took 1772 ms. Trace:
I20260709 13:07:44.168350 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2155) took 1784 ms. Trace:
I20260709 13:07:44.168830 26679 rpcz_store.cc:276] 0709 13:07:42.383890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.105619 (+1721729us) service_pool.cc:224] Handling call
0709 13:07:44.105885 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.168003 (+ 62118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.168281 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:44.170534 26651 connection.cc:256] RPC call timeout handler was delayed by -1.4145346550000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:07:44.171020 26651 connection.cc:256] RPC call timeout handler was delayed by -1.296634655000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:07:44.171376 26651 connection.cc:256] RPC call timeout handler was delayed by -1.2687346550000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:07:44.171765 26651 connection.cc:256] RPC call timeout handler was delayed by -1.0788346550000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:07:44.167485 26682 rpcz_store.cc:276] 0709 13:07:42.384210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.120145 (+1735935us) service_pool.cc:224] Handling call
0709 13:07:44.120442 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.156316 (+ 35874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.156501 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.179347 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:44.186697 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:44.109864 26609 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:44.193022 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:44.196600 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 135) took 1809 ms. Trace:
I20260709 13:07:44.197129 26682 rpcz_store.cc:276] 0709 13:07:42.387277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.174578 (+1787301us) service_pool.cc:224] Handling call
0709 13:07:44.174962 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.175180 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.175218 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.196203 (+ 20985us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.196281 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.196369 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.196526 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.199266 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 136) took 1811 ms. Trace:
I20260709 13:07:43.965786 28766 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:44.222880 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.208197 26683 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.225207 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2159) took 1840 ms. Trace:
I20260709 13:07:44.225641 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:07:44.227051 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 142560us
I20260709 13:07:44.225550 26683 rpcz_store.cc:276] 0709 13:07:42.384964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.159578 (+1774614us) service_pool.cc:224] Handling call
0709 13:07:44.207967 (+ 48389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.224917 (+ 16950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.225149 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.209092 26678 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:44.239007 26678 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:44.270248 26682 rpcz_store.cc:276] 0709 13:07:42.387562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.198280 (+1810718us) service_pool.cc:224] Handling call
0709 13:07:44.198654 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.198857 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.198894 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.198950 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.198998 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.199066 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.199199 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.273486 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 884) took 1847 ms. Trace:
I20260709 13:07:44.276441 26682 rpcz_store.cc:276] 0709 13:07:42.426462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.272011 (+1845549us) service_pool.cc:224] Handling call
0709 13:07:44.272447 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.272681 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.272719 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.273132 (+   413us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:44.273179 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.273258 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.273411 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:44.284121 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 91172.1us
I20260709 13:07:44.285148 26682 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.285274 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:44.286291 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 887) took 1848 ms. Trace:
I20260709 13:07:44.287392 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.287685 26682 rpcz_store.cc:276] 0709 13:07:42.438196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.284341 (+1846145us) service_pool.cc:224] Handling call
0709 13:07:44.284898 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.285904 (+  1006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.286223 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.288446 26684 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:44.289026 26684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2133) took 2034 ms (client timeout 1555 ms). Trace:
I20260709 13:07:44.290076 26679 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:44.290594 26679 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:44.289484 26684 rpcz_store.cc:269] 0709 13:07:42.263341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.339503 (+ 76162us) service_pool.cc:224] Handling call
0709 13:07:44.287259 (+1947756us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016beee 0000000000375939 00007f40f81df1e0 00007f40f82a80c4 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:44.288956 (+  1697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17584640}
I20260709 13:07:44.167825 28708 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.296176 26678 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:43.964538 28264 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.189448 28667 raft_consensus.cc:2764] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:44.189716 28197 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:44.293525 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 64048us
W20260709 13:07:44.307633 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57461.6us
I20260709 13:07:44.188840 27319 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:44.302727 26683 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.097401 28689 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:44.326078 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.328608 26678 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:44.336661 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:44.338032 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 882) took 1935 ms. Trace:
I20260709 13:07:44.338521 26683 rpcz_store.cc:276] 0709 13:07:42.402664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.239134 (+1836470us) service_pool.cc:224] Handling call
0709 13:07:44.302463 (+ 63329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.332168 (+ 29705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.337969 (+  5801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.223587 28704 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.320541 26679 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.287335 28632 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.349828 26758 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:44.288695 28661 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.293131 28747 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.298605 28735 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.353541 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 293) took 1809 ms. Trace:
W20260709 13:07:44.348866 28768 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.373s	user 0.001s	sys 0.001s
I20260709 13:07:44.355799 28747 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.354305 28689 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:44.358763 26678 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:44.360240 26679 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.321501 28774 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:07:44.391129 28747 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:44.391611 26678 pending_rounds.cc:85] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 2
I20260709 13:07:44.408272 26679 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:44.414474 26678 pending_rounds.cc:107] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:44.414532 26679 pending_rounds.cc:85] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 2
I20260709 13:07:44.415462 26678 raft_consensus.cc:2889] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.415591 26679 pending_rounds.cc:107] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:44.395344 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2140) took 2102 ms. Trace:
I20260709 13:07:44.416172 26679 raft_consensus.cc:2889] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.416513 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2157) took 2032 ms. Trace:
I20260709 13:07:44.417212 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2163) took 2031 ms. Trace:
I20260709 13:07:44.399695 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 879) took 2035 ms. Trace:
I20260709 13:07:44.416204 26686 rpcz_store.cc:276] 0709 13:07:42.292588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.963208 (+1670620us) service_pool.cc:224] Handling call
0709 13:07:43.963480 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.010080 (+ 46600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.010124 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.050422 (+ 40298us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.218541 (+168119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:44.218597 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.218693 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.395075 (+176382us) raft_consensus.cc:1685] finished
0709 13:07:44.395096 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.395271 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18885,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":38981,"thread_start_us":111957,"threads_started":1,"wal-append.queue_time_us":312285}
I20260709 13:07:44.417982 26687 rpcz_store.cc:276] 0709 13:07:42.363930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.060959 (+1697029us) service_pool.cc:224] Handling call
0709 13:07:44.061415 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.068554 (+  7139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.068666 (+   112us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.097070 (+ 28404us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.309109 (+212039us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:44.309146 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.309212 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.399393 (+ 90181us) raft_consensus.cc:1685] finished
0709 13:07:44.399422 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.399591 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19403,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8210,"thread_start_us":16202,"threads_started":1,"wal-append.queue_time_us":287302}
I20260709 13:07:44.419974 26679 rpcz_store.cc:276] 0709 13:07:42.386030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.169741 (+1783711us) service_pool.cc:224] Handling call
0709 13:07:44.170099 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.416970 (+246871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.417156 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.417265 26678 rpcz_store.cc:276] 0709 13:07:42.384465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.154923 (+1770458us) service_pool.cc:224] Handling call
0709 13:07:44.155313 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.416228 (+260915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.416442 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.347034 28264 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:44.442456 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 157308us
I20260709 13:07:44.330719 28708 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.383987 28667 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:44.446949 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 121382us
I20260709 13:07:44.452617 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.453008 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.453876 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.454272 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.455230 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.455456 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.455793 26686 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:44.456038 26683 raft_consensus.cc:2376] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.456339 26682 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:44.434566 28735 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:44.457105 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.465121 26679 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.458057 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:44.465034 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 128465us
I20260709 13:07:44.442866 28661 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:44.459164 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.468561 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.468658 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:44.468995 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.469151 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.460850 28764 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.463228 26687 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.454457 26678 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:44.361536 28632 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.473239 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.470016 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.473829 26686 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:44.473824 26682 raft_consensus.cc:2376] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.474649 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.476176 26687 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:07:44.477576 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.478570 27321 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:44.479964 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2153) took 2127 ms (client timeout 1901 ms). Trace:
I20260709 13:07:44.480662 26678 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:44.481032 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.481964 26686 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:44.480508 26685 rpcz_store.cc:269] 0709 13:07:42.352390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.479737 (+2127347us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:44.479885 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:44.482900 26678 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:44.484128 26682 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:44.484128 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:44.485181 27320 raft_consensus.cc:2368] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:44.486775 26682 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:44.464746 28240 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:44.463690 28667 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:44.488358 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.493088 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.493459 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.494032 26682 raft_consensus.cc:2376] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.494436 26678 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.495740 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.496598 26682 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:44.496770 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.497596 26687 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:44.499192 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.500250 26687 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:44.501262 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.500330 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.502374 26682 raft_consensus.cc:2376] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.504431 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.505232 26679 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:44.351233 28197 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.382954 27319 rpcz_store.cc:276] 0709 13:07:42.543773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.548400 (+  4627us) service_pool.cc:224] Handling call
0709 13:07:43.704719 (+1156319us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:43.704956 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.337539 (+632583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.353440 (+ 15901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12120320}
I20260709 13:07:44.436417 28773 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:44.632143 26653 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47704 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:07:44.664621 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:44.665148 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.665560 26679 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.581342 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:44.525277 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.583045 26686 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:44.508674 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.667809 26678 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.668613 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.666808 26684 raft_consensus.cc:2376] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.669817 26686 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:44.670723 26603 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:44.672394 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.673893 26686 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 2.
I20260709 13:07:44.672654 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.675107 26684 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
W20260709 13:07:44.675619 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.528184 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.700160 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.700845 26687 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.705627 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.704349 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.707998 26679 raft_consensus.cc:2376] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5. Re-sending same reply.
I20260709 13:07:44.706339 26685 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
W20260709 13:07:44.663101 28765 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.706s	user 0.001s	sys 0.011s
W20260709 13:07:44.544615 28783 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:07:44.669622 28112 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.375s	user 0.007s	sys 0.006s
W20260709 13:07:44.664522 28700 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.920s	user 0.009s	sys 0.002s
W20260709 13:07:44.581454 28748 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
W20260709 13:07:44.540798 28786 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:07:44.548355 28793 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.579624 28751 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:44.579205 28723 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.715972 26754 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:44.544020 28735 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.582940 28763 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:44.719691 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.700433 28794 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:44.664448 28622 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.716953 28751 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:44.722739 28197 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:44.723182 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 301) took 1371 ms. Trace:
I20260709 13:07:44.715698 28700 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:44.732842 28756 consensus_meta.cc:287] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
I20260709 13:07:44.712143 28796 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.731503 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.769677 26577 leader_election.cc:336] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.557s (SENT)
I20260709 13:07:44.770159 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:44.717306 28708 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.783443 26761 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:44.785144 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 853) took 1465 ms. Trace:
I20260709 13:07:44.785528 26761 rpcz_store.cc:276] 0709 13:07:43.319975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.320093 (+   118us) service_pool.cc:224] Handling call
0709 13:07:44.784964 (+1464871us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540010fed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:44.785089 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3355483008}
I20260709 13:07:44.762843 26687 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:44.716312 28748 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.549882 28661 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.581985 28667 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.718423 28793 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.109686 27317 rpcz_store.cc:276] 0709 13:07:42.550087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.551881 (+  1794us) service_pool.cc:224] Handling call
0709 13:07:42.935422 (+383541us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:42.935629 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.935872 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:43.609144 (+673272us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.860262 (+251118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.871420 (+ 11158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.872975 (+  1555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.889128 (+ 16153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.895004 (+  5876us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":838941,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":170629,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":126,"spinlock_wait_cycles":7227136,"thread_start_us":692601,"threads_started":2,"wal-append.queue_time_us":321778}
I20260709 13:07:44.713790 28765 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.721333 28632 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.781049 28700 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:44.665017 26653 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47704 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
W20260709 13:07:44.788547 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.811229 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 349699us
I20260709 13:07:44.813364 26724 leader_election.cc:400] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:44.824646 26724 leader_election.cc:403] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.825930 28754 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.832221 28750 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.832947 26756 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:44.834797 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.840723 26753 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:44.835708 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.844112 26759 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.845073 28754 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:44.837895 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:44.764353 27316 rpcz_store.cc:276] 0709 13:07:43.351425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.354752 (+  3327us) service_pool.cc:224] Handling call
0709 13:07:43.355204 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.051587 (+696383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.722914 (+671327us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540052f8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:44.723118 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267086592}
I20260709 13:07:44.854753 26761 raft_consensus.cc:606] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.855271 26761 raft_consensus.cc:614] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.856056 28763 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:44.856493 28790 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.856679 28763 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.856734 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.858142 28790 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.858919 28763 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.836594 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.860744 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.860687 28790 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.861510 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.862092 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.862493 28790 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:44.850515 28689 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.863054 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.852607 28240 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.850816 28750 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.864480 28750 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.853856 28804 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:44.864945 28750 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:44.865264 28804 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.866236 28750 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.868710 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.863410 26757 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:44.869539 26761 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:44.874828 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.876222 26757 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:44.871614 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.869560 28804 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:44.870738 28750 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.874512 28689 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.883553 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:44.884591 28689 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:44.885088 28689 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.885561 28689 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.885113 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.892423 26761 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:44.896885 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:44.899201 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:44.902341 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:44.905491 28240 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:44.906736 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.923949 28240 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:44.924932 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.925251 28240 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.926898 28690 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:44.927385 28754 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:44.908325 28689 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.930809 28801 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:44.931380 28801 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.931620 28689 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:44.931902 28801 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.911744 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.933790 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:44.934754 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.935766 26757 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:44.936769 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.938092 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.940079 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.940701 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:44.941828 28531 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:44.942049 26726 leader_election.cc:400] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:44.942390 28531 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.942925 28531 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.944002 28689 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.943243 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.946264 28754 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:44.946942 28754 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:44.950026 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.807261 28777 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:07:44.911850 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.951637 28754 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:44.952131 26761 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.953377 28777 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:44.954977 28777 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:44.955688 28754 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:44.958463 28801 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:44.939386 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:44.959847 28777 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.961059 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.956833 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:44.962100 26757 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:44.962289 28754 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:44.963176 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.975397 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:44.977504 26679 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:44.815886 28693 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.980166 26682 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:44.980230 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.981220 26679 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:44.982407 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.983202 26679 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:44.986603 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:44.963408 28754 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:44.907323 26753 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:44.918772 26759 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:45.008798 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.968881 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:44.816089 28691 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.971016 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:44.813673 28792 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.784739 28723 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.974035 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.022991 26678 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.740374 28794 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:44.816263 28112 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.979132 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.767640 28756 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.029150 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:44.988240 26682 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.989017 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:44.966670 28777 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.005416 26761 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:45.005558 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.006464 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.010531 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.014169 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.017056 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.017727 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.019852 28661 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:45.026400 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 55455.3us
I20260709 13:07:45.086771 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.093298 26753 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:45.094389 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 105432us
W20260709 13:07:45.060956 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.095698 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.096096 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.096613 26679 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 3: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:45.094725 26687 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:45.097865 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.098906 26687 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:45.099138 26678 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:45.013573 28197 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:45.104331 26651 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:45.105458 26651 leader_election.cc:403] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.104907 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:44.781108 28796 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.009722 28700 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.966918 28531 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.030815 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.103390 26685 raft_consensus.cc:2376] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6. Re-sending same reply.
I20260709 13:07:45.102929 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.106980 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:45.105505 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.111531 26687 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:45.102671 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.108191 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.017383 28710 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:45.126876 28710 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:45.031309 28792 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.128207 28757 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.331s	user 0.007s	sys 0.004s
I20260709 13:07:45.128019 28710 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.129374 28710 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.132903 28514 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.133409 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.134337 26609 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:45.135296 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.135296 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.136073 26679 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:45.130808 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:45.114928 28806 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.125s	user 0.000s	sys 0.005s
I20260709 13:07:45.115399 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.117707 28531 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:45.118506 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2161) took 2733 ms (client timeout 1957 ms). Trace:
I20260709 13:07:45.140929 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:45.108893 28786 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:07:45.140969 26680 rpcz_store.cc:269] 0709 13:07:42.385516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.118291 (+2732775us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:45.118430 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:45.118865 28700 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.101215 28112 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.010510 28693 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.109125 28805 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.973953 28751 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.119774 28708 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:45.090931 28794 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.124998 28756 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:45.110996 28661 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:45.086843 28801 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.129739 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:45.143142 28750 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.130785 28765 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:45.151034 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.114295 26682 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:45.171247 26605 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:45.137001 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.130649 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.138616 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.113134 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.114454 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.175535 26684 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:45.175916 26687 raft_consensus.cc:2376] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6. Re-sending same reply.
I20260709 13:07:45.105624 28197 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.100570 28776 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.105333 28735 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:45.131392 28754 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.181979 28735 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:45.143600 26686 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:45.142340 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:45.144938 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.185372 26603 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:45.185930 28264 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.738s	user 0.003s	sys 0.007s
I20260709 13:07:45.186342 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.185393 28661 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.186678 28264 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:45.187203 28264 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:45.187827 28807 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:45.189651 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.190039 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.145569 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.111830 28632 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.093061 28748 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:45.087116 28793 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.144690 28689 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.153204 28549 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:07:45.158799 28708 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:45.210909 28708 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.161274 28700 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.162883 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 866) took 1359 ms. Trace:
I20260709 13:07:45.168773 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:45.214742 28765 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.215293 28765 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.215617 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:45.216401 26753 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:45.216990 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 291) took 1271 ms. Trace:
I20260709 13:07:45.217123 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.217669 26753 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:45.217365 27318 rpcz_store.cc:276] 0709 13:07:43.945279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.945705 (+   426us) service_pool.cc:224] Handling call
0709 13:07:43.945985 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.328241 (+382256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.328300 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.328364 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.328416 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.216781 (+888365us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54004a38d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:45.216822 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.216943 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878597888}
I20260709 13:07:45.218478 26753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:45.217296 28765 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.218989 26753 raft_consensus.cc:606] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:45.219367 26753 raft_consensus.cc:614] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.214427 26758 rpcz_store.cc:276] 0709 13:07:43.803105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.963087 (+159982us) service_pool.cc:224] Handling call
0709 13:07:43.964547 (+  1460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.350253 (+385706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.162627 (+812374us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002e90d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:45.162811 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885293440}
I20260709 13:07:45.221076 26758 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.170172 28112 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.024547 28691 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.176584 26679 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:45.176735 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63699.6us
W20260709 13:07:45.176838 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 208062us
I20260709 13:07:45.224901 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.225795 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.151264 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:45.200209 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.190356 28773 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.202065 28796 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.179981 28197 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.183015 28735 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:45.202805 28531 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:45.173538 28792 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.204571 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.242817 26756 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:45.205025 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.160363 28693 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.226651 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:45.218562 26576 connection.cc:256] RPC call timeout handler was delayed by -1.1147803559999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:07:45.248241 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.247989 28478 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.249083 28801 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:45.249595 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.236199 26726 leader_election.cc:400] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:07:45.236207 26753 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:45.180392 28704 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:45.251533 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:45.282861 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56376us
W20260709 13:07:45.286249 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.218493 28477 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.233925 28622 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:45.288506 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 56464.1us
W20260709 13:07:45.294090 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.275684 28112 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.275404 28691 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.233196 28409 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:07:45.274999 28796 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.296378 27316 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:45.296175 28777 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:45.313246 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87515.8us
I20260709 13:07:45.314616 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:45.293238 28704 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:45.308272 28112 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.274077 28531 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.304543 28707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.503s	user 0.029s	sys 0.010s
I20260709 13:07:45.305393 28622 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:45.316130 28796 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.321280 28661 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:45.326797 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:45.295121 28477 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.329538 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.332901 28653 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:07:45.334822 26760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 856) took 1975 ms (client timeout 1653 ms). Trace:
I20260709 13:07:45.349426 28704 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.350132 26760 rpcz_store.cc:269] 0709 13:07:43.359632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.658910 (+299278us) service_pool.cc:224] Handling call
0709 13:07:45.334578 (+1675668us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000dcad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:45.334724 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691117440}
I20260709 13:07:45.332185 28473 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.351423 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.354302 28622 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.359990 28812 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.327695 28777 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.363288 28777 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:45.346540 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0739256129999148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:07:45.371641 26650 connection.cc:256] RPC call timeout handler was delayed by -1.070325612999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:07:45.330899 28820 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.321134 28819 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.374615 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:45.341264 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.373783 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47077.9us
I20260709 13:07:45.375949 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.351454 28473 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:45.331548 28112 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:45.331079 28707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.539s	user 0.029s	sys 0.011s
I20260709 13:07:45.367400 28531 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.376817 26687 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:45.394290 26687 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:45.395008 26687 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.370395 28661 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.384115 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.374616 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123147us
W20260709 13:07:45.386962 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.381668 28473 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.387838 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.311939 28264 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.398919 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.399811 26684 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:45.388901 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.347640 28796 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.395912 26687 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.352782 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.398900 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.378968 28793 raft_consensus.cc:2764] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:45.413607 26760 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
W20260709 13:07:45.414357 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.414690 26679 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:45.381778 28819 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.418876 26681 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.419559 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.421839 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.378446 28777 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:45.425742 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.426630 26679 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:45.400090 28661 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.410295 28473 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.397349 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:45.441133 26687 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:45.395813 28632 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:45.442562 26687 pending_rounds.cc:85] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 5
W20260709 13:07:45.423036 28755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.622s	user 0.016s	sys 0.007s
I20260709 13:07:45.443849 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.443789 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.441761 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.458725 26687 pending_rounds.cc:107] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:45.463961 26687 raft_consensus.cc:2889] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.464241 26681 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:45.464560 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.465173 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.437202 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.465709 26681 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:45.424360 28819 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.482095 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.484498 28636 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.484858 28708 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:07:45.485267 28708 raft_consensus.cc:1068] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:45.463408 26760 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:45.471918 28751 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.473574 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 864) took 1671 ms. Trace:
I20260709 13:07:45.474815 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.443176 28754 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:45.436156 28777 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.475983 26753 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:45.476543 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.508430 28777 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:45.476748 28828 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.467186 28707 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:45.480136 28812 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:45.466809 28755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.661s	user 0.018s	sys 0.008s
W20260709 13:07:45.487084 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.487658 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.488459 26679 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.436400 28667 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:45.492856 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.485647 28822 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.485260 28824 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.504549 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:45.504550 26681 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:45.505139 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.505743 28754 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.510722 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 136154us
I20260709 13:07:45.514940 26684 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:45.554351 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.554616 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.520354 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.556118 26609 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:45.525231 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:45.539556 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51975.1us
I20260709 13:07:45.540757 26757 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:45.560058 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.541455 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.561338 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.563259 26603 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:45.565802 26757 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.567349 26757 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.542088 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.541980 28824 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.584012 26606 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.542985 26760 raft_consensus.cc:2410] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:45.585318 28824 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.585676 26760 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:45.586107 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.586699 26684 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:45.586875 26760 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.543468 27314 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:45.543596 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:45.587525 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.490108 28765 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.493455 28775 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.469632 28793 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:45.466449 28197 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.545171 28805 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.545606 27316 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:45.596130 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.596771 26679 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:45.597679 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.565222 28777 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.552593 26612 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:45.541848 27315 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:45.518785 28416 raft_consensus.cc:1027] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: attempt to promote peer 77c617823f2e4a938ef247a8924e299b: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:45.577265 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.607225 26610 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:45.577502 26650 leader_election.cc:400] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
I20260709 13:07:45.582429 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.608284 26650 leader_election.cc:403] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.588095 26684 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:45.589721 26760 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:07:45.590553 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 168781us
I20260709 13:07:45.609162 26760 pending_rounds.cc:85] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:07:45.609437 26760 pending_rounds.cc:107] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:45.592422 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.598687 26680 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.489251 26755 rpcz_store.cc:276] 0709 13:07:43.802598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.850242 (+ 47644us) service_pool.cc:224] Handling call
0709 13:07:43.891049 (+ 40807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.943885 (+ 52836us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:44.029085 (+ 85200us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.810117 (+781032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.810193 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:44.810265 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.473355 (+663090us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b540011c6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:45.473403 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.473516 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457598,"prepare.queue_time_us":64657,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":458132,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":85454080,"thread_start_us":316171,"threads_started":1,"wal-append.queue_time_us":415953}
I20260709 13:07:45.577639 28632 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.556486 28708 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:45.609658 26760 raft_consensus.cc:2889] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.609598 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.612349 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.592394 28740 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:45.613953 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 860) took 1882 ms. Trace:
I20260709 13:07:45.599233 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:45.616671 26682 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.616895 28533 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.601052 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:45.591310 28776 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:07:45.576009 28473 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.686790 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.626899 28754 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:45.628473 28773 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:45.629096 28477 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.632987 28197 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:45.595489 28793 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:45.639007 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.623687 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.553211 28707 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.601260 28777 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.636186 26752 rpcz_store.cc:276] 0709 13:07:43.731205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.731331 (+   126us) service_pool.cc:224] Handling call
0709 13:07:43.791295 (+ 59964us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.863524 (+ 72229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:44.053805 (+190281us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.255150 (+201345us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.317698 (+ 62548us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.317918 (+   220us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:44.318234 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.630139 (+311905us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800121360. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:44.795586 (+165447us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b1800121360. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:07:44.989557 (+193971us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.989973 (+   416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.613664 (+623691us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54002e9ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:45.613710 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.613758 (+    48us) raft_consensus.cc:1685] finished
0709 13:07:45.613769 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.613900 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76739,"prepare.queue_time_us":177424,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":2985,"raft.queue_time_us":605060,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":17886,"spinlock_wait_cycles":245400448,"thread_start_us":453862,"threads_started":3,"wal-append.queue_time_us":262411}
I20260709 13:07:45.643627 28794 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:45.644196 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66849.8us
W20260709 13:07:45.645779 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.648052 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.650585 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 304) took 1182 ms. Trace:
I20260709 13:07:45.652628 28533 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:45.652982 28112 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.575634 28661 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.655381 28830 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:45.656066 26712 heartbeater.cc:646] Failed to heartbeat to 127.24.232.254:38345 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.232.254:38345 timed out after 15.000s (SENT)
I20260709 13:07:45.607177 28805 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.638556 28636 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:45.638199 28740 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:45.760267 26683 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:45.660709 28798 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:45.595309 28765 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.661248 28812 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.639926 28622 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
I20260709 13:07:45.666688 26608 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:45.668992 28796 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.670135 28829 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.673310 28828 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.641410 28708 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.675691 26759 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:45.677029 28728 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:45.820363 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:45.683852 28792 raft_consensus.cc:1064] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:45.684376 28469 raft_consensus.cc:1064] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:45.690438 26757 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:45.695103 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.821868 26752 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:45.706067 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.669005 27313 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:45.825796 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.789676 28735 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:45.721006 26607 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:45.758324 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:45.758231 27321 rpcz_store.cc:276] 0709 13:07:44.468080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.468419 (+   339us) service_pool.cc:224] Handling call
0709 13:07:45.650427 (+1182008us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b54004c7cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:45.650529 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21253376}
I20260709 13:07:45.699810 28793 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:45.796056 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.831792 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 73543us
I20260709 13:07:45.832749 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.799543 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:45.800773 26756 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.838948 26687 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:45.840090 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.724356 28777 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:45.811834 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.754752 28264 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.847628 28264 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:45.677435 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67921.8us
I20260709 13:07:45.851598 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.852118 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.853823 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:45.818070 28197 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:45.854933 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:45.631479 28819 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:45.792299 28740 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.820977 28728 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.837220 28792 raft_consensus.cc:1068] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:45.836540 28469 raft_consensus.cc:1068] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:45.791992 28805 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.871366 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:45.819582 28776 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:45.910197 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:45.911340 26608 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.851289 28632 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:45.917966 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46687.4us
I20260709 13:07:45.862705 28828 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:45.860064 28812 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.825737 28829 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:45.859259 28754 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:45.957412 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.959079 26752 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:45.932080 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:46.001170 28754 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.837940 28818 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:45.869103 28728 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:46.004771 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 153236us
I20260709 13:07:45.910197 28822 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.911921 28792 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.015448 26608 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.017094 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.860041 28689 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:46.031747 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.034034 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:45.922299 28477 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:46.037372 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.041213 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:45.863267 28197 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.010000 28754 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.960229 28264 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.008193 28636 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.959731 28478 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:07:45.838313 28735 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.019729 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.033567 28775 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:46.032619 28533 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:46.028360 28828 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:46.036666 28653 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.042450 28689 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:46.111809 28112 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.091787 28469 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.033931 28822 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.094796 28792 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:46.114490 28777 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.092535 28473 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.119947 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1174) took 1289 ms. Trace:
I20260709 13:07:46.156987 26759 rpcz_store.cc:276] 0709 13:07:44.830931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.016749 (+185818us) service_pool.cc:224] Handling call
0709 13:07:46.119725 (+1102976us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:46.119881 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318223744}
I20260709 13:07:46.123955 27321 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:46.139822 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.094135 28773 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.161365 28793 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.162400 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:46.162628 28775 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.132998 28661 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.136436 28852 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:46.163618 28852 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.165215 28777 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.135865 28469 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:46.120793 28533 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:46.145462 28834 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:07:46.147802 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.148399 26608 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.140331 28792 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.132433 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.160490 28840 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:46.161278 28689 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.168462 26605 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:46.100517 28636 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:46.161890 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 229526us
I20260709 13:07:46.151317 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.190023 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:46.144766 28835 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:46.133291 28693 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.158514 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 872) took 1033 ms. Trace:
I20260709 13:07:46.135281 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:46.142392 28833 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
W20260709 13:07:46.156502 28837 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:07:46.179838 27284 leader_election.cc:336] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.629s (SENT)
I20260709 13:07:46.142047 28707 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:46.408967 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 229322us
I20260709 13:07:46.191915 26756 rpcz_store.cc:276] 0709 13:07:45.124912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.244283 (+119371us) service_pool.cc:224] Handling call
0709 13:07:45.244541 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.835217 (+590676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.158226 (+323009us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54000da7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:46.158445 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278650112}
W20260709 13:07:46.406980 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.012s
W20260709 13:07:46.410521 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.013s
W20260709 13:07:46.393577 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 258637us
W20260709 13:07:46.411105 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 578371us
I20260709 13:07:46.411792 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:46.412271 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.170120 28796 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.407477 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.169592 28773 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.169859 28469 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:46.414939 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 225301us
I20260709 13:07:46.442891 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.442691 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.443691 26609 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.352483 28549 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:46.417165 28793 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.415589 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:46.424001 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:46.224596 28664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.001s	sys 0.020s
I20260709 13:07:46.185516 28792 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.175717 28775 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.413173 27316 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 4 LEARNER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:46.456235 28473 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:07:46.462654 28850 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:46.356309 28828 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.230077 28693 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.454195 28823 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:07:46.474241 28794 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:46.444862 28773 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.452698 26755 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:46.452875 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.453994 26752 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.455134 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.397703 28852 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:46.428355 28848 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:46.457227 26611 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.188186 28765 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:46.461212 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45704.1us
I20260709 13:07:46.493368 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:46.461161 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.465178 26756 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:07:46.465655 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55904.9us
W20260709 13:07:46.496997 27284 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.785s (SENT)
I20260709 13:07:46.463464 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:46.460809 28661 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:07:46.428378 28728 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.415510 28533 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.469403 28197 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.470144 28822 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.470655 28829 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:46.357697 28819 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.483304 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2215) took 1043 ms. Trace:
I20260709 13:07:46.275974 28740 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.488842 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.538523 26609 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.461036 28549 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:46.512142 28850 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.499842 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.501706 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:46.504690 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.543479 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.546423 26611 raft_consensus.cc:2368] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:46.504909 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.474627 28794 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:46.484020 28473 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:07:46.521658 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65188.2us
I20260709 13:07:46.522845 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 916) took 1537 ms. Trace:
I20260709 13:07:46.552356 26682 rpcz_store.cc:276] 0709 13:07:44.985597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.174547 (+188950us) service_pool.cc:224] Handling call
0709 13:07:45.174756 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.638343 (+463587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.522668 (+884325us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400127ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:46.522800 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015647488}
I20260709 13:07:46.553308 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.553828 26756 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.524235 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:46.528860 28764 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:46.529285 28728 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.532194 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 163) took 1255 ms. Trace:
I20260709 13:07:46.559782 26757 rpcz_store.cc:276] 0709 13:07:45.276627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.579097 (+302470us) service_pool.cc:224] Handling call
0709 13:07:45.579376 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.826881 (+247505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.531950 (+705069us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:46.532131 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254937856}
I20260709 13:07:46.533318 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 279) took 1132 ms. Trace:
I20260709 13:07:46.534142 28750 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.534688 26683 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.536204 28693 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.537230 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2210) took 1120 ms. Trace:
I20260709 13:07:46.566543 26687 rpcz_store.cc:276] 0709 13:07:45.417380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.464939 (+ 47559us) service_pool.cc:224] Handling call
0709 13:07:46.537044 (+1072105us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400187754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:46.537172 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857526016}
I20260709 13:07:46.495518 28735 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:46.519065 26678 rpcz_store.cc:276] 0709 13:07:45.440127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.659908 (+219781us) service_pool.cc:224] Handling call
0709 13:07:45.660238 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.660566 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.660593 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.661028 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.865297 (+204269us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:45.865335 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.865395 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.483104 (+617709us) raft_consensus.cc:1685] finished
0709 13:07:46.483127 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.483246 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10020,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":203927,"threads_started":1,"wal-append.queue_time_us":341615}
I20260709 13:07:46.548534 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.571525 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.572407 26609 raft_consensus.cc:2368] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6.
I20260709 13:07:46.516587 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.549842 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.573455 26605 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:46.574046 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.575402 26611 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:46.547216 26753 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:46.577524 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2221) took 1106 ms. Trace:
I20260709 13:07:46.578141 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.577961 26686 rpcz_store.cc:276] 0709 13:07:45.471227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.095635 (+624408us) service_pool.cc:224] Handling call
0709 13:07:46.096146 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.407792 (+311646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.407834 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.408436 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.559469 (+151033us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:46.559511 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.559574 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.577245 (+ 17671us) raft_consensus.cc:1685] finished
0709 13:07:46.577280 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.577452 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":394691,"threads_started":2,"wal-append.queue_time_us":125962}
I20260709 13:07:46.578892 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:46.579135 26753 raft_consensus.cc:2410] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:46.550825 28549 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:46.585263 28838 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:46.585731 26678 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:46.586200 28663 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.586571 28663 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.575243 28776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.011s
I20260709 13:07:46.557596 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.545274 28850 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.565701 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.577185 26611 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:46.584648 26686 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [2.2-6.4]
I20260709 13:07:46.584915 26753 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:46.551297 28740 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:46.587483 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 85867.5us
I20260709 13:07:46.593000 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:46.594237 26760 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:46.559518 28764 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:46.597421 26760 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:46.562408 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.604691 26760 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:46.586921 28663 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.562785 28473 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:46.563843 28636 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:46.613873 26756 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:46.594700 26611 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:46.588686 28776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.007s	sys 0.011s
I20260709 13:07:46.605419 26609 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:46.625774 28775 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.625988 28630 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.561879 28845 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:46.563809 28750 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:46.628844 28750 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.629329 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 145) took 1647 ms. Trace:
I20260709 13:07:46.589177 28112 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.629685 26680 rpcz_store.cc:276] 0709 13:07:44.982342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.142001 (+159659us) service_pool.cc:224] Handling call
0709 13:07:45.148717 (+  6716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.610172 (+461455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.629109 (+1018937us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000c44d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:46.629274 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034441088}
I20260709 13:07:46.627432 28766 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.634660 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.635787 26611 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:46.562414 27313 rpcz_store.cc:276] 0709 13:07:45.400742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.410382 (+  9640us) service_pool.cc:224] Handling call
0709 13:07:45.668666 (+258284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.825737 (+157071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.533098 (+707361us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54004c7cd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:46.533254 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518575488}
I20260709 13:07:46.594172 28850 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.641674 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.642402 26611 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:46.643064 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.644421 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.634598 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.559697 28794 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.614537 26755 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.646930 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.609063 26683 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:46.663295 26609 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:46.663719 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.486s (SENT) [suppressed 46 similar messages]
I20260709 13:07:46.668126 26756 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:46.669279 28825 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 1.188s	user 0.004s	sys 0.005s
I20260709 13:07:46.643581 26611 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:46.670498 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.670707 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.671546 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.671931 28794 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.624075 28723 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:46.672879 28723 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:46.673202 28723 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:46.673595 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:46.673933 28723 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.674902 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.675127 28723 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.676088 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:46.676218 28764 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.676780 26611 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:07:46.677302 28842 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.539s	user 0.000s	sys 0.001s
I20260709 13:07:46.677554 28764 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.678500 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:46.678771 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.679330 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 844) took 3411 ms (client timeout 1823 ms). Trace:
W20260709 13:07:46.693409 26754 rpcz_store.cc:269] 0709 13:07:43.267447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.267563 (+   116us) service_pool.cc:224] Handling call
0709 13:07:46.679092 (+3411529us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540014f5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:46.679227 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3278921984}
I20260709 13:07:46.680207 26758 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:46.694466 26758 pending_rounds.cc:85] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:07:46.694766 26758 pending_rounds.cc:107] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:46.614807 28819 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:46.695073 26758 raft_consensus.cc:2889] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.689623 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:46.682155 26752 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:46.639358 28750 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.603837 28754 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.675992 28718 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.645776 28860 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:46.705233 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2180) took 1038 ms. Trace:
I20260709 13:07:46.702653 28766 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.700321 27312 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:46.706281 28766 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.706720 28766 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.708189 28860 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:46.709106 28860 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.712309 28773 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.705778 28754 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:46.734328 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.713995 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:46.705603 26612 rpcz_store.cc:276] 0709 13:07:45.666589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.686935 (+ 20346us) service_pool.cc:224] Handling call
0709 13:07:45.687245 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.687606 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.687635 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.697456 (+  9821us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.926770 (+229314us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:45.926832 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.926942 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.676700 (+749758us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:46.702228 (+ 25528us) raft_consensus.cc:1685] finished
0709 13:07:46.702252 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.705164 (+  2912us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4368,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2629,"spinlock_wait_cycles":4188416,"thread_start_us":165551,"threads_started":1,"wal-append.queue_time_us":370851}
W20260709 13:07:46.781147 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.846766 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:46.847910 26752 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:46.855801 28870 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:07:46.855995 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.857281 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.858204 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2182) took 1191 ms. Trace:
I20260709 13:07:46.858426 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.859174 26756 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:46.858588 26605 rpcz_store.cc:276] 0709 13:07:45.667122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.574381 (+907259us) service_pool.cc:224] Handling call
0709 13:07:46.574811 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.575543 (+   732us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:46.575957 (+   414us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.657322 (+ 81365us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.657796 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.657931 (+   135us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:46.657962 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.658036 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.858003 (+199967us) raft_consensus.cc:1685] finished
0709 13:07:46.858023 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.858147 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15563,"prepare.queue_time_us":199,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":11776,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":21391,"thread_start_us":72204,"threads_started":1,"wal-append.queue_time_us":279884}
I20260709 13:07:46.864377 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:46.867730 28751 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:46.871887 28867 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:07:46.872788 28710 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.874145 28773 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:46.876024 27316 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:46.891003 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.912691 26612 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.896816 26755 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:46.899778 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.919087 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:46.922822 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.916339 28777 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.924654 28777 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.925079 28766 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.927235 28766 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.916379 28710 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:46.928778 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:46.929351 26605 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:46.930246 28710 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:46.933247 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:46.934333 26756 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:46.937019 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:46.944126 26678 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 2.
I20260709 13:07:46.945276 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:46.945875 26678 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:46.946820 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:46.937817 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:46.947945 26687 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.947465 26678 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:46.951722 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:46.952618 26678 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:46.954416 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:46.956661 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:46.957399 26754 raft_consensus.cc:606] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:07:46.959789 26678 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:46.936095 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:46.970242 26686 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:46.908203 28751 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.968336 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:46.976761 26680 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:07:46.977233 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44093.2us
I20260709 13:07:46.975131 26687 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:46.940945 26612 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:46.935834 28773 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:46.979573 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:46.980780 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:46.942761 28469 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:46.986966 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:46.977299 28751 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.975943 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:46.979171 28801 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:46.984862 28828 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:46.998273 26757 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:46.992127 28794 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:47.026299 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.026595 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:47.028491 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2179) took 1362 ms. Trace:
I20260709 13:07:47.028843 26610 rpcz_store.cc:276] 0709 13:07:45.666331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.697260 (+ 30929us) service_pool.cc:224] Handling call
0709 13:07:47.026434 (+1329174us) spinlock_profiling.cc:243] Waited 939 us on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:47.028434 (+  2000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158848}
I20260709 13:07:46.995114 28823 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.053547 26605 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:46.986409 28663 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:47.029451 28632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.012s	sys 0.037s
I20260709 13:07:46.996191 27314 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.995446 28801 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.080540 26759 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:47.034771 28823 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:47.060647 28632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.012s	sys 0.038s
I20260709 13:07:47.067502 28794 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:47.069098 28819 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.071446 28801 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.086099 28823 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.085510 28632 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:47.108696 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.112706 27313 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:47.118469 28549 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:47.121037 28469 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:47.123579 28663 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.125720 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:47.126725 27318 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 3: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:07:47.127228 27318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 277) took 1734 ms (client timeout 2103 ms). Trace:
W20260709 13:07:47.137030 27318 rpcz_store.cc:269] 0709 13:07:45.392800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.392948 (+   148us) service_pool.cc:224] Handling call
0709 13:07:46.156581 (+763633us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:47.125542 (+968961us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016be9c 00007f40f016ba5b 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:47.127155 (+  1613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34272384}
I20260709 13:07:47.134684 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.132126 28854 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.138216 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.141510 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:47.147300 28773 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:47.147933 28773 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:47.148082 28764 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:47.148690 28764 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:47.148798 28773 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.149667 28764 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:47.159137 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.155874 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 157150us
I20260709 13:07:47.160537 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.162595 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.169759 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.093271 28850 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.171799 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.108461 28777 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:47.099689 28819 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.168705 28636 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.180596 28723 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:47.198261 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 252633us
I20260709 13:07:47.197269 28197 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:47.170698 28663 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:47.198498 28723 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:47.206588 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 932) took 1667 ms. Trace:
I20260709 13:07:47.207573 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.210855 26680 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:47.099212 28794 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:47.220115 28792 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:07:47.220624 28792 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.220808 28632 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.152949 28854 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.221932 26760 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:07:47.203482 28704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.770s	user 0.013s	sys 0.018s
W20260709 13:07:47.225297 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.201911 28663 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.208839 28828 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:47.223984 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 812195us
I20260709 13:07:47.200987 28777 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:07:47.227430 28704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.799s	user 0.013s	sys 0.018s
I20260709 13:07:47.236501 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:47.205090 28636 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.244591 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.264034 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:47.264693 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.231616 28663 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.273255 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.275050 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:47.278271 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 105115us
I20260709 13:07:47.234552 28828 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.279575 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.280766 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:47.227154 28723 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:47.225221 28852 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:47.224937 28883 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:07:47.301368 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64980.7us
I20260709 13:07:47.303571 26687 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:47.305889 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.306223 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.306885 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.307112 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.304171 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.307646 26683 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:47.308149 26678 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:47.308506 26686 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:47.308773 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.309319 26687 raft_consensus.cc:2376] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6. Re-sending same reply.
I20260709 13:07:47.309757 26683 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:47.309880 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.311437 26683 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:47.311519 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.312829 26687 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:47.285594 28718 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:47.286013 28828 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:47.327538 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46880.8us
I20260709 13:07:47.287767 28829 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:47.319985 26687 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:47.320158 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.329106 26683 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.328352 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:47.334507 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.335331 26687 raft_consensus.cc:2410] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:47.312965 28622 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:47.326406 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.338917 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.341585 26687 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.300599 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.343922 28549 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.344396 28549 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.345479 26683 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:47.313748 28892 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.287554 28862 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:07:47.315639 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:47.302337 28888 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:47.328245 28718 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:47.351203 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45053.3us
I20260709 13:07:47.359859 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:47.351989 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51509.7us
I20260709 13:07:47.352880 28894 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.333858 28859 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.336315 28197 raft_consensus.cc:2764] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:47.349048 28860 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.350661 28882 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:07:47.339895 28622 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.348392 28751 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.382560 28819 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.363497 28888 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:47.382740 28636 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:47.383006 28890 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:47.383332 28892 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.375578 28898 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.360728 28718 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:47.363416 28799 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.388823 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.397275 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.390535 28903 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.390616 28891 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:47.383405 28889 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:47.406226 28751 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:47.406087 28663 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.390112 26687 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:47.391989 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.408751 26680 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:07:47.394716 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.384080 28829 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:47.387806 28622 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.399631 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.413650 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.418965 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:47.381263 28723 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:47.376171 28859 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.391914 27314 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:47.424429 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.427420 28663 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.400980 28799 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:47.430521 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 246963us
I20260709 13:07:47.400815 28903 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.427604 28858 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:47.429100 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.408779 28896 raft_consensus.cc:2764] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:47.385996 28860 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.423259 28893 raft_consensus.cc:2764] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:47.434152 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.450836 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:47.428607 28897 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:47.451566 28897 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:47.451994 28897 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.428267 28801 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.426492 28531 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:47.455324 28531 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:47.407222 28888 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.400430 28892 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.459789 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.459976 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:47.381435 28894 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.400599 28898 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.458618 26683 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:47.435010 28799 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.463867 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:47.467628 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:47.466115 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.467056 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:47.468976 26687 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:47.470765 28896 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:47.471046 28860 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:47.471609 28896 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.455994 28801 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.473151 28898 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:47.466614 28902 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:47.474510 28902 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.474876 28902 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:47.475901 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.476840 28894 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.444321 28903 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.477746 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2222) took 2006 ms. Trace:
I20260709 13:07:47.471446 28892 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:47.482908 26684 rpcz_store.cc:276] 0709 13:07:45.471528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.364860 (+893332us) service_pool.cc:224] Handling call
0709 13:07:46.365298 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:47.132303 (+767005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.132340 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:47.132994 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 13:07:47.271366 (+138372us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:47.271420 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.271512 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.477546 (+206034us) raft_consensus.cc:1685] finished
0709 13:07:47.477564 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.477692 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":782013,"raft.queue_time_us":830884,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5733,"thread_start_us":123135,"threads_started":1,"wal-append.queue_time_us":278353}
I20260709 13:07:47.485478 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.486788 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:47.478040 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2217) took 2021 ms. Trace:
I20260709 13:07:47.488014 26679 rpcz_store.cc:276] 0709 13:07:45.456695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.700077 (+243382us) service_pool.cc:224] Handling call
0709 13:07:45.700400 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.720670 (+ 20270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.720702 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.756630 (+ 35928us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.010041 (+253411us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:46.104797 (+ 94756us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.130753 (+1025956us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18001ce040. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:07:47.234790 (+104037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.234879 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.475023 (+240144us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b18001ce040. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:47.477872 (+  2849us) raft_consensus.cc:1685] finished
0709 13:07:47.477892 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.477993 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66702,"prepare.queue_time_us":87311,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1090641,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":58595,"spinlock_wait_cycles":16159872,"thread_start_us":366090,"threads_started":3,"wal-append.queue_time_us":334250}
I20260709 13:07:47.481949 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 930) took 1944 ms. Trace:
I20260709 13:07:47.450079 28862 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:47.478081 26680 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:07:47.503214 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 174940us
I20260709 13:07:47.491103 26685 rpcz_store.cc:276] 0709 13:07:45.537406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.541487 (+1004081us) service_pool.cc:224] Handling call
0709 13:07:46.554706 (+ 13219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.197994 (+643288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.198021 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.198472 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.282630 (+ 84158us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:47.282667 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.282729 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.481699 (+198970us) raft_consensus.cc:1685] finished
0709 13:07:47.481725 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.481879 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":782529,"raft.queue_time_us":643057,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":5565,"thread_start_us":83713,"threads_started":1,"wal-append.queue_time_us":133009}
W20260709 13:07:47.483454 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 103520us
W20260709 13:07:47.509989 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43962.3us
I20260709 13:07:47.510311 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:47.469080 28531 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.467545 28636 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:47.511045 28892 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:47.512676 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.516779 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.510459 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:47.520185 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.492808 28898 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:47.508991 28858 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:47.522392 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.525134 26756 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:47.529973 28724 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.514809 28636 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:47.517805 28892 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:47.537243 26650 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5.
I20260709 13:07:47.531483 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:47.539179 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2194) took 1618 ms (client timeout 1739 ms). Trace:
W20260709 13:07:47.539701 26606 rpcz_store.cc:269] 0709 13:07:45.920431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.924441 (+  4010us) service_pool.cc:224] Handling call
0709 13:07:47.531313 (+1606872us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:47.539099 (+  7786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31317760}
I20260709 13:07:47.467141 28829 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.522151 28723 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:47.524394 28801 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.522003 28908 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:47.526623 28914 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:47.553622 28914 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:47.549808 28801 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.556516 28801 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:47.526088 28899 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:47.560860 28912 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:07:47.551846 28805 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:47.536455 28894 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:47.525238 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.548840 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.582912 28892 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.589397 28636 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.564221 28823 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.554586 28914 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:47.608116 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84493.5us
I20260709 13:07:47.613541 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:47.613998 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90982.7us
W20260709 13:07:47.618259 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.605162 28197 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.620435 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:47.617090 28750 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:47.624116 28765 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:47.624285 28750 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:47.624527 28765 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:47.625250 28750 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:47.628355 28879 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.533s	user 0.001s	sys 0.001s
I20260709 13:07:47.625373 28765 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.629997 28765 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.630818 28823 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.620190 28888 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:07:47.634404 28910 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:47.635335 28829 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.609452 28897 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.615727 28858 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.783231 28700 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:47.642547 28622 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.030030 28829 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:47.779819 28902 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:48.019068 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 399307us
I20260709 13:07:48.034829 28921 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:48.035804 28921 consensus_queue.cc:1243] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:48.038057 28921 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:47.747611 27318 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:48.041038 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:48.042001 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:47.732478 28908 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.781477 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 316) took 1648 ms. Trace:
I20260709 13:07:48.043745 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:47.777263 28903 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.609951 28861 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:47.644848 28859 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:47.771703 28828 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.043121 27315 rpcz_store.cc:276] 0709 13:07:46.133050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.134458 (+  1408us) service_pool.cc:224] Handling call
0709 13:07:47.780200 (+1645742us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016beee 0000000000375939 00007f40f81df1e0 00007f40f82a80c4 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:47.780396 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.781109 (+   713us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:47.781135 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.781181 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:47.781233 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.781294 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.781418 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4628352}
I20260709 13:07:47.777263 28801 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.045565 27320 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:47.778767 28799 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:47.681565 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 929) took 2145 ms. Trace:
I20260709 13:07:48.018843 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 303) took 1459 ms. Trace:
I20260709 13:07:48.049015 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:48.097812 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 48908.3us
W20260709 13:07:48.049418 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.026072 28700 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:47.781018 28718 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.075433 28792 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.097015 26681 rpcz_store.cc:276] 0709 13:07:45.536235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.422538 (+886303us) service_pool.cc:224] Handling call
0709 13:07:46.422918 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.302135 (+879217us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:47.504544 (+202409us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.599512 (+ 94968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.607721 (+  8209us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.607861 (+   140us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:47.607890 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.607955 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.679456 (+ 71501us) raft_consensus.cc:1685] finished
0709 13:07:47.679477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.679656 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772168,"prepare.queue_time_us":240439,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":775472,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11744,"thread_start_us":395298,"threads_started":3,"wal-append.queue_time_us":108841}
I20260709 13:07:48.092702 28897 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.046123 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 305) took 1448 ms. Trace:
I20260709 13:07:47.775328 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:48.060335 28839 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.060992 28622 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:48.060212 28921 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.135878 28839 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.065748 28888 consensus_queue.cc:1243] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:48.071699 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:48.108343 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:48.083091 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 320) took 1144 ms. Trace:
I20260709 13:07:48.073325 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:48.118062 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:48.118913 28700 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.109946 28852 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:48.139935 27318 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:48.142194 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69005.8us
I20260709 13:07:48.149431 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:48.153661 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:48.145571 26679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.023s	sys 0.056s
I20260709 13:07:48.124595 26681 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:48.080637 28902 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:48.158560 26679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.023s	sys 0.056s
I20260709 13:07:48.140671 28622 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.113281 28859 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:48.147254 28888 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:48.116686 28913 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:07:48.211073 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.220741 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.221026 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.221988 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.222718 26604 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:48.207866 27317 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:48.226626 26606 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.156227 28700 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:48.161024 28921 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.238106 27318 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:48.239920 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:48.240278 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:48.240383 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.241027 26609 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:48.241384 26611 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:48.241683 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.242120 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.229197 28888 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:48.242936 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:48.243727 28888 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.140537 27313 rpcz_store.cc:276] 0709 13:07:46.936507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.115374 (+178867us) service_pool.cc:224] Handling call
0709 13:07:47.116250 (+   876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.116528 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:47.791439 (+674911us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.046738 (+255299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.046809 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.051503 (+  4694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.068215 (+ 16712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.080976 (+ 12761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":928885,"prepare.queue_time_us":675143,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":256599,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":24987}
I20260709 13:07:48.249212 27313 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.253372 28839 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.255554 28799 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.256572 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:48.258858 27314 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:48.132655 27312 rpcz_store.cc:276] 0709 13:07:46.598010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.706996 (+108986us) service_pool.cc:224] Handling call
0709 13:07:46.707442 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.707687 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:47.052621 (+344934us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.787536 (+734915us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b18002b0180. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf 00007f40f32aa038
0709 13:07:47.787801 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.044922 (+257121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.045009 (+    87us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.045088 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.045208 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.046034 (+   826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265706,"prepare.queue_time_us":863569,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":276853,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":29012,"spinlock_wait_cycles":15390592,"thread_start_us":323172,"threads_started":1}
I20260709 13:07:48.260849 27312 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.262503 27312 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.265285 28801 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.210878 28897 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:48.213207 28794 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.714406 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 280) took 3300 ms. Trace:
I20260709 13:07:48.276314 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:48.637784 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 314) took 2790 ms. Trace:
I20260709 13:07:48.725281 27318 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:48.724681 27320 rpcz_store.cc:276] 0709 13:07:45.414029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.414172 (+   143us) service_pool.cc:224] Handling call
0709 13:07:46.154744 (+740572us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:46.990778 (+836034us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016be9c 00007f40f016ba5b 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:07:48.045354 (+1054576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.094500 (+ 49146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.714029 (+619529us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004268d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.714255 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457603840}
I20260709 13:07:48.725467 27321 rpcz_store.cc:276] 0709 13:07:45.834848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.835569 (+   721us) service_pool.cc:224] Handling call
0709 13:07:45.835881 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.158611 (+322730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.625038 (+2466427us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400632754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:48.625308 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661835648}
I20260709 13:07:48.224506 28795 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.225338 28718 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.228039 28823 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:48.213336 28914 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.259580 28861 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.265863 28708 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:48.335413 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 184890us
W20260709 13:07:48.465945 26607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1175) took 2941 ms (client timeout 1659 ms). Trace:
W20260709 13:07:48.832808 26607 rpcz_store.cc:269] 0709 13:07:45.524489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.524611 (+   122us) service_pool.cc:224] Handling call
0709 13:07:48.465636 (+2941025us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400271354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.465844 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326891392}
I20260709 13:07:48.799276 26609 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:48.801331 26611 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:48.837028 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2193) took 2978 ms (client timeout 2197 ms). Trace:
W20260709 13:07:48.837697 26608 rpcz_store.cc:269] 0709 13:07:45.858146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.031452 (+173306us) service_pool.cc:224] Handling call
0709 13:07:48.836380 (+2804928us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000311d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.836671 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261259648}
I20260709 13:07:48.839812 28946 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.468716 28469 raft_consensus.cc:993] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:07:48.841116 28946 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:48.803169 26603 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:48.804414 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.807051 26679 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:48.522560 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2239) took 1112 ms. Trace:
I20260709 13:07:48.808163 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:48.844079 26680 rpcz_store.cc:276] 0709 13:07:47.410533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.424180 (+ 13647us) service_pool.cc:224] Handling call
0709 13:07:48.522350 (+1098170us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54001e8cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.522501 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110461824}
I20260709 13:07:48.844951 26681 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:48.846988 28889 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.809610 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.001s	sys 0.009s
I20260709 13:07:48.555035 28689 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.847905 28664 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:48.848011 28889 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.848594 28664 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:48.848321 28689 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.850195 28664 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:48.595821 28693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.948s	user 0.008s	sys 0.025s
W20260709 13:07:48.852188 28693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.213s	user 0.010s	sys 0.027s
I20260709 13:07:48.852375 28801 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.755681 28823 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:48.853209 28801 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.855623 28823 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.858175 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:48.858600 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.508219 28909 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.860379 28909 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:48.816589 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 250355us
I20260709 13:07:48.753867 28861 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.209960 26682 rpcz_store.cc:276] 0709 13:07:45.538906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.553373 (+1014467us) service_pool.cc:224] Handling call
0709 13:07:46.553628 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.553813 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:46.554117 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.206237 (+652120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.206287 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:47.206335 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.206397 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.206531 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241784,"prepare.queue_time_us":3015,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2086,"raft.queue_time_us":243891,"thread_start_us":409995,"threads_started":1,"wal-append.queue_time_us":513612}
I20260709 13:07:48.522663 28839 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.552111 28700 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.474074 28828 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.428938 28750 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.851279 28689 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.753162 28914 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.488814 28938 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.286280 28913 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.470s
I20260709 13:07:48.733569 28897 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:48.760483 28903 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:48.497491 28934 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:07:48.819353 28941 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.870219 28938 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.877964 28941 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.880285 28914 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.880616 28941 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:48.881242 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 171) took 2530 ms. Trace:
I20260709 13:07:48.851154 28889 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:48.762456 28883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.421s	user 0.015s	sys 0.019s
I20260709 13:07:48.881983 26759 rpcz_store.cc:276] 0709 13:07:46.350563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.350729 (+   166us) service_pool.cc:224] Handling call
0709 13:07:46.351090 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.081029 (+729939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.880587 (+1799558us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000dc0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:48.880986 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677088512}
I20260709 13:07:48.868570 28750 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:48.883409 28883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.545s	user 0.015s	sys 0.020s
I20260709 13:07:48.866770 28920 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.885943 28750 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.885619 28920 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.867125 28902 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:48.881135 26681 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:48.887812 28902 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.888986 28920 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.864595 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:48.890328 27317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 278) took 3495 ms (client timeout 2100 ms). Trace:
I20260709 13:07:48.890764 28902 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:48.858525 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.001s	sys 0.009s
I20260709 13:07:48.872402 28900 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.894731 26606 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:48.895315 27316 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:48.915781 28900 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.916432 28728 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:48.916924 28728 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:48.917743 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 307) took 1500 ms. Trace:
I20260709 13:07:48.918270 27316 rpcz_store.cc:276] 0709 13:07:47.417113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.418038 (+   925us) service_pool.cc:224] Handling call
0709 13:07:48.894804 (+1476766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.916050 (+ 21246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.917478 (+  1428us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54004a38d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.917650 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352731392}
I20260709 13:07:48.896445 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 892) took 2343 ms. Trace:
W20260709 13:07:48.875862 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.859567 26610 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:48.855962 28801 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.874220 28897 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.927186 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.856885 28661 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.928858 28661 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:48.919878 26760 rpcz_store.cc:276] 0709 13:07:46.553200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.645635 (+ 92435us) service_pool.cc:224] Handling call
0709 13:07:46.646020 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.223716 (+577696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.895745 (+1672029us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540011cbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:48.896234 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323924864}
I20260709 13:07:48.918491 28900 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:48.931571 28661 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:48.900339 28941 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.872041 28718 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:48.901266 28689 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:48.893525 27317 rpcz_store.cc:269] 0709 13:07:45.394433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.396815 (+  2382us) service_pool.cc:224] Handling call
0709 13:07:47.300438 (+1903623us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:48.889710 (+1589272us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54004a38d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:48.890038 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802750208}
I20260709 13:07:48.904004 28909 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.869519 28469 raft_consensus.cc:1081] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:07:48.904968 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:48.906016 28664 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.906132 28549 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.907145 26608 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:48.907521 26611 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:48.734696 28794 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.602913 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 885) took 2150 ms. Trace:
I20260709 13:07:48.913615 28946 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.914052 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.897598 28938 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:48.918443 28728 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.866578 28839 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.739097 28795 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.950803 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:48.951817 28728 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.952310 26681 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:48.953049 26682 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:48.953948 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:48.523626 27313 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:07:48.955511 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:48.955448 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.038329 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.036847 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.049997 26687 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:49.049482 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:48.867532 28700 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.080045 28951 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.080644 27313 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 4
I20260709 13:07:49.081140 27313 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:07:49.081670 27313 raft_consensus.cc:2917] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:07:49.081172 28951 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:48.968860 28718 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.082341 28700 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:49.083786 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.084544 28718 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.085047 28708 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.082382 27313 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.086073 28708 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.087045 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 285) took 1291 ms. Trace:
I20260709 13:07:49.054605 28941 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.048333 28689 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:49.155884 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 113358us
W20260709 13:07:49.187213 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 267558us
I20260709 13:07:48.101327 27319 rpcz_store.cc:276] 0709 13:07:46.559084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.577806 (+ 18722us) service_pool.cc:224] Handling call
0709 13:07:46.578356 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.614731 (+ 36375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.623101 (+  8370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.629297 (+  6196us) log.cc:844] Serialized 572 byte log entry
0709 13:07:46.986153 (+356856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.986194 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.990035 (+  3841us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.627703 (+637668us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:47.629586 (+  1883us) raft_consensus.cc:1685] finished
0709 13:07:47.629610 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.018751 (+389141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8924544,"thread_start_us":351978,"threads_started":1,"wal-append.queue_time_us":429676,"wal-append.run_cpu_time_us":4688,"wal-append.run_wall_time_us":1564101}
W20260709 13:07:49.140173 26576 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.823s (SENT)
I20260709 13:07:49.189855 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:49.191072 28661 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:49.084652 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.116067 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:49.193074 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.160480 26682 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.192220 28941 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.201560 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.203248 26680 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.157342 28900 raft_consensus.cc:1064] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:49.150090 28704 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:49.087577 27313 rpcz_store.cc:276] 0709 13:07:47.795300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.248780 (+453480us) service_pool.cc:224] Handling call
0709 13:07:48.249092 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.086600 (+837508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.086960 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.087843 28795 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.145385 28839 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.213387 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.148315 28794 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.088166 26757 rpcz_store.cc:276] 0709 13:07:46.451969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.589529 (+137560us) service_pool.cc:224] Handling call
0709 13:07:46.589856 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.028813 (+438957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.602552 (+1573739us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400201a54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:48.602820 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938839808}
I20260709 13:07:49.131101 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:49.219162 28632 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.219391 28805 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.219913 28632 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.220367 28805 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.223246 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:49.223793 26724 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.820s (SENT)
I20260709 13:07:49.224365 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:49.224488 26607 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:49.224566 26611 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:49.226379 26611 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:49.228724 28636 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:49.228953 28708 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.222270 28632 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.129799 28469 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:49.229549 28636 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.230186 28469 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:49.232061 28700 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.231289 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:49.232875 28469 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:49.232934 28700 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.230189 28636 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.241258 28951 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.242241 28693 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:49.236789 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 184104us
I20260709 13:07:49.244989 28897 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:49.246379 26759 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:49.247455 26760 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:49.248477 26759 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:49.249023 28822 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:49.249475 28822 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:49.250348 26752 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:49.251745 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.252508 26753 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:49.243016 28693 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:49.131420 28883 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:49.250716 28822 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.211335 28859 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.268878 26679 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.273248 28921 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:49.268759 28946 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:49.281492 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2237) took 1871 ms. Trace:
I20260709 13:07:49.281965 26683 rpcz_store.cc:276] 0709 13:07:47.409876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.411775 (+  1899us) service_pool.cc:224] Handling call
0709 13:07:47.420002 (+  8227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.465911 (+ 45909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.280596 (+1814685us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400305cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:49.281118 (+   522us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5400305cd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:49.281304 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97854720}
I20260709 13:07:49.282552 28859 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:49.293248 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.295842 28951 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:49.296584 28951 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.296936 28794 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:49.298451 28735 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:49.298538 28794 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:49.299239 28951 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.307614 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:49.327075 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.299296 28735 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:49.318558 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:07:49.359951 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 81490.7us
I20260709 13:07:49.361997 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.362668 26759 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:49.277981 28883 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.268497 28792 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:07:49.309028 28689 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:49.292168 28805 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.335041 28861 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.453176 26680 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:49.484223 26759 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:49.365044 26760 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:49.376322 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.436332 26687 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:49.369834 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 239035us
I20260709 13:07:49.309194 28946 consensus_queue.cc:1243] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:49.497538 26679 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:07:49.492038 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 131183us
I20260709 13:07:49.363493 26755 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:49.371457 26606 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:49.502439 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 195600us
I20260709 13:07:49.366457 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:49.482120 28957 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:49.316622 28632 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:49.503010 26755 pending_rounds.cc:85] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 2
I20260709 13:07:49.509670 26755 pending_rounds.cc:107] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:49.510030 26755 raft_consensus.cc:2889] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:49.482543 28944 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.721s	user 0.001s	sys 0.000s
W20260709 13:07:49.508769 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 244368us
I20260709 13:07:49.364107 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:49.368904 28956 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:49.516260 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.360508 28892 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.526561 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.360445 28941 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:07:49.528194 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.472420 28854 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.532296 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.535516 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.534749 26760 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:49.541920 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47005.8us
I20260709 13:07:49.521720 28839 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:49.551301 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.551819 28697 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:49.552479 26759 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:49.541325 28938 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:49.558082 26680 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:49.543488 28822 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:49.541944 28805 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.546936 28845 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:49.560055 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:49.409688 28693 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:49.562834 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.561126 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:49.547396 28728 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.000s
W20260709 13:07:49.565680 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.562592 26757 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:49.552209 27313 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:49.481756 28704 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:49.561789 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 261841us
I20260709 13:07:49.531371 28632 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.552346 28697 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.369387 28900 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.572026 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:49.564715 28845 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:49.584095 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:49.590371 26610 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:07:49.590828 26610 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:07:49.591032 26610 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:07:49.594617 26610 raft_consensus.cc:2917] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:07:49.572835 28697 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.572499 28854 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:49.595043 26610 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.571187 28938 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:49.598654 26679 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:49.577940 28735 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.602962 28735 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.590461 28728 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:49.608129 28728 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.610600 28728 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.584790 28892 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:49.616261 28891 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:49.611353 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:49.600318 28792 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:49.611838 28859 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.596690 28805 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.631317 28883 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.631609 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.633154 28766 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:49.635780 28892 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:49.636364 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76572.6us
I20260709 13:07:49.627713 28792 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.649279 26680 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:07:49.656625 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.657326 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.662062 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.650275 28792 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.651078 28766 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:07:49.667773 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 98827.3us
I20260709 13:07:49.672700 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.673785 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:49.675441 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.628391 28854 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:49.683634 28857 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:49.684561 28549 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.684719 28854 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.685184 28549 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:49.607740 28951 consensus_queue.cc:1175] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "687d192f79a044ce838f0bf292f0c09f" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:49.690429 28805 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.691444 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.691943 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e89d788bee4a128b18985e582217d9"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:49.692698 26757 raft_consensus.cc:606] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:49.693079 26757 raft_consensus.cc:614] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:49.692889 28845 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.694070 28845 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:49.694154 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.695031 26757 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:49.696574 26759 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:49.697646 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.698148 28892 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.698210 26759 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:49.699394 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.700464 28859 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:49.700951 28859 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.701323 28859 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.702486 28632 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.703696 28938 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.704419 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.705103 26761 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:49.706130 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.706775 26760 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:49.707846 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.708103 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.708738 27319 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:49.709594 26755 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:49.709748 28976 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:49.710994 28976 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:49.711373 28976 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:49.711525 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:49.712539 28976 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.713205 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:49.714123 28976 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:49.715337 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.715592 28708 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:49.715965 28891 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:49.716568 28708 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.717747 28891 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.715888 28632 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:49.719254 28632 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:49.719700 28632 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:49.721695 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:49.722966 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.687389 28549 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.715456 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:49.724833 26682 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:49.735960 28766 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:49.745657 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65424.7us
I20260709 13:07:49.749729 28728 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:49.750200 28728 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.750551 28728 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.724254 28857 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:49.748046 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:07:49.754202 28977 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:07:49.759382 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.754946 26755 raft_consensus.cc:606] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:07:49.769203 26686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 945) took 2457 ms (client timeout 2371 ms). Trace:
I20260709 13:07:49.769479 28857 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:49.769757 26686 rpcz_store.cc:269] 0709 13:07:47.311560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.326081 (+ 14521us) service_pool.cc:224] Handling call
0709 13:07:49.768714 (+2442633us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003c1754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:49.768947 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644715392}
I20260709 13:07:49.772464 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1192) took 4786 ms. Trace:
I20260709 13:07:49.773140 26758 rpcz_store.cc:276] 0709 13:07:44.985612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.221669 (+236057us) service_pool.cc:224] Handling call
0709 13:07:46.679856 (+1458187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.695786 (+ 15930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.772064 (+3076278us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540014f5d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:49.772247 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352917248}
I20260709 13:07:49.775565 26752 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:49.760510 28822 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.778607 28822 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.780974 28822 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:49.783963 26756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 176) took 2324 ms (client timeout 1938 ms). Trace:
W20260709 13:07:49.784391 26756 rpcz_store.cc:269] 0709 13:07:47.459007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.459143 (+   136us) service_pool.cc:224] Handling call
0709 13:07:49.783555 (+2324412us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000dcad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:49.783738 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24909056}
W20260709 13:07:49.786396 28943 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.023s	user 0.000s	sys 0.004s
I20260709 13:07:49.786129 28792 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.788161 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1190) took 1566 ms. Trace:
I20260709 13:07:49.788424 28850 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:49.788549 26604 rpcz_store.cc:276] 0709 13:07:48.221947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.226528 (+  4581us) service_pool.cc:224] Handling call
0709 13:07:48.226806 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.227197 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.227239 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.239712 (+ 12473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.433764 (+194052us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:48.433820 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.433929 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.785582 (+1351653us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:49.787683 (+  2101us) raft_consensus.cc:1685] finished
0709 13:07:49.787704 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.787965 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328,"raft.queue_time_us":99,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9799,"spinlock_wait_cycles":299772800,"thread_start_us":193547,"threads_started":1,"wal-append.queue_time_us":523023}
I20260709 13:07:49.790810 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.790900 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.792225 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:49.793303 27314 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:49.794342 28533 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.795946 28792 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.796741 28859 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.798954 28859 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.801328 28801 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:49.799803 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:49.800689 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:49.800575 28938 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:49.803996 26678 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:49.814695 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52311.4us
I20260709 13:07:49.775024 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:49.821971 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.821115 28859 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:49.816794 28693 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:49.824534 28982 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:07:49.829805 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.851686 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.830976 28735 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:49.852286 28735 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.852694 28735 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.853458 26686 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:49.856091 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.837311 28632 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.841548 28697 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.831033 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.858767 26752 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.845111 28728 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.856263 28883 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.849188 28965 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.344s	user 0.003s	sys 0.000s
I20260709 13:07:49.871275 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.870815 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.896775 26752 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:49.869762 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.875008 27318 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:49.879142 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1189) took 1657 ms. Trace:
I20260709 13:07:49.881718 26681 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:49.884783 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.870198 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.872619 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:49.891390 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.891938 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59260.2us
I20260709 13:07:49.871742 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:49.898002 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 141577us
I20260709 13:07:49.869011 28735 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.872213 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:49.917871 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.856007 28700 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:49.871605 28689 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:49.867776 28469 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:49.930387 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.930711 28469 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:49.931250 26759 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:49.931721 28661 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:49.931867 28469 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.932705 28724 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:49.933106 28724 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:49.899338 26612 rpcz_store.cc:276] 0709 13:07:48.221647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.221810 (+   163us) service_pool.cc:224] Handling call
0709 13:07:48.838912 (+617102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.842126 (+  3214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.842183 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.843163 (+   980us) log.cc:844] Serialized 52 byte log entry
0709 13:07:49.068081 (+224918us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:49.205086 (+137005us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.205291 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.209166 (+  3875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.275928 (+ 66762us) raft_consensus.cc:1685] finished
0709 13:07:49.275945 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.796264 (+520319us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800160300. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:49.878830 (+ 82566us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54000311d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:49.878957 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2245,"prepare.queue_time_us":136817,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5289,"raft.queue_time_us":6867,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":297,"spinlock_wait_cycles":1425558528,"thread_start_us":224353,"threads_started":1,"wal-append.queue_time_us":372873}
I20260709 13:07:49.933604 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1191) took 1656 ms. Trace:
I20260709 13:07:49.887918 28883 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.933897 28724 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:49.934013 26605 rpcz_store.cc:276] 0709 13:07:48.286533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.796040 (+509507us) service_pool.cc:224] Handling call
0709 13:07:48.796958 (+   918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.856155 (+ 59197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:48.856748 (+   593us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.054401 (+197653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.054453 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:49.054506 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.933294 (+878788us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54001135d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:49.933340 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.933453 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":856,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":5773,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8976,"spinlock_wait_cycles":135036416,"thread_start_us":191390,"threads_started":1,"wal-append.queue_time_us":291891}
I20260709 13:07:49.927839 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.928536 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.869793 28531 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:49.929153 28829 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.861337 28632 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.929929 26757 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:49.884117 28693 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:49.880534 28636 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:49.935238 28724 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.936084 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.928964 28697 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:49.969641 26761 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:50.001078 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 226366us
W20260709 13:07:49.990222 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.968292 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:49.936740 26756 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:49.982879 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:49.936041 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 115164us
I20260709 13:07:49.937547 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:49.966542 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:50.003782 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.970286 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:49.949012 26760 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:50.008349 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.009883 26754 raft_consensus.cc:2368] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
I20260709 13:07:49.927158 28689 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:50.011615 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.974174 28735 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.013377 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.015022 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:49.967694 28773 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.016394 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.002995 28829 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:50.014773 28533 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.970511 28661 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:07:50.021250 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51085us
I20260709 13:07:50.019579 26758 raft_consensus.cc:2376] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6. Re-sending same reply.
I20260709 13:07:50.019126 26754 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:50.022074 28829 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.042076 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.042834 26761 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:50.044289 28661 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:50.044728 28661 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.045500 28661 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.045640 28773 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.046797 28661 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.048012 28829 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.049674 28697 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:50.050060 28861 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.052587 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.052111 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.017146 28805 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:50.067539 28921 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.054752 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:50.067631 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:49.968245 28874 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:07:50.070089 28900 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:50.070605 28900 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:50.058153 28689 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.071918 28773 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.072077 26678 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:50.072441 28689 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.059432 26609 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:50.078658 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 187) took 1168 ms. Trace:
I20260709 13:07:50.079759 28979 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.071568 28900 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.081015 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 957) took 1128 ms. Trace:
I20260709 13:07:50.019559 28728 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.060123 28894 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:50.081421 28900 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.085534 28531 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.052533 28951 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:07:50.086109 28531 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.081463 26678 rpcz_store.cc:276] 0709 13:07:48.952362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.046261 (+ 93899us) service_pool.cc:224] Handling call
0709 13:07:49.790485 (+744224us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:50.080927 (+290442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7740288}
I20260709 13:07:50.088229 28531 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:50.085182 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.089141 27285 leader_election.cc:400] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
W20260709 13:07:50.089365 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.089524 27285 leader_election.cc:403] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:50.079291 26609 rpcz_store.cc:276] 0709 13:07:48.910344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.912441 (+  2097us) service_pool.cc:224] Handling call
0709 13:07:48.912949 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.075879 (+1162930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.078296 (+  2417us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540035f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:50.078575 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635836672}
W20260709 13:07:50.089998 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.091259 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.053555 26754 raft_consensus.cc:2376] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5. Re-sending same reply.
I20260709 13:07:50.061439 27312 raft_consensus.cc:2410] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:50.061250 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:50.052696 27319 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:50.062456 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:50.063091 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.063512 28989 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.065021 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.068200 28883 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.068814 27320 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.055689 28693 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.068447 28921 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.080576 28979 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.022168 28854 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.018879 28859 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.093075 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.096168 26758 raft_consensus.cc:2376] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5. Re-sending same reply.
I20260709 13:07:50.097728 26761 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:50.099102 26756 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:50.100399 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:50.101353 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92248.1us
I20260709 13:07:50.101290 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.103729 26612 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.104578 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.105587 28897 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:50.105780 28766 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:50.106246 28897 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.106333 28766 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:50.106920 28766 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.107090 28951 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:50.097069 28533 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.110580 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.111794 28989 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.105615 28854 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:50.115986 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53642.5us
I20260709 13:07:50.116222 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.117203 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.117488 28854 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.117832 26607 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:50.118767 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.111824 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.118690 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:50.120026 26761 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:50.119586 26607 raft_consensus.cc:2410] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:07:50.121508 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.121376 26761 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:50.124718 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:50.114567 28989 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.127420 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.137986 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.140751 26758 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:50.142061 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.142887 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.146534 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:50.144565 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.149070 26761 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:50.149279 26611 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:50.136586 28664 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:50.160028 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.164103 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.136972 28854 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:50.166354 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.166976 26604 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.167954 28664 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.168386 28664 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.172248 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.172868 26611 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.175945 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.178995 26612 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:50.179694 27320 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:50.180850 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.182137 26611 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:50.188284 26758 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:50.188791 26758 pending_rounds.cc:85] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:07:50.176594 26607 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:50.190089 26604 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:50.191325 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.192044 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.192730 26611 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:50.146237 28951 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:50.161798 28991 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:07:50.197789 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:50.150105 28989 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.202757 26758 pending_rounds.cc:107] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:50.203342 26758 raft_consensus.cc:2889] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.203152 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.143364 28794 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:07:50.205636 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.195226 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.212357 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.212513 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.107446 28897 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.148774 28859 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.153496 28728 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.240084 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.238955 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.205333 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.250303 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:50.255764 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.240877 28764 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:50.188575 28773 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
I20260709 13:07:50.263598 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.200731 28938 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:50.283304 26612 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:50.298470 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.306252 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.324061 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.346755 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.351151 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.353015 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.354076 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.308306 28938 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.364270 26607 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:50.365521 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.366638 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 176705us
I20260709 13:07:50.300196 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.207850 28724 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:50.371539 26604 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:50.370095 26610 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:50.204711 28766 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.315333 28661 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:50.373703 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 174854us
I20260709 13:07:50.265326 28989 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.201361 28839 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:50.378157 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.315106 28857 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.380749 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.384693 26611 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:50.372376 28938 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.385106 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:50.383908 28661 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.388060 28661 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.390606 27321 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:50.385942 28988 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.382028 28839 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.392323 28839 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.397015 28766 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.398589 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.308143 28728 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:50.399271 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.399329 26761 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.400391 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.401245 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:50.377889 28724 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:07:50.410068 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.412947 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.403195 28801 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:50.423763 29001 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:07:50.424160 28859 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.424924 28728 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.425278 28921 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.425513 28728 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:50.426136 28728 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.414906 28857 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.427631 26753 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:50.428093 28857 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:50.429018 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.413893 28977 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:50.432339 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.433283 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:50.434300 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.434423 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.412406 28822 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:50.436293 28822 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.436692 28822 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.437026 28822 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.435457 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.416363 28801 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.440106 28801 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.440587 26611 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:50.442173 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.442780 26611 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:50.446336 28997 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:50.447546 26607 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:50.448781 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.450584 26607 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.420082 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.451692 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.453178 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.452214 26607 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.451011 28822 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.453039 26608 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:50.456637 26611 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:50.457000 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:50.436296 28724 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.471606 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:50.466593 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.472801 28921 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.474471 27316 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
W20260709 13:07:50.478663 28998 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:07:50.479338 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.480139 28989 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.496690 26761 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:50.480548 28979 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:50.482908 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.427237 28664 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.458702 28977 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:50.495975 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83153.9us
I20260709 13:07:50.498093 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.497263 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.501003 28859 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:50.505813 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.507364 29006 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:50.508013 27319 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:50.499724 28795 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:50.510730 28664 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.512540 29006 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:50.513577 29006 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.518736 28857 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.518015 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:50.519943 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 926682us
I20260709 13:07:50.513754 28839 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.525133 27313 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 3 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:50.525614 27319 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:07:50.519980 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62188.8us
I20260709 13:07:50.501698 28728 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.521852 28795 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.522351 28977 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.523223 28822 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.528928 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:50.533192 29011 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:50.533352 28859 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.533524 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:50.534080 28632 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:50.561216 28632 consensus_queue.cc:1243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:50.561846 28632 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:50.562242 28632 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:50.534628 28894 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:50.536291 28829 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:50.536926 26611 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:50.537695 28795 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.539299 26754 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:50.540529 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 956) took 1588 ms. Trace:
I20260709 13:07:50.540894 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.544312 28977 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.545650 28728 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:50.569190 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.545861 28839 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.521080 28979 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:07:50.577416 28664 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:50.567680 26685 rpcz_store.cc:276] 0709 13:07:48.951971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.045251 (+ 93280us) service_pool.cc:224] Handling call
0709 13:07:49.139797 (+ 94546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.413241 (+273444us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:49.639923 (+226682us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.779485 (+139562us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b18001885c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3557 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:50.443226 (+663741us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18001885c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:07:50.443411 (+   185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.443977 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.444150 (+   173us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.444359 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.444526 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.540073 (+ 95547us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001e87d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:50.540130 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.540182 (+    52us) raft_consensus.cc:1685] finished
0709 13:07:50.540195 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.540341 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1092,"prepare.queue_time_us":201184,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":98,"raft.queue_time_us":26842,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":63559,"spinlock_wait_cycles":384296448,"thread_start_us":121193,"threads_started":2,"wal-append.queue_time_us":97626}
I20260709 13:07:50.559576 28938 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.578015 28664 consensus_queue.cc:1243] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:50.578778 27318 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:50.563289 28632 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.565063 28951 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.546736 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.547268 28897 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:50.548547 26724 leader_election.cc:336] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.706s (SENT)
I20260709 13:07:50.549613 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.583118 26753 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.549924 26604 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.551855 28794 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:50.528903 28891 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:50.540544 26605 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:50.567559 26754 pending_rounds.cc:85] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 2
I20260709 13:07:50.587498 26754 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:50.587805 26754 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.571640 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.572450 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.574862 28735 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.566219 28805 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:50.566339 28892 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:50.575906 28801 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.575400 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.576282 28728 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.588913 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.592536 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:50.601079 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.641268 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:50.625516 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.581200 28632 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:50.643415 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55036.5us
W20260709 13:07:50.644901 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 96390.7us
I20260709 13:07:50.648682 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.656810 26752 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.649425 26761 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:50.655894 26756 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:50.662268 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.581166 28822 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:07:50.669028 28728 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.645270 28892 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:50.647733 29011 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:50.673273 28801 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.653543 28764 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:50.648108 28946 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.646371 28735 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:50.679944 26724 leader_election.cc:336] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.739s (SENT)
I20260709 13:07:50.733407 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:50.681890 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.641023 28938 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.684221 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.740279 28900 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.684955 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.741434 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.685289 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.690685 26603 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:50.691538 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.692138 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 51388.8us
I20260709 13:07:50.692726 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.692939 28805 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:50.748769 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.750500 28805 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.750655 26758 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.750959 28805 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.751977 28764 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:50.753044 28764 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.754287 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.755432 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.758213 26758 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:50.759642 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.760011 26685 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:50.759685 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:50.760735 28883 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.761161 28883 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.761466 28883 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.763031 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.763558 26758 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.763906 28946 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.766114 28946 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:50.759370 28735 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:50.768139 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.744138 28892 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:50.770183 26610 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.772914 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.748358 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 68459.5us
W20260709 13:07:50.774932 26724 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.086s (SENT)
I20260709 13:07:50.741508 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:50.769276 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.776446 26761 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:50.701022 28854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.014s
I20260709 13:07:50.797016 26752 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:50.798961 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.800052 26611 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
W20260709 13:07:50.802802 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.807938 28854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.013s	sys 0.014s
I20260709 13:07:50.867215 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.831570 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:50.861541 26758 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:50.869979 26604 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:50.870509 26603 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:50.872054 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.872910 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 98023.7us
W20260709 13:07:50.873641 26724 leader_election.cc:336] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.095s (SENT)
I20260709 13:07:50.874013 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:50.875093 26724 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.105s (SENT)
I20260709 13:07:50.875496 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:50.876515 28689 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.872308 26753 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
W20260709 13:07:50.881095 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.884496 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.883543 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.816809 28938 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:50.898326 26761 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:50.899418 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:50.904884 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 219656us
I20260709 13:07:50.906040 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.867861 29011 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:50.907692 26606 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:50.909541 26757 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:50.913275 26757 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:50.897675 28735 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.915203 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.894834 28854 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:07:50.903880 28718 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:50.903703 28792 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.912186 28938 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:50.914518 28989 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:50.938400 26603 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:50.914255 29011 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.926156 28632 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:50.946416 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.947099 26604 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:50.929282 28822 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.920910 28735 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:50.956866 26757 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:50.948256 28689 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.937224 28718 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:50.970551 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:50.971375 26605 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.974712 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:50.976040 28988 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.976548 28988 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.976981 28988 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.985064 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:50.991865 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45532us
I20260709 13:07:50.960834 28632 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:50.994091 26604 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:50.969784 28735 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.996433 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:50.994993 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47341.1us
I20260709 13:07:50.957527 28900 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:50.999598 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:51.000584 26757 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.000411 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:50.985486 28854 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.003644 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.002318 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:51.016019 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.017910 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.998059 28822 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:50.996886 28632 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.016800 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:51.021991 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.030910 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.002666 28989 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.031636 26604 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.997071 28829 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:51.015070 28859 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.043013 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.024896 28795 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.048239 26603 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:51.033383 28728 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:51.054891 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58865.7us
I20260709 13:07:51.042580 28845 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:51.044510 28989 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:51.062932 28805 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:51.064263 29019 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:51.076327 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:51.083321 29017 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:07:51.064877 28728 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:51.088282 28883 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.088837 28728 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.090526 28883 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.091147 28883 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.097043 28792 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.066038 28718 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.097752 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.099272 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.099418 28792 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.100256 29034 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.047576 28938 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.101183 27320 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:51.101673 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.102495 29033 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:51.102593 28792 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:51.103140 29033 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:51.103639 29033 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.103271 28989 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.103924 28792 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.105306 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:07:51.111374 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.114641 26604 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:51.107857 28805 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:51.122705 27321 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:51.130995 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:51.131814 27318 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:51.131878 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.131896 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.132545 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:51.133680 26679 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:51.130520 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 93821us
I20260709 13:07:51.143544 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.137104 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.166762 26678 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:51.169957 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 110041us
I20260709 13:07:51.129655 28822 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.172384 26687 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:51.169932 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.178004 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.131960 28845 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.179579 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.184144 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.186475 29030 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:51.187378 29034 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:51.187799 29034 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.188169 29034 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.160928 29035 raft_consensus.cc:2764] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:51.137247 28805 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:51.204706 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.206336 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.178524 28689 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:51.209331 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.212039 26682 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:51.180637 28894 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.186892 29030 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:51.192276 29031 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:51.213644 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.217976 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.218380 26679 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:07:51.211707 28689 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:51.233244 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 46962.8us
I20260709 13:07:51.213245 29037 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.192399 28822 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.218792 29030 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.217993 29031 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.203394 28805 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.194978 28845 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.244298 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.249063 26679 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:51.252348 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.256242 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.239795 28689 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.268525 26605 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:51.218111 29035 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:07:51.273231 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.219795 28894 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.272153 28829 raft_consensus.cc:1064] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:07:51.248440 29031 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:51.282891 28845 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.296650 26757 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:51.281206 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.284556 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.245507 28664 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:07:51.226008 28988 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:51.306097 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.306689 26684 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.307726 26686 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:51.245543 29037 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:51.302031 28829 raft_consensus.cc:1068] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:51.320252 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 77343.4us
I20260709 13:07:51.321146 26608 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:07:51.327466 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75226us
I20260709 13:07:51.356460 26686 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:51.341531 28829 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.358547 26679 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:51.362327 29042 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:07:51.363037 29040 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:51.378470 29037 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:51.379894 29055 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:51.380154 29062 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:51.380762 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.383957 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.388857 26684 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:51.384861 29034 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:51.391404 29038 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.394205 29052 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.396900 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.395797 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:51.405618 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.435931 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.385200 27319 raft_consensus.cc:1217] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:07:51.433694 28794 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.395704 29062 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:51.438861 29060 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:51.372985 28829 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.396983 29037 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:51.395170 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 329) took 1705 ms. Trace:
I20260709 13:07:51.438577 28894 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:51.433261 29038 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.460767 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.423923 26684 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:51.471222 29034 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.474781 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.472965 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.444512 27319 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:51.479983 26684 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:51.475634 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 79951.7us
I20260709 13:07:51.478144 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 924) took 1342 ms. Trace:
I20260709 13:07:51.476372 29051 raft_consensus.cc:2764] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:51.459837 28805 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.488133 28805 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:51.488677 29015 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.457s	user 0.003s	sys 0.001s
I20260709 13:07:51.488940 28632 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:51.490319 29053 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:51.493059 29062 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:51.495015 29044 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:07:51.494922 28689 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.495791 29049 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:51.496398 28988 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.497366 26683 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:51.485350 26754 rpcz_store.cc:276] 0709 13:07:50.132377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.132521 (+   144us) service_pool.cc:224] Handling call
0709 13:07:50.132789 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.623029 (+490240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.474038 (+851009us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54000dbbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:51.474222 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933585280}
I20260709 13:07:51.452157 27312 rpcz_store.cc:276] 0709 13:07:49.680376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.680939 (+   563us) service_pool.cc:224] Handling call
0709 13:07:51.370724 (+1689785us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54005406d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:51.385259 (+ 14535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807965952}
I20260709 13:07:51.460513 28894 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.514686 28689 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.460204 29037 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.443359 28794 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.518905 28794 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.497305 28697 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:51.521239 28735 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.002s
I20260709 13:07:51.521713 28735 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.523953 26685 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:51.495415 29030 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:51.526788 29030 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.474347 29033 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.554780 29033 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.565030 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.566576 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.567155 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:51.567806 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 131995us
I20260709 13:07:51.568162 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.569082 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.569746 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.566823 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.571008 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.571642 26755 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:51.571447 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.572590 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:51.573637 26752 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:51.578938 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.564440 29062 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.559312 29031 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.585937 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.576815 28697 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.587561 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.588138 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2223) took 1469 ms. Trace:
I20260709 13:07:51.597021 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.598752 26609 rpcz_store.cc:276] 0709 13:07:50.114006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.202604 (+ 88598us) service_pool.cc:224] Handling call
0709 13:07:51.582843 (+1380239us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540037a0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:51.582968 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049330944}
I20260709 13:07:51.581115 28951 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:51.604331 28951 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:51.605507 28951 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.606505 28951 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.606680 28822 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:51.595481 28854 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.608170 28854 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.571432 29055 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:51.598253 26752 pending_rounds.cc:85] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 1
I20260709 13:07:51.610208 26752 pending_rounds.cc:107] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:51.610507 26752 raft_consensus.cc:2889] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:51.581137 29037 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.615303 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.615221 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.584079 28938 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:51.600848 28845 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.617865 29068 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.587487 28794 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:51.618348 29067 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.634856 29067 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:51.635244 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.635982 26609 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:51.635833 29067 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.637074 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.638646 26760 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:51.639525 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.639859 26760 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:51.640174 26604 raft_consensus.cc:2376] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7. Re-sending same reply.
I20260709 13:07:51.640817 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.641614 26754 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:51.642537 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.643158 26754 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:51.643265 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.643932 26758 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:51.644275 26761 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:51.628153 28805 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:51.645460 26761 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:51.619035 26611 raft_consensus.cc:2376] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6. Re-sending same reply.
I20260709 13:07:51.644701 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.646683 26761 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:51.646075 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.647753 26756 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:51.648204 26753 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:51.648739 26756 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:51.649118 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:51.649852 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48268us
I20260709 13:07:51.650143 28845 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.651500 28632 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.651916 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:51.652200 28632 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.653407 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:51.653230 28632 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:51.654541 26758 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:51.659181 26761 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:51.669683 26758 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:51.672305 26758 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:51.674499 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.675267 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.676090 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.678977 29037 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:51.679576 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:51.679730 29037 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:51.680286 26684 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.681180 29037 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.595445 29030 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:51.684764 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:51.690168 26684 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:51.691291 26685 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:51.696533 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:07:51.694434 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.696579 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:51.702487 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49135.6us
I20260709 13:07:51.653347 28854 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.654754 28891 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:51.652235 28845 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.617942 28988 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:51.618238 29069 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.677325 28951 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:51.713641 26684 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:51.720518 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.684331 28861 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:51.677186 28989 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.717280 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:51.684000 28976 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:51.723505 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:51.724520 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.724432 28891 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.725656 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.729866 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.726352 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:07:51.724462 26724 leader_election.cc:336] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.486s (SENT)
I20260709 13:07:51.618070 29064 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 13:07:51.728643 26605 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:51.728912 26610 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:51.729388 26606 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:51.755128 26607 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:51.732288 26612 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:51.738075 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.753819 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.756956 26603 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:51.730444 26609 raft_consensus.cc:2376] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6. Re-sending same reply.
I20260709 13:07:51.715296 28822 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.761551 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.763396 26610 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:51.769986 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45566.4us
I20260709 13:07:51.770102 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.770694 26605 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.772022 26610 pending_rounds.cc:85] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 2
I20260709 13:07:51.772356 26610 pending_rounds.cc:107] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:51.772634 26610 raft_consensus.cc:2889] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:51.726227 28861 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:51.782325 26604 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:51.758546 29064 consensus_queue.cc:1243] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:51.783434 26612 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:51.789245 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.793469 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.802261 26685 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:51.770802 28951 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:51.769840 28976 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.795962 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:51.774777 28822 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:51.796682 28891 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:51.795998 28861 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.797565 27319 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:51.797466 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:51.803145 26686 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:51.733048 28989 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.728579 28988 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:51.807572 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 122859us
I20260709 13:07:51.789098 29052 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.823935 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.813683 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.817808 26686 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:51.827431 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62999us
I20260709 13:07:51.829007 26605 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:51.830364 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.825090 29031 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:51.859792 28795 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:07:51.886124 28976 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:51.886447 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:51.908583 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.870932 26686 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:51.819320 27312 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:51.907867 26604 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:51.834250 28951 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:51.930295 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 132888us
I20260709 13:07:51.931253 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.932157 26685 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:51.932376 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:51.934321 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56744.8us
I20260709 13:07:51.832647 29052 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.833778 29011 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:07:51.907366 28861 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.944545 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:51.941768 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.945963 26679 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:51.931423 29055 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:51.936760 29072 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:51.948901 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:51.928557 28689 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:51.952656 29075 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:07:51.954408 29076 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:07:51.962081 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.962657 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.964004 28951 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:51.968726 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.969157 26604 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:51.971819 26761 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:51.972611 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.982790 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:51.983675 26758 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:07:52.002254 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:52.003168 26761 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:07:52.006145 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 73838us
I20260709 13:07:52.008471 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.012566 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:52.013321 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.019402 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.020401 26679 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:52.020920 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:52.021521 26758 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:52.023561 26761 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:52.024080 26758 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:52.021085 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:51.946933 29069 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.026173 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.030915 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:52.032023 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.036499 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:52.039798 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.909582 29082 consensus_queue.cc:1175] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "77c617823f2e4a938ef247a8924e299b" responder_term: 4 status { last_received { term: 4 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:52.040906 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:52.039517 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.043538 26611 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:52.045032 26604 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:52.018816 29068 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.016180 29055 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.048768 26651 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:51.952674 28664 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:07:52.010581 28689 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:52.071640 28845 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:52.072655 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.073199 28689 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:52.073796 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.074891 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.055687 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.037742 28976 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:52.037392 28795 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:07:52.077004 28883 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:52.056555 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.077917 29052 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:52.078364 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.078562 29052 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:52.078828 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.058416 28951 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:52.079900 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.059918 26756 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.079905 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:52.059682 29031 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.947640 28822 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.060860 26760 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:52.063939 29080 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:52.043830 28894 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.069422 26757 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:52.069217 29055 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:52.070295 29057 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.578s	user 0.000s	sys 0.003s
I20260709 13:07:52.070511 28989 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:52.051468 28794 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:52.082913 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.102982 26685 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:52.084131 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.080895 26756 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.079303 29052 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:52.088160 28951 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.049407 28839 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:52.089525 28664 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.090153 29062 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:52.090602 28900 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.080427 29068 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:07:52.091383 28689 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:52.091914 29038 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:52.092252 29031 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:52.095089 29069 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.100662 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:52.104274 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.117228 29052 consensus_queue.cc:1243] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:52.117301 28951 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.108450 29080 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.105880 28794 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.107416 26756 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.134613 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.140096 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.134058 29069 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.147008 28794 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.146234 29038 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:52.156272 29092 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:52.159696 28951 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:52.161836 29079 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.164023 26756 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.164199 28900 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.169862 28801 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.146740 28883 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:07:52.149554 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.135857 29031 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:52.176154 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:52.206996 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 149421us
I20260709 13:07:52.226567 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.227254 26685 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:52.227402 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.228526 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:52.232026 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.180215 29031 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.250419 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.205139 29038 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.258590 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.181739 29011 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:07:52.238873 28883 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.271451 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.272940 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.274163 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.253669 29078 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:52.250798 29086 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.251770 29094 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:52.277508 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 176941us
W20260709 13:07:52.283533 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127312us
I20260709 13:07:52.287132 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:52.152513 29069 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.298184 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.254010 28805 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:07:52.294816 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 214964us
W20260709 13:07:52.296211 26726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.343s (SENT) [suppressed 33 similar messages]
I20260709 13:07:52.280376 29078 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.306315 26685 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:52.266342 28632 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:52.311604 26756 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:52.318470 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.299371 29052 raft_consensus.cc:2764] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:07:52.313928 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 260082us
I20260709 13:07:52.323006 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:52.296463 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 251086us
I20260709 13:07:52.300242 29068 consensus_queue.cc:1243] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:52.324231 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.321245 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:52.327045 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.329501 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:52.332255 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 82059.2us
I20260709 13:07:52.332705 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.333014 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:52.334614 26685 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:52.320449 29069 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.315157 29078 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.316632 28859 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:52.388057 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.421017 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.434947 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:07:52.436417 26685 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.334221 28632 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.334444 28795 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:52.437014 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68045.8us
I20260709 13:07:52.331596 29103 raft_consensus.cc:2764] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:52.360828 28989 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:52.299101 29094 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:52.335835 29091 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.145s
W20260709 13:07:52.491575 29097 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:52.510710 26685 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:52.334280 29068 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
W20260709 13:07:52.565191 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 268995us
W20260709 13:07:52.492355 29104 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:07:52.472720 28632 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:52.597754 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 347385us
I20260709 13:07:52.368702 29106 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.243s
I20260709 13:07:52.606318 26756 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:52.606839 26756 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.564400 29011 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.606319 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.607722 26756 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.436882 29052 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:07:52.420310 28801 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:52.614759 26756 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.620574 29073 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.612803 28805 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:07:52.621361 28805 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:52.621766 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:52.622205 28805 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.622539 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 180) took 1223 ms. Trace:
W20260709 13:07:52.623091 28861 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.003s
I20260709 13:07:52.623651 28861 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.624017 28861 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:52.624784 28861 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.625844 28861 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.628456 29114 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:52.629168 29114 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.630627 28874 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:52.631017 28874 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.630280 29114 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:52.633406 29108 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:07:52.637029 28892 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.637454 28892 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:52.638183 28892 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.639320 28892 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.639781 29083 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:52.640787 29088 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.641350 26682 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:52.641443 29088 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.645354 28951 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:52.645764 28951 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:52.614547 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:52.650625 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:52.657291 29082 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.657724 29082 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.658037 29082 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.658722 28861 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:52.659106 28861 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.659428 28861 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.660343 29107 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:07:52.659909 28874 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.661203 28874 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.664696 29052 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.665097 29052 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.665917 29052 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.666704 28861 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.667042 29052 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.667734 29095 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:07:52.668958 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 173) took 1458 ms. Trace:
I20260709 13:07:52.669301 26681 rpcz_store.cc:276] 0709 13:07:51.210925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.211067 (+   142us) service_pool.cc:224] Handling call
0709 13:07:51.222796 (+ 11729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.223145 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.223177 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.223635 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.937378 (+713743us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b1800331660. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:07:52.041201 (+103823us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.041244 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.041351 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.668685 (+627334us) raft_consensus.cc:1685] finished
0709 13:07:52.668704 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.668900 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17619,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":13101,"spinlock_wait_cycles":11031296,"thread_start_us":103626,"threads_started":1,"wal-append.queue_time_us":878887}
I20260709 13:07:52.670660 28829 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:52.612003 29106 consensus_queue.cc:1243] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:52.622956 26687 rpcz_store.cc:276] 0709 13:07:51.399423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.621498 (+1222075us) service_pool.cc:224] Handling call
0709 13:07:52.622482 (+   984us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.672714 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.673460 28697 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:52.673085 28632 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:52.673857 28697 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.674257 28697 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.675757 29105 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.676342 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.676654 29113 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:52.677211 29113 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:52.680872 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.562278 28795 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 13:07:52.701449 29112 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:07:52.701758 29118 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:52.708240 26757 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:52.710671 26757 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.674472 28632 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.706776 28689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.020s	sys 0.006s
I20260709 13:07:52.737258 26757 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:52.738359 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.738399 26757 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:52.740064 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 378869us
I20260709 13:07:52.744490 26756 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:52.620079 28801 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:52.747620 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 426432us
W20260709 13:07:52.740803 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 276158us
I20260709 13:07:52.739511 26685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55252
I20260709 13:07:52.665122 29094 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:52.758641 26685 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.667472 29036 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:07:52.655738 29011 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.775087 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:52.784559 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 307585us
I20260709 13:07:52.730225 29113 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:52.803995 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.800906 26610 raft_consensus.cc:1217] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
W20260709 13:07:52.792845 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.800709 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.814466 26610 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:52.813820 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:52.784291 29079 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.006s
W20260709 13:07:52.746435 28689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.020s	sys 0.006s
I20260709 13:07:52.794840 26757 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:52.820776 26685 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:52.798306 28900 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.006s
I20260709 13:07:52.729290 29129 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:52.765551 29062 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:52.763777 28801 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.765257 29088 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:52.859723 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 103711us
I20260709 13:07:52.838227 29079 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.828510 28689 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:52.842284 28900 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:52.888094 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68725us
W20260709 13:07:52.863097 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.853410 29126 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 13:07:52.873086 29124 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:07:52.874905 29122 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:07:52.876454 29110 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:52.900172 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:52.880844 28794 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.001s
I20260709 13:07:52.837764 28664 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 13:07:52.880301 29109 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:52.902662 26758 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:52.903235 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.907415 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:52.886976 29137 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:52.904951 29038 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.006s
I20260709 13:07:52.919852 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1227) took 1808 ms. Trace:
I20260709 13:07:52.920418 26608 rpcz_store.cc:276] 0709 13:07:51.111948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.112122 (+   174us) service_pool.cc:224] Handling call
0709 13:07:51.112567 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.321591 (+209024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.919511 (+1597920us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003796d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:52.919781 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479121664}
I20260709 13:07:52.891194 29088 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:52.925529 28859 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:52.929170 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 987) took 1756 ms. Trace:
I20260709 13:07:52.929579 26678 rpcz_store.cc:276] 0709 13:07:51.172921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.173076 (+   155us) service_pool.cc:224] Handling call
0709 13:07:51.195094 (+ 22018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.275084 (+ 79990us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:51.367509 (+ 92425us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.589955 (+222446us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.590148 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.590189 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:51.590250 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.648991 (+ 58741us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18003a7620. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:07:52.928538 (+1279547us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b18003a7620. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419
0709 13:07:52.928954 (+   416us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b54003052d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:52.929004 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.929115 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28459,"prepare.queue_time_us":218702,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":8521,"raft.queue_time_us":11783,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5346,"spinlock_wait_cycles":201851264,"thread_start_us":301910,"threads_started":2,"wal-append.queue_time_us":299761,"wal-append.run_cpu_time_us":1768,"wal-append.run_wall_time_us":1086596}
I20260709 13:07:52.939889 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:52.947359 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.917140 29038 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:52.939888 28689 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.907733 28794 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:52.958770 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:52.961107 26678 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:07:52.907346 29110 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.955739 29079 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.966023 29069 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:07:52.957832 29147 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:52.962738 29137 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:52.975332 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68009.7us
I20260709 13:07:52.963974 29103 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:52.966869 29011 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:52.960800 29094 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:52.980005 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.005528 26678 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:52.968571 28989 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:52.980934 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:07:52.981705 29031 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
W20260709 13:07:52.982370 29065 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.462s	user 0.006s	sys 0.000s
I20260709 13:07:52.990559 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:52.990656 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.010627 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.991532 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.992208 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:52.992837 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:52.975071 29150 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:53.001032 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 99021.8us
I20260709 13:07:52.978055 29137 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.009178 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.018416 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.017026 26685 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.020769 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.021837 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.026886 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.027652 26608 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:07:53.001022 28632 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:53.060005 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.019995 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.033190 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:52.973773 29079 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.033062 26608 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:53.062294 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.032866 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.063113 26678 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 2.
I20260709 13:07:53.064116 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.064872 28632 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:53.068316 29146 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:07:53.021293 29031 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.071166 29031 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:53.071086 29082 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:52.980057 29147 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:52.985114 28697 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.075379 29147 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.018416 29150 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:53.076573 28697 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:53.018019 29011 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.078334 28801 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.061759 28989 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.081646 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 61758.7us
I20260709 13:07:53.064904 26678 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:53.090687 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:53.099586 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.102895 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.028815 29137 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.032650 29103 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.105690 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.106202 26608 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:53.108482 28892 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:53.111450 29149 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:07:53.111631 28857 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:53.111753 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.114084 28857 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.114542 28857 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.112325 28801 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:53.112535 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.112939 28469 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.116420 29148 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.116779 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.116927 29148 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.118027 26678 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:53.119289 29148 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.113005 29103 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:53.120157 29143 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:07:53.120249 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.120863 29141 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.121407 26678 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:53.121730 29103 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.121941 28861 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.079178 29011 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.122521 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.123106 26678 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:53.124089 26608 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:53.090204 29088 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.125366 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:53.123991 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.127231 28735 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.128253 28892 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:53.079558 29150 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.129494 29150 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.132896 26678 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:53.136435 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 378339us
I20260709 13:07:53.100018 28989 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.139129 26680 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:53.139559 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:53.140776 26609 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:53.141126 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 182) took 1668 ms. Trace:
I20260709 13:07:53.137300 28861 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:53.142516 26680 rpcz_store.cc:276] 0709 13:07:51.472814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.026255 (+1553441us) service_pool.cc:224] Handling call
0709 13:07:53.141069 (+114814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.149015 26603 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:53.149791 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.150663 26680 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:53.141826 29088 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:53.160743 29011 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.160784 29152 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:53.162990 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.163589 29079 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.167573 26680 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.172430 29137 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.162171 29088 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:53.175048 26684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2267) took 1383 ms (client timeout 1609 ms). Trace:
W20260709 13:07:53.176414 29078 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.000s
I20260709 13:07:53.176458 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2272) took 1372 ms. Trace:
W20260709 13:07:53.188625 26684 rpcz_store.cc:269] 0709 13:07:51.791346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.806906 (+ 15560us) service_pool.cc:224] Handling call
0709 13:07:53.174845 (+1367939us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001eaad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:53.174989 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470362368}
W20260709 13:07:53.180701 27286 connection.cc:256] RPC call timeout handler was delayed by -1.1090556890000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:07:53.151623 29144 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.152855 28861 consensus_queue.cc:1243] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:53.138033 28892 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:53.190860 29088 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.201400 28951 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.202746 28951 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.184571 29152 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:53.204022 29152 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.204368 28989 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.205107 26686 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.208770 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 980) took 2563 ms. Trace:
I20260709 13:07:53.209175 26683 rpcz_store.cc:276] 0709 13:07:50.645404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.126738 (+481334us) service_pool.cc:224] Handling call
0709 13:07:51.127131 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.497849 (+370718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.208534 (+1710685us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54000c49d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:53.208710 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850991872}
I20260709 13:07:53.188410 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:53.192898 27286 connection.cc:256] RPC call timeout handler was delayed by -1.0431085259999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 13:07:53.191069 26612 rpcz_store.cc:276] 0709 13:07:51.804611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.804755 (+   144us) service_pool.cc:224] Handling call
0709 13:07:51.815790 (+ 11035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.865852 (+ 50062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.865883 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.927950 (+ 62067us) log.cc:844] Serialized 572 byte log entry
0709 13:07:52.017704 (+ 89754us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:52.019458 (+  1754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.176098 (+1156640us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b5400249854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:53.176144 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.176188 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:53.176202 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.176397 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114280832,"thread_start_us":88774,"threads_started":1,"wal-append.queue_time_us":188254,"wal-append.run_cpu_time_us":1766,"wal-append.run_wall_time_us":1001777}
I20260709 13:07:53.195715 28883 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:53.212950 28883 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:07:53.214051 29030 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:53.213759 28883 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.198761 29144 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.214684 27316 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:53.212540 29157 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:53.210480 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.215487 29157 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.216248 29144 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.217506 28805 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.217991 28805 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.214736 28883 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:53.222630 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.223402 26682 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:53.223938 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.216184 26683 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:07:53.225204 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.225914 26683 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:53.226315 26683 pending_rounds.cc:85] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 5
I20260709 13:07:53.226406 26684 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.226717 26683 pending_rounds.cc:107] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:53.226996 26683 raft_consensus.cc:2889] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.227082 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2275) took 1341 ms. Trace:
I20260709 13:07:53.227691 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2273) took 1407 ms. Trace:
I20260709 13:07:53.194953 29078 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.228107 26683 rpcz_store.cc:276] 0709 13:07:51.819963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.225356 (+1405393us) service_pool.cc:224] Handling call
0709 13:07:53.225604 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.227467 (+  1863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.227622 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:53.229152 29123 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
I20260709 13:07:53.226347 29148 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:53.229848 29078 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.230118 29148 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:53.230540 29148 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:53.231563 26680 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:07:53.232648 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 58306.5us
I20260709 13:07:53.233027 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:53.218273 29157 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.235208 26686 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:53.250710 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 183) took 1777 ms. Trace:
W20260709 13:07:53.236984 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.251037 26686 rpcz_store.cc:276] 0709 13:07:51.473150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.777076 (+303926us) service_pool.cc:224] Handling call
0709 13:07:51.793564 (+ 16488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.204647 (+1411083us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002a38a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3205a1d 00007f40f31ec1a4 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419
0709 13:07:53.250456 (+ 45809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.250657 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310172032}
I20260709 13:07:53.212185 26678 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:53.229066 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.239500 26682 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.227439 26684 rpcz_store.cc:276] 0709 13:07:51.885530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.225995 (+1340465us) service_pool.cc:224] Handling call
0709 13:07:53.226238 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.226859 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.227032 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.249809 26680 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:53.252259 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:53.260617 26604 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:53.260895 26604 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:53.253216 26686 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:53.258409 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.258561 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2278) took 1372 ms. Trace:
I20260709 13:07:53.259155 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2276) took 1373 ms. Trace:
I20260709 13:07:53.276757 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:53.259590 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2280) took 1372 ms. Trace:
I20260709 13:07:53.277216 26682 rpcz_store.cc:276] 0709 13:07:51.886443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.238943 (+1352500us) service_pool.cc:224] Handling call
0709 13:07:53.239323 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.258321 (+ 18998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.258509 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.277479 26684 rpcz_store.cc:276] 0709 13:07:51.887118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.258854 (+1371736us) service_pool.cc:224] Handling call
0709 13:07:53.259121 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.259291 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.259314 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.259367 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:53.259398 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.259449 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.259540 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.278654 26682 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.278878 26684 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.279491 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 999) took 1342 ms. Trace:
I20260709 13:07:53.283804 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2281) took 1347 ms. Trace:
I20260709 13:07:53.258585 26683 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:53.283816 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.284109 26684 rpcz_store.cc:276] 0709 13:07:51.936856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.278494 (+1341638us) service_pool.cc:224] Handling call
0709 13:07:53.278720 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.279228 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.279417 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.277269 26680 rpcz_store.cc:276] 0709 13:07:51.885820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.232235 (+1346415us) service_pool.cc:224] Handling call
0709 13:07:53.232518 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.258935 (+ 26417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.259107 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.286372 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:53.287693 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:53.261658 26604 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.288754 26604 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.289597 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1000) took 1329 ms. Trace:
I20260709 13:07:53.284667 26682 rpcz_store.cc:276] 0709 13:07:51.936529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.278214 (+1341685us) service_pool.cc:224] Handling call
0709 13:07:53.278497 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.279014 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.283744 (+  4730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.289958 26680 rpcz_store.cc:276] 0709 13:07:51.959912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.286081 (+1326169us) service_pool.cc:224] Handling call
0709 13:07:53.289150 (+  3069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.289309 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.289331 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.289368 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:53.289398 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.289448 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.289548 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.291154 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.291430 26682 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:07:53.290378 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2279) took 1403 ms. Trace:
I20260709 13:07:53.292042 26686 rpcz_store.cc:276] 0709 13:07:51.886745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.252789 (+1366044us) service_pool.cc:224] Handling call
0709 13:07:53.253058 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.290153 (+ 37095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.290319 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.292734 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.251753 29035 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.297290 26683 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.262009 28976 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:53.299085 26680 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.306324 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1006) took 1344 ms. Trace:
I20260709 13:07:53.304359 29035 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.305075 28829 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.297838 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1004) took 1336 ms. Trace:
I20260709 13:07:53.258700 29147 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.306814 26680 rpcz_store.cc:276] 0709 13:07:51.961702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.290981 (+1329279us) service_pool.cc:224] Handling call
0709 13:07:53.298925 (+  7944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.306025 (+  7100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.306256 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.304622 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.302942 26604 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:53.310165 26682 rpcz_store.cc:276] 0709 13:07:51.961168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.290945 (+1329777us) service_pool.cc:224] Handling call
0709 13:07:53.291222 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.297603 (+  6381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.297787 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.303354 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.308089 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1002) took 1347 ms. Trace:
I20260709 13:07:53.308431 26686 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:53.309409 26678 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:53.311487 26686 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:53.311393 26683 rpcz_store.cc:276] 0709 13:07:51.960576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.289697 (+1329121us) service_pool.cc:224] Handling call
0709 13:07:53.289938 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.307846 (+ 17908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.308031 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.311911 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.231382 29148 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.320158 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.290297 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.315189 26679 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:53.323889 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1008) took 1361 ms. Trace:
I20260709 13:07:53.317423 26611 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:53.230129 28857 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.327628 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.328214 26680 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.311954 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1001) took 1351 ms. Trace:
I20260709 13:07:53.329785 26678 rpcz_store.cc:276] 0709 13:07:51.960286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.287133 (+1326847us) service_pool.cc:224] Handling call
0709 13:07:53.307910 (+ 20777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.311739 (+  3829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.311906 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.261837 29038 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:53.324298 26679 rpcz_store.cc:276] 0709 13:07:51.962253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.314440 (+1352187us) service_pool.cc:224] Handling call
0709 13:07:53.314837 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.323555 (+  8718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.323819 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.336807 26679 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:53.337302 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1010) took 1374 ms. Trace:
I20260709 13:07:53.337592 26679 rpcz_store.cc:276] 0709 13:07:51.962741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.336232 (+1373491us) service_pool.cc:224] Handling call
0709 13:07:53.336489 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.337101 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.337251 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.338104 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1009) took 1375 ms. Trace:
I20260709 13:07:53.338474 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.339033 26679 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.319125 28891 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.319476 28829 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.333253 28857 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.323004 28735 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.356793 28735 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.340373 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.359576 28735 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:53.360823 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.361280 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.361546 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.524425 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.362107 29088 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.364645 26679 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:53.324868 28805 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.322288 28861 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.338483 26681 rpcz_store.cc:276] 0709 13:07:51.962500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.316470 (+1353970us) service_pool.cc:224] Handling call
0709 13:07:53.337611 (+ 21141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.337788 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.337816 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.337860 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:53.337893 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.337946 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.338041 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.366811 26681 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:53.367576 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2282) took 1403 ms. Trace:
I20260709 13:07:53.368007 26681 rpcz_store.cc:276] 0709 13:07:51.964276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.366165 (+1401889us) service_pool.cc:224] Handling call
0709 13:07:53.366587 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.367292 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.367524 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.335433 29132 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:53.343324 26759 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:53.349994 28829 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.350726 28891 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:53.364112 26510 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.305274 29144 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:53.370187 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2283) took 1405 ms. Trace:
I20260709 13:07:53.378814 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.372393 26679 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:53.373263 26759 pending_rounds.cc:85] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 6
I20260709 13:07:53.321408 28976 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:53.300261 28801 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:53.386117 26686 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.383895 28845 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:53.377928 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.378038 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.324329 29145 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:53.370996 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:53.379711 26759 pending_rounds.cc:107] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:53.389546 26759 raft_consensus.cc:2889] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.383734 26680 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:07:53.380689 26612 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:53.379222 26681 rpcz_store.cc:276] 0709 13:07:51.964580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.369293 (+1404713us) service_pool.cc:224] Handling call
0709 13:07:53.369632 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.369854 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.369890 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.369938 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:53.369976 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.370021 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.370124 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.389147 26611 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:53.323074 29147 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.380476 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2284) took 1415 ms. Trace:
I20260709 13:07:53.393635 26679 rpcz_store.cc:276] 0709 13:07:51.964864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.371873 (+1407009us) service_pool.cc:224] Handling call
0709 13:07:53.372205 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.380249 (+  8044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.380425 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.373056 29148 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.372826 29132 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:53.389616 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:53.394923 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.397182 28891 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:53.395916 26686 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.397943 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:53.398962 28891 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.390785 29145 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.400012 29145 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.401057 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:53.401784 28891 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:53.402149 28891 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.402469 28891 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.404330 29152 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.405486 26686 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:53.405089 28976 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.406191 26686 pending_rounds.cc:85] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 2
I20260709 13:07:53.406543 26686 pending_rounds.cc:107] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:53.406950 26686 raft_consensus.cc:2889] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.410648 29152 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.413724 29106 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:53.414113 29106 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:53.413303 28891 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.425119 28891 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.385689 29144 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:53.421917 29160 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:53.393414 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.394686 29137 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.426367 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1007) took 1464 ms. Trace:
I20260709 13:07:53.450803 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:53.450752 26686 rpcz_store.cc:276] 0709 13:07:51.961970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.292777 (+1330807us) service_pool.cc:224] Handling call
0709 13:07:53.308327 (+ 15550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.426129 (+117802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.426311 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.451718 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:53.452050 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.452310 26607 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.452411 28883 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.452737 26686 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:53.453634 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:53.454126 26686 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:53.406224 29132 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.433324 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:53.461735 26678 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:07:53.461063 26686 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:53.451100 29088 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.468633 26686 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:53.476807 26607 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:07:53.484596 26686 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:53.414942 29106 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.486560 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2267) took 1764 ms. Trace:
I20260709 13:07:53.492020 26606 rpcz_store.cc:276] 0709 13:07:51.722248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.764466 (+ 42218us) service_pool.cc:224] Handling call
0709 13:07:51.800294 (+ 35828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.800680 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.800718 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.821544 (+ 20826us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.250288 (+428744us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.250332 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.250407 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.661353 (+410946us) raft_consensus.cc:1685] finished
0709 13:07:52.661372 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.477128 (+815756us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54002391d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:53.486491 (+  9363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1085,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7704,"spinlock_wait_cycles":81574144,"thread_start_us":319519,"threads_started":1,"wal-append.queue_time_us":444730}
I20260709 13:07:53.523236 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.509251 26686 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:53.531199 26686 pending_rounds.cc:85] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 3
I20260709 13:07:53.531539 26686 pending_rounds.cc:107] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:53.531879 26686 raft_consensus.cc:2889] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.531926 29145 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.524268 29088 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.534520 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.535089 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.535372 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.534179 29088 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.538259 29088 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.539978 29011 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.540766 26686 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:53.540571 29011 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.541093 26686 pending_rounds.cc:85] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 3
I20260709 13:07:53.541332 26686 pending_rounds.cc:107] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:53.541515 28946 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.542088 28946 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.542876 29011 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.541553 26686 raft_consensus.cc:2889] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.556840 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.486194 29148 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:53.560568 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.558636 29106 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.563237 26754 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:53.564652 26754 pending_rounds.cc:85] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 6
I20260709 13:07:53.565521 26754 pending_rounds.cc:107] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:53.566370 26754 raft_consensus.cc:2889] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.563441 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.570153 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.569082 29148 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.561214 28874 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.555296 29137 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.570241 29136 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.578181 28946 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.579833 29052 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:53.575047 29148 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.584251 29144 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.576360 29137 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.585523 26678 pending_rounds.cc:85] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 2
I20260709 13:07:53.585830 26678 pending_rounds.cc:107] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:53.586081 26678 raft_consensus.cc:2889] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.586277 29137 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.600786 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:53.602669 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.603516 26754 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:53.561523 28900 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.606271 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:53.611868 26754 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.610126 28946 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:53.628325 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:53.610566 29136 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:53.630292 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:53.630368 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.644223 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:53.645030 27320 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:07:53.644891 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:53.660354 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.662468 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.645334 28874 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:53.669479 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.652004 29052 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.631860 28900 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:53.651470 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:53.667613 28874 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:53.666858 28976 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.650449 29030 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:53.698001 28988 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:53.699997 29119 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.110s	user 0.004s	sys 0.000s
I20260709 13:07:53.703331 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:53.734854 26760 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:53.734900 26754 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:53.684664 29145 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:53.737219 29172 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:07:53.672868 29033 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.657871 29062 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:53.673031 29068 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.663879 28946 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:07:53.647432 29136 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.726351 28874 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:53.740088 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.741520 29033 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.774839 29033 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:07:53.668979 29144 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:53.778031 29147 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:53.786533 29173 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:53.729117 29106 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:53.788201 29082 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.787981 29106 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.790874 26679 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:53.791088 29106 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.793042 26680 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:53.795143 26680 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:53.751490 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.757082 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.798517 26754 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:07:53.799023 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.800086 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.800611 26752 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:53.801362 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.801664 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:53.802409 26754 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.759196 29136 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:53.750283 29145 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.804265 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.807511 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:53.746902 29132 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.808116 26752 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:53.814050 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1265) took 1783 ms (client timeout 1834 ms). Trace:
W20260709 13:07:53.815462 26761 rpcz_store.cc:269] 0709 13:07:52.030535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.030657 (+   122us) service_pool.cc:224] Handling call
0709 13:07:53.813817 (+1783160us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400201a54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:53.813985 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525336960}
I20260709 13:07:53.815838 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:53.753518 29068 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.817286 26761 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:53.817633 26761 pending_rounds.cc:85] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 2
I20260709 13:07:53.817850 26761 pending_rounds.cc:107] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:53.818089 26761 raft_consensus.cc:2889] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.822021 26761 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:53.829064 26754 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:53.808321 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.749998 28976 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:53.830556 29132 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.820894 28794 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.874993 26755 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:07:53.848210 26760 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:07:53.878258 26760 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:53.881759 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 154676us
I20260709 13:07:53.808259 29145 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:53.823362 29068 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:53.874046 29174 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:53.896800 26761 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260709 13:07:53.888628 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.887728 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:53.837656 27316 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:53.873792 28946 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.900640 29175 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:07:53.912150 29067 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:53.938057 26761 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:53.931414 29086 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.937754 28946 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.959932 26752 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:53.949184 29086 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:53.984342 29145 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:53.985327 28976 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:53.988016 28946 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:53.968586 29110 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:54.006518 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.006361 28874 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.029939 28874 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:54.037832 28664 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.038323 28664 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:54.045890 26685 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.029711 29086 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.048368 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55252 (request call id 2266) took 2270 ms. Trace:
I20260709 13:07:54.039151 28664 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.049328 26685 rpcz_store.cc:276] 0709 13:07:51.788967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.600130 (+811163us) service_pool.cc:224] Handling call
0709 13:07:54.045775 (+1445645us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b4c0022d7c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f155ca20 00007f40f156da29 00007f40f156e13f 00007f40f15322ab 00007f40f155ff3c 00007f40f15603fe 00007f40f17ed88b 00007f40f31ec495 00007f40f323d30f 00007f40f3287a55 00007f40f8257cd0
0709 13:07:54.046408 (+   633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88784768}
I20260709 13:07:54.052582 28632 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.056443 28664 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.066926 26510 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.068524 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 181) took 4102 ms. Trace:
I20260709 13:07:54.069012 26510 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:54.068991 26759 rpcz_store.cc:276] 0709 13:07:49.965676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.972420 (+  6744us) service_pool.cc:224] Handling call
0709 13:07:49.972708 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.390024 (+3417316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.068257 (+678233us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b54002e95d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:54.068456 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7744714496}
I20260709 13:07:54.079162 29113 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:54.093884 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.108438 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:54.109067 26685 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.111807 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.113524 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.105801 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:54.120453 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:54.125237 26757 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.128032 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.129083 26757 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:54.132372 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.132146 26678 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:54.134315 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:54.135212 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:54.135777 26687 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.138108 26757 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:54.139564 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.140925 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.144763 26755 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:54.147917 26685 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:54.148476 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.159535 26604 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:54.132092 29137 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.136602 29110 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.137064 28632 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:54.177562 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.161672 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.179790 26755 raft_consensus.cc:2410] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:54.182830 26687 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:54.155465 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:54.173775 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.175608 26753 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:54.191732 26684 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:54.190054 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.192934 26759 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:54.201647 29171 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.503s	user 0.003s	sys 0.000s
I20260709 13:07:54.203868 28689 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:54.204404 28689 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:54.205490 28689 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.206964 28689 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.207202 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:54.160326 29137 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.160975 29106 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:54.214402 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81094.6us
I20260709 13:07:54.221451 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.224395 26604 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:54.224623 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:54.225345 26606 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:54.215746 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:54.222232 26753 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:54.233964 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:07:54.226770 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.239159 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.239827 26757 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:54.231756 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.242910 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.243259 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.245741 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:54.247941 26612 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:54.253149 29132 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:54.246191 28938 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:54.254316 28938 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:54.255191 28938 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:54.232522 29106 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:54.257504 29106 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:54.258934 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.260185 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.260605 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.261840 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.266393 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.215299 28874 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:54.231798 28946 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.218534 28632 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:54.218840 28900 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:54.269482 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.226462 28469 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.272964 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.276837 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:54.273280 29113 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:54.329510 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.334474 29207 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:54.335321 29207 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.338774 29121 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.340400 29121 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:54.340773 29121 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:54.290573 29148 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.313401 29132 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:54.283862 29106 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:07:54.278887 28874 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.361258 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1252) took 1366 ms. Trace:
I20260709 13:07:54.361830 26608 rpcz_store.cc:276] 0709 13:07:52.995261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.113085 (+117824us) service_pool.cc:224] Handling call
0709 13:07:53.113370 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.124430 (+ 11060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.360939 (+1236509us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400088c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:54.361176 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23861504}
I20260709 13:07:54.290915 28900 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.277854 28946 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.341636 29121 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.310387 28469 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.349594 29207 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:54.430071 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1241) took 1437 ms (client timeout 1834 ms). Trace:
W20260709 13:07:54.430719 26609 rpcz_store.cc:269] 0709 13:07:52.992694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.012653 (+ 19959us) service_pool.cc:224] Handling call
0709 13:07:54.429807 (+1417154us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54003791d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:54.429981 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170857728}
I20260709 13:07:54.342330 29113 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.364410 28989 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:07:54.350157 28632 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:54.673993 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 381907us
W20260709 13:07:54.582697 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.545586 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 190203us
I20260709 13:07:54.790141 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:07:54.675576 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.792392 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.438364 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.793308 26683 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:07:54.705458 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 329) took 1530 ms. Trace:
I20260709 13:07:54.795831 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:54.599957 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:54.679989 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44199.4us
W20260709 13:07:54.806406 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.807011 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.791594 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:54.635090 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:54.813133 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.814620 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:54.815471 26604 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:54.807212 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:54.817764 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:54.819314 26604 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.794477 27321 rpcz_store.cc:276] 0709 13:07:53.175218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.176595 (+  1377us) service_pool.cc:224] Handling call
0709 13:07:53.176959 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.218923 (+ 41964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.218952 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.219375 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.308528 (+ 89153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:53.308566 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.673285 (+1364719us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b5400642dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:54.673340 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.673387 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:54.673401 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.705374 (+ 31973us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":917,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":95698816,"thread_start_us":88816,"threads_started":1,"wal-append.queue_time_us":112018,"wal-append.run_cpu_time_us":1554,"wal-append.run_wall_time_us":1007575}
I20260709 13:07:54.438126 29073 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.400530 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 308) took 1075 ms. Trace:
I20260709 13:07:54.882436 26610 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:54.380873 29147 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.440s
I20260709 13:07:54.696545 29068 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.830170 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.830389 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.822942 26604 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:54.398706 29011 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.437s
I20260709 13:07:54.899593 28900 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:54.901008 29011 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:54.624603 29201 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
W20260709 13:07:54.626549 29205 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:07:54.836031 29194 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.547s	user 0.001s	sys 0.000s
I20260709 13:07:54.596716 28469 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:54.803299 28664 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.001s
I20260709 13:07:54.715891 29131 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:54.908172 29131 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:54.909121 29131 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.910135 29131 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:54.473191 29207 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.916098 29207 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.886176 27314 rpcz_store.cc:276] 0709 13:07:53.325201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.277689 (+952488us) service_pool.cc:224] Handling call
0709 13:07:54.311345 (+ 33656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.344465 (+ 33120us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:54.350083 (+  5618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.352026 (+  1943us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:54.356354 (+  4328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.372123 (+ 15769us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.397525 (+ 25402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.918967 29207 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:54.800172 29121 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:54.706780 29137 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.893045 27317 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:54.879897 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:54.879540 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:54.930449 29137 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.931547 26510 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:07:54.933568 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.933499 26510 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.935252 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.900964 28900 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:54.894912 26651 connection.cc:256] RPC call timeout handler was delayed by -1.0144738859999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:07:54.597581 28976 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:54.628963 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 344) took 1353 ms. Trace:
I20260709 13:07:54.936906 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:07:54.575337 29091 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.968029 29091 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.767792 29200 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 13:07:54.971711 29200 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:54.972157 29200 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:54.973097 29200 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.973445 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.974181 29200 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:54.974737 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.975158 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.975345 26683 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:54.975965 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:54.977017 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:54.979071 29035 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:54.892530 29106 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.979579 28976 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.980191 29106 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:54.980763 29106 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.981666 28976 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.954666 29068 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.983835 29067 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.984125 29068 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:54.984469 29067 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.986392 29086 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.987018 29086 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.889986 29073 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.989528 29086 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.990172 29086 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.990679 29086 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.991726 29082 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.992358 29082 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:54.994791 29082 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:54.996591 26684 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:07:54.997052 26684 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 3
I20260709 13:07:54.997308 26684 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:07:54.997605 26684 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:07:54.998039 26684 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:54.998270 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.998812 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.999158 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.886052 29132 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:54.999902 29132 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:55.001039 29132 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.002313 29132 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:55.004987 29113 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:55.005962 29197 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.006597 29197 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.009225 29197 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.012501 28946 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:54.960961 27316 rpcz_store.cc:276] 0709 13:07:53.275603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.289161 (+ 13558us) service_pool.cc:224] Handling call
0709 13:07:53.323305 (+ 34144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.935098 (+611793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.628556 (+693458us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400560254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:54.628873 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142835968}
I20260709 13:07:54.954149 29193 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.014741 29193 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:55.016426 27313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 330) took 1682 ms (client timeout 1644 ms). Trace:
W20260709 13:07:55.016870 27313 rpcz_store.cc:269] 0709 13:07:53.334280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.016200 (+1681920us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:55.016327 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:55.017493 29193 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.018740 26611 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:55.020136 26682 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:55.040258 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.042618 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:55.041152 26683 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:55.044478 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:55.044775 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.946007 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:54.472144 29033 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:54.597885 29093 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:55.049149 26687 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:54.882541 29148 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:07:55.047515 26607 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:54.944994 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:55.045033 26683 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
W20260709 13:07:55.071508 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.081614 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.082765 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.083365 26686 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:55.066859 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:55.089025 26683 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:07:55.099907 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.100797 26680 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:54.970723 29091 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.065090 26684 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:07:55.051134 29193 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.989570 29073 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:55.087814 29036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.012s
I20260709 13:07:55.050115 28938 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.052424 29198 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.067945 29033 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.050343 29116 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:55.067704 29093 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.064249 28951 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.204010 28951 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.055760 29082 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.089646 28976 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.128609 29091 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.168798 29036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.008s	sys 0.012s
W20260709 13:07:55.216984 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.229453 28951 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:55.239645 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.192392 29064 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.250242 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.221453 29073 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.187472 29193 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.205314 29082 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.223624 29144 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:55.222304 29093 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:55.296376 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 500136us
W20260709 13:07:55.299161 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 482774us
I20260709 13:07:55.191463 28938 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:55.314246 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.023s
W20260709 13:07:55.314818 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.003s	sys 0.023s
I20260709 13:07:55.256599 29148 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.222819 28976 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.201908 29198 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.256115 29218 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.354431 29218 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.357303 29218 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.359853 29145 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:55.360424 29145 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:55.361534 29145 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:55.364456 29203 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:07:55.316123 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 524545us
W20260709 13:07:55.334477 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.365942 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.245945 29091 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.271749 29067 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.260057 29073 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.353664 29198 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:55.366220 29195 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:07:55.372766 26612 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:55.300154 29144 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:55.367134 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:55.368848 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.026s
W20260709 13:07:55.369524 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.350975 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:55.417651 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66764.8us
I20260709 13:07:55.418649 27284 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:55.418669 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.011s	sys 0.029s
W20260709 13:07:55.421206 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 623941us
I20260709 13:07:55.317907 29210 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:55.366379 29068 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.313966 29064 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:55.368600 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 309) took 2018 ms. Trace:
I20260709 13:07:55.345837 29148 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.416278 29145 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.441743 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.442449 26684 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:55.445883 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.446601 26678 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:55.416393 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.034s	sys 0.019s
W20260709 13:07:55.447775 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.034s	sys 0.020s
W20260709 13:07:55.419821 26759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.015s	sys 0.014s
W20260709 13:07:55.449623 26759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.016s	sys 0.014s
W20260709 13:07:55.376861 28728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.017s	sys 0.021s
I20260709 13:07:55.425940 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.377118 29218 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:55.433640 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:55.451997 26683 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:55.453804 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1003) took 1194 ms. Trace:
W20260709 13:07:55.405151 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.455144 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:55.455905 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.456661 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:55.457340 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:55.418476 29086 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:55.457957 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 650747us
I20260709 13:07:55.459563 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:55.460242 26610 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:07:55.460371 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:55.430056 28988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.009s
I20260709 13:07:55.450435 26682 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:07:55.450446 26761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.002s	sys 0.017s
W20260709 13:07:55.451215 28728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.018s	sys 0.022s
I20260709 13:07:55.377661 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:55.460999 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:55.444736 29110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.012s	sys 0.006s
I20260709 13:07:55.430684 29216 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.473388 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 430857us
I20260709 13:07:55.474013 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:55.475044 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:55.475340 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:07:55.462791 28988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.010s	sys 0.009s
W20260709 13:07:55.464426 27285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.023s	sys 0.032s
I20260709 13:07:55.430318 29210 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:07:55.448432 29121 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:07:55.487397 27285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.023s	sys 0.032s
W20260709 13:07:55.446182 28794 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.010s
W20260709 13:07:55.471185 26752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.020s	sys 0.032s
W20260709 13:07:55.472043 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 94461.6us
I20260709 13:07:55.488480 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:55.451807 29214 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.458532 28989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.025s
I20260709 13:07:55.466662 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:55.489176 26752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.020s	sys 0.032s
I20260709 13:07:55.489738 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:07:55.490841 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.491029 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:55.493294 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.492156 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:55.444121 29068 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.498322 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1006) took 1237 ms. Trace:
W20260709 13:07:55.463125 26761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.002s	sys 0.017s
I20260709 13:07:55.501866 29222 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:55.502941 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 222) took 1223 ms. Trace:
W20260709 13:07:55.504012 28632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.016s
I20260709 13:07:55.504408 29224 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:55.504658 28632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.016s
I20260709 13:07:55.505383 26685 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:55.505707 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 224) took 1111 ms. Trace:
W20260709 13:07:55.506733 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 292515us
I20260709 13:07:55.508365 29236 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:55.509370 29236 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:55.509644 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.510185 29236 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:55.510579 29236 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:55.510932 29236 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:55.490347 29110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.012s	sys 0.006s
W20260709 13:07:55.492156 28794 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.010s
I20260709 13:07:55.495110 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:07:55.492980 28989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.011s	sys 0.025s
I20260709 13:07:55.506316 26760 rpcz_store.cc:276] 0709 13:07:54.394554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.896800 (+502246us) service_pool.cc:224] Handling call
0709 13:07:54.897142 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.897392 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:55.109772 (+212380us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.505183 (+395411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.505251 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.505318 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.505407 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.505551 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167068,"prepare.queue_time_us":221580,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":95,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":394649,"threads_started":1,"wal-append.queue_time_us":390840}
I20260709 13:07:55.491344 28728 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:55.503523 26753 rpcz_store.cc:276] 0709 13:07:54.279518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.790555 (+511037us) service_pool.cc:224] Handling call
0709 13:07:54.790917 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.791145 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:55.064628 (+273483us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.500903 (+436275us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.502259 (+  1356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.502319 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:55.502401 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.502784 (+   383us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.502882 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":229442,"prepare.queue_time_us":273406,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":9753,"raft.queue_time_us":1443,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"thread_start_us":435293,"threads_started":1}
I20260709 13:07:55.488557 29086 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:55.525399 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:55.468202 29093 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:07:55.509450 26608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.006s	sys 0.007s
I20260709 13:07:55.494663 29067 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:55.539125 29067 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:55.540340 29067 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.446017 29064 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.470679 29137 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:55.527385 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:55.501960 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1004) took 1242 ms. Trace:
I20260709 13:07:55.435257 27317 rpcz_store.cc:276] 0709 13:07:53.348242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.629854 (+1281612us) service_pool.cc:224] Handling call
0709 13:07:54.630308 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.928238 (+297930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.366294 (+438056us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005a3554. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:55.366520 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482218240}
I20260709 13:07:55.512831 28951 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.496966 29033 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:55.495393 29091 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.494235 29121 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.497498 29214 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:55.506831 29226 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:07:55.515455 29144 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.514568 29210 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.498868 26752 rpcz_store.cc:276] 0709 13:07:54.260485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.262646 (+  2161us) service_pool.cc:224] Handling call
0709 13:07:54.262917 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.263181 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:54.263422 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.497858 (+1234436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.497932 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:55.498012 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.498100 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.498250 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23615,"prepare.queue_time_us":2913,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":4085,"spinlock_wait_cycles":2944,"thread_start_us":1230115,"threads_started":1}
W20260709 13:07:55.806586 29212 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.544s	user 0.002s	sys 0.001s
I20260709 13:07:55.819551 29198 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:55.543766 27287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.015s
I20260709 13:07:55.848259 29216 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:55.821743 29086 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:55.850728 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 323409us
W20260709 13:07:55.557021 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.454212 26759 rpcz_store.cc:276] 0709 13:07:54.259698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.260977 (+  1279us) service_pool.cc:224] Handling call
0709 13:07:54.261230 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.261423 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:54.263426 (+  2003us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.453395 (+1189969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.453456 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:55.453532 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.453612 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.453742 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":517,"prepare.queue_time_us":1593,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":3324,"thread_start_us":1186311,"threads_started":1}
I20260709 13:07:55.851184 29086 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:55.667797 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.730527 29231 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:07:55.798791 28664 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:55.621137 29068 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:55.804704 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2283) took 1009 ms. Trace:
W20260709 13:07:55.808887 26509 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 209) took 25286 ms (client timeout 15000 ms). Trace:
I20260709 13:07:55.850401 29238 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:55.694231 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:55.728377 28874 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:55.811425 26510 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 3 to 5, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:07:55.600871 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.023s	sys 0.031s
I20260709 13:07:55.849227 29198 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:55.788957 29242 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:07:55.760495 29225 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.761528 29235 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:55.692610 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:55.529085 28728 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:55.825289 29197 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:55.788527 28689 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.581s	user 0.010s	sys 0.007s
I20260709 13:07:55.546350 28632 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:55.615090 28938 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:55.573244 29193 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.521984 29230 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:07:55.849470 27287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.019s	sys 0.023s
I20260709 13:07:55.601264 29228 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:55.778597 29132 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.005s
W20260709 13:07:55.801328 29106 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.000s
W20260709 13:07:55.650530 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 189866us
W20260709 13:07:55.543462 29199 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:07:55.664064 29219 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
W20260709 13:07:55.856626 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.029s	sys 0.035s
W20260709 13:07:55.856714 26608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.006s	sys 0.018s
I20260709 13:07:55.851645 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.011126 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 223) took 1731 ms. Trace:
W20260709 13:07:56.055619 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.997351 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.722638 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.857224 26761 rpcz_store.cc:276] 0709 13:07:54.259976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.261423 (+  1447us) service_pool.cc:224] Handling call
0709 13:07:54.261713 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.261914 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:54.472733 (+210819us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.501442 (+1028709us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.501585 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.501635 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:55.501703 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.501773 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.501906 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":633627,"prepare.queue_time_us":86254,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1579,"raft.queue_time_us":870,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":1186463,"threads_started":2,"wal-append.queue_time_us":1071186}
W20260709 13:07:56.131784 26681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.026s	sys 0.028s
W20260709 13:07:56.010591 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.033s
I20260709 13:07:55.853772 26612 rpcz_store.cc:276] 0709 13:07:54.795492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.795599 (+   107us) service_pool.cc:224] Handling call
0709 13:07:55.804495 (+1008896us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540003ded4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:55.804632 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161408256}
W20260709 13:07:56.009194 26726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.020s
W20260709 13:07:56.139425 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.135929 26754 rpcz_store.cc:276] 0709 13:07:54.279817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.798055 (+518238us) service_pool.cc:224] Handling call
0709 13:07:54.798366 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.798763 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.798802 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.801076 (+  2274us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.216389 (+415313us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b18001aad00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:07:55.530857 (+314468us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:55.539189 (+  8332us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.540215 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.540324 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.866993 (+326669us) raft_consensus.cc:1685] finished
0709 13:07:56.010881 (+143888us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.011053 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8111,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":89113,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":46294,"spinlock_wait_cycles":41204096,"thread_start_us":314255,"threads_started":1,"wal-append.queue_time_us":904680}
I20260709 13:07:55.856101 26510 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.011572 26610 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:55.795471 29131 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.002s
W20260709 13:07:56.139585 26681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.026s	sys 0.029s
W20260709 13:07:56.123926 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.018s	sys 0.021s
W20260709 13:07:55.993891 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.528486 29211 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:07:55.853487 28900 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.624534 29073 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.859139 29198 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:56.140090 26726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.028s
I20260709 13:07:56.223052 29073 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.222892 28900 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:55.694633 29200 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
I20260709 13:07:56.223640 29073 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:55.601260 29196 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.259s	user 0.002s	sys 0.003s
I20260709 13:07:55.859519 28728 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.776714 29064 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:55.854139 29238 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.226969 29238 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.226929 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 220) took 1948 ms. Trace:
I20260709 13:07:56.227655 26757 rpcz_store.cc:276] 0709 13:07:54.278887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.281491 (+  2604us) service_pool.cc:224] Handling call
0709 13:07:54.282548 (+  1057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.334283 (+ 51735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.334328 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.334949 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.467623 (+132674us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.467683 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.467754 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.226691 (+1758937us) raft_consensus.cc:1685] finished
0709 13:07:56.226717 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.226862 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31737,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":25340,"thread_start_us":183067,"threads_started":2,"wal-append.queue_time_us":855733}
W20260709 13:07:56.166507 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.223171 29198 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:55.686739 28976 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:56.139603 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.040s
I20260709 13:07:55.854801 27312 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
W20260709 13:07:56.231734 27284 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.003s	sys 0.020s
W20260709 13:07:56.232056 27284 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.003s	sys 0.020s
W20260709 13:07:56.232440 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 643755us
W20260709 13:07:56.223433 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 744467us
W20260709 13:07:56.223060 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.853302 29210 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:56.239229 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 73660.3us
W20260709 13:07:56.231389 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 740383us
W20260709 13:07:56.036691 28988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.037s
I20260709 13:07:55.688117 29206 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.536296 29082 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:55.862970 28951 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.964537 29086 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:56.230319 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.020s	sys 0.027s
I20260709 13:07:56.240793 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:55.860075 28946 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.853142 28664 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:56.247572 29073 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.248306 29033 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.249225 29227 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:56.241128 29131 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:56.247259 29216 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:56.230819 28689 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:56.251842 26510 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 3 to 4, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:56.258868 29222 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.003s
I20260709 13:07:56.260031 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:56.278927 28951 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.261166 29245 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:56.261408 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:56.238677 29064 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.265395 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:56.266089 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.853895 29223 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.862066 29230 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:55.862610 29228 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.286603 29082 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:55.858553 29225 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:55.973673 29068 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.774430 29148 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:55.835659 29239 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:56.352197 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86896.4us
I20260709 13:07:56.353186 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:55.860206 28632 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:55.727969 29113 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:56.280601 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 790892us
I20260709 13:07:56.283134 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:07:56.355754 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:07:56.355899 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 72880us
W20260709 13:07:56.274718 28988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.014s	sys 0.048s
W20260709 13:07:56.273744 26726 leader_election.cc:336] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.787s (SENT)
I20260709 13:07:55.859836 29197 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.165557 29106 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:56.276237 29219 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:56.260360 29214 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.278525 29198 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:56.298333 26510 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 2, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:07:56.287644 28794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.002s	sys 0.040s
I20260709 13:07:56.289683 29033 consensus_queue.cc:1243] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:55.854022 26509 rpcz_store.cc:269] 0709 13:07:30.528933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.564270 (+ 35337us) service_pool.cc:224] Handling call
0709 13:07:55.808633 (+25244363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:40.065328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:40.065988 (+   660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:40.066043 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:40.066077 (+    34us) tablet.cc:662] Decoding operations
0709 13:07:40.104560 (+ 38483us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:40.104702 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:40.104745 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:07:40.107139 (+  2394us) tablet.cc:701] Row locks acquired
0709 13:07:40.107220 (+    81us) write_op.cc:260] PREPARE: finished
0709 13:07:40.107479 (+   259us) write_op.cc:270] Start()
0709 13:07:40.130851 (+ 23372us) write_op.cc:276] Timestamp: P: 1783602460107392 usec, L: 0
0709 13:07:40.163046 (+ 32195us) op_driver.cc:348] REPLICATION: starting
0709 13:07:40.399324 (+236278us) log.cc:844] Serialized 8419 byte log entry
0709 13:07:41.867152 (+1467828us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:07:42.688570 (+821418us) op_driver.cc:464] REPLICATION: finished
0709 13:07:43.557285 (+868715us) write_op.cc:301] APPLY: starting
0709 13:07:43.593715 (+ 36430us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:43.713680 (+119965us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:43.713741 (+    61us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.799969 (+ 86228us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.800392 (+   423us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:07:43.800446 (+    54us) write_op.cc:312] APPLY: finished
0709 13:07:43.800927 (+   481us) log.cc:844] Serialized 144 byte log entry
0709 13:07:45.336589 (+1535662us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:07:45.588510 (+251921us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.601975 (+ 13465us) write_op.cc:454] Released schema lock
0709 13:07:45.613436 (+ 11461us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:45.627781 (+ 14345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.627811 (+    30us) write_op.cc:454] Released schema lock
0709 13:07:46.668750 (+1040939us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
Metrics: {"mutex_wait_us":1742171,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":634490,"apply.run_cpu_time_us":32149,"apply.run_wall_time_us":2236213,"num_ops":21,"prepare.queue_time_us":276721,"prepare.run_cpu_time_us":43182,"prepare.run_wall_time_us":2242283,"raft.queue_time_us":157685,"raft.run_cpu_time_us":27548,"raft.run_wall_time_us":640768,"replication_time_us":2482825,"spinlock_wait_cycles":113709056,"thread_start_us":4351864,"threads_started":5,"wal-append.queue_time_us":3649497,"wal-append.run_cpu_time_us":26978,"wal-append.run_wall_time_us":3465244}]]}
I20260709 13:07:56.260401 29238 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.294368 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:56.389564 26604 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.313714 29222 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:56.287429 28946 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.357618 29239 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.396071 29110 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:56.396646 29110 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:56.397565 29239 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.397471 29110 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:56.399178 29247 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:56.327544 28664 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.400203 28664 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:56.402271 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.403153 29252 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:56.404898 29252 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:56.406658 29230 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.299345 29131 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.354390 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:07:56.410053 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55738.6us
I20260709 13:07:56.412838 29228 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.413154 29121 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.413515 29226 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.277897 29206 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.299769 28689 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.417264 29238 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.413509 29200 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.323853 29223 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.417753 28689 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.417264 29206 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.418496 28689 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.358562 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:07:56.361886 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 510288us
I20260709 13:07:56.419625 29223 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.420228 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.420781 28900 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.421294 28900 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.367568 29254 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:56.422096 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.422385 29254 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:56.422791 29254 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.321396 29064 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.424831 29197 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.321230 29245 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.425120 29064 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.425613 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:07:56.426745 29245 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.426839 29148 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.427728 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.428450 26753 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:56.428701 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.429412 26758 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:56.358834 29082 consensus_queue.cc:1243] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:56.360745 29137 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:56.036487 28697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.026s	sys 0.031s
I20260709 13:07:55.965148 29224 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:56.349179 29068 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.430742 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.429425 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:56.380738 28794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.003s	sys 0.040s
W20260709 13:07:56.420251 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146555us
I20260709 13:07:56.494824 26756 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:56.495163 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.495760 26752 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:56.495893 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.432205 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:56.430804 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.356575 28632 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:56.358007 29251 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:56.488248 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55924.7us
I20260709 13:07:56.427803 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.419081 28689 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.497080 26753 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:56.499364 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.499979 26758 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:56.502780 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.503456 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.496476 26755 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:56.360657 29113 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.506395 28689 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:56.472836 28697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.030s	sys 0.038s
I20260709 13:07:56.512364 29113 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.494541 29064 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.514285 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.515596 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.518580 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:56.518744 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.519384 26683 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:07:56.520762 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90113.1us
I20260709 13:07:56.521585 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:56.420225 29223 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:56.522809 26760 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:56.524171 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:56.526134 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:56.526321 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:56.535386 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.536159 26756 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:56.537216 26606 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:56.387144 29198 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.500327 29239 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.552423 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:56.508235 28900 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:56.539086 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:56.519022 28874 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.558868 26609 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:56.560518 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:56.564364 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:56.565164 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:56.538251 28689 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:56.538249 29137 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:56.543387 28988 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.499821 29238 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:07:56.548120 29252 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:56.543084 29064 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.539628 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:56.508808 29073 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:56.508963 29197 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:56.574210 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:56.573573 26726 leader_election.cc:336] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.771s (SENT)
W20260709 13:07:56.580582 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 316951us
I20260709 13:07:56.538551 29266 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:56.592800 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:07:56.594640 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.542511 29086 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:56.603565 26683 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:56.566506 28976 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:56.585265 28689 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.603071 29137 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:07:56.578552 28664 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:56.613840 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.610180 29260 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:56.567306 28900 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.622012 29248 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:56.615144 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:56.617480 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.661095 26687 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:56.617846 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.584842 29251 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:56.575160 29113 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:56.618052 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.620563 26682 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:56.549861 29223 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.613504 29241 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.618925 29068 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.637101 27313 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:07:56.577045 28874 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.631824 28976 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:56.654276 28664 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:56.641614 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2282) took 1847 ms. Trace:
I20260709 13:07:56.642163 29121 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:56.642091 29262 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:56.665227 29248 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:56.578706 29250 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:56.644367 29236 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.133s	user 0.011s	sys 0.000s
I20260709 13:07:56.644804 29273 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.646788 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2306) took 1612 ms. Trace:
I20260709 13:07:56.647917 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.648675 29198 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.614945 26756 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:07:56.657024 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.662153 26680 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:56.664346 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.640587 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:56.692243 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:56.765863 26679 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:56.672863 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99325us
I20260709 13:07:56.648706 29106 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.696374 26608 rpcz_store.cc:276] 0709 13:07:54.794353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.794505 (+   152us) service_pool.cc:224] Handling call
0709 13:07:54.794816 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.135249 (+1340433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.135294 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.135982 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.328333 (+192351us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:56.328469 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.328611 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.641339 (+312728us) raft_consensus.cc:1685] finished
0709 13:07:56.641367 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.641542 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105679,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1426545,"threads_started":2,"wal-append.queue_time_us":289498}
I20260709 13:07:56.656454 28728 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.671437 29113 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.650709 29266 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.604986 28988 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.665580 29251 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.653328 28794 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:56.669660 29082 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:56.880533 29251 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:56.608481 29224 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.746001 26681 rpcz_store.cc:276] 0709 13:07:55.034633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.034776 (+   143us) service_pool.cc:224] Handling call
0709 13:07:55.035081 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.503497 (+468416us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:56.235710 (+732213us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.611538 (+375828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.612129 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.612294 (+   165us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:56.612334 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.612414 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.646586 (+ 34172us) raft_consensus.cc:1685] finished
0709 13:07:56.646606 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.646730 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43496,"prepare.queue_time_us":819422,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":165592,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":24119,"thread_start_us":1501721,"threads_started":3,"wal-append.queue_time_us":378687}
I20260709 13:07:56.658675 29260 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.885310 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.694288 28976 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.848641 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.878790 29254 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.860309 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.893355 26683 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:07:56.865988 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.894367 26680 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:56.816815 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.897397 26682 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:56.700475 28664 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:56.696658 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 157094us
W20260709 13:07:56.859607 29274 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:56.899312 26679 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:56.900672 28689 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.901667 28874 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:07:56.904219 29210 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.000s
I20260709 13:07:56.905020 29223 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:56.885763 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 245204us
I20260709 13:07:56.909569 26684 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:56.846926 29282 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:07:56.699394 29121 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.971733 29198 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:56.973716 29121 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.974103 29198 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.974548 29113 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.975541 28988 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.976163 29198 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.694613 29265 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.979492 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:56.912441 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.704578 29250 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:56.703636 29248 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.912878 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.988844 26679 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:56.914742 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:56.967761 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.987751 26756 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:56.989795 26680 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:56.817312 29068 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.969852 26684 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:07:56.970634 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:56.970643 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:56.892851 29266 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.988252 28988 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:56.995287 26684 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.995731 28988 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:56.996227 29281 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:56.996430 26684 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:56.996757 29281 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.997151 29281 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:56.997793 28988 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:56.998364 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:07:56.999598 29068 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.001689 29113 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.002872 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.003574 29113 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:07:57.004859 26684 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:57.006062 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.006956 26684 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:56.981446 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:56.982012 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 155353us
I20260709 13:07:57.003577 26678 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:57.007973 26753 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:56.990525 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75864.9us
I20260709 13:07:56.912953 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.995493 28632 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.010365 26683 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:57.010882 26681 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:56.988867 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.011621 26761 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:57.011778 28632 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:57.014438 29266 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:57.015468 29266 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:56.955211 29278 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:57.015838 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.019305 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.967571 29086 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:57.017130 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.771219 29273 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:57.020375 26685 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:57.020457 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.019196 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.009459 29248 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.980190 28900 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:56.973876 28946 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:56.763947 29236 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:57.022706 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:56.771584 29137 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.025267 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.025458 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.025697 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.023375 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.027117 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.040093 26679 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:57.040233 26685 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:57.024329 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:56.983650 28874 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:07:57.029325 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.064314 29068 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:57.065023 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.066105 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.068076 29238 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:57.068451 28951 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.002s
I20260709 13:07:57.068656 29238 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.068946 28951 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.027750 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:56.989188 29250 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:57.067440 29198 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:57.010892 29260 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:57.040357 26683 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:57.084201 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.020985 28632 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.085568 26611 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:57.085353 28632 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:57.087169 29273 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:57.090013 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 342) took 1376 ms. Trace:
I20260709 13:07:57.024354 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.041955 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:57.022166 29106 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:57.024852 28988 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.033885 29148 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:57.043170 29011 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:57.104228 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 78596.3us
I20260709 13:07:57.044673 29131 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:57.047729 29033 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:57.049701 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.051641 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:07:57.054356 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.054867 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.035446 29266 consensus_queue.cc:1243] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:57.056963 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.057857 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.059986 26608 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:57.061648 29251 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.027040 29086 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:56.988770 29223 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:57.063186 29200 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:57.024997 29278 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.069238 29238 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.992034 29197 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.070621 29198 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:07:57.079154 29258 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.690s	user 0.011s	sys 0.004s
I20260709 13:07:57.081408 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.082281 29082 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.082939 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1272) took 1633 ms. Trace:
I20260709 13:07:57.093153 26684 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:07:57.098649 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56800.4us
I20260709 13:07:57.098929 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.105085 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:07:57.090493 27316 rpcz_store.cc:276] 0709 13:07:55.713708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.728386 (+ 14678us) service_pool.cc:224] Handling call
0709 13:07:55.728735 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.360584 (+631849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.366252 (+  5668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.372288 (+  6036us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:56.386962 (+ 14674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.089718 (+702756us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54004268d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:57.089776 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.089940 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433733376}
I20260709 13:07:57.109244 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.820883 26686 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:07:57.821913 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.822679 26679 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 4.
I20260709 13:07:57.822755 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.823379 26754 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:57.823866 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1293) took 1237 ms. Trace:
I20260709 13:07:57.824204 26754 rpcz_store.cc:276] 0709 13:07:56.586392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.822528 (+1236136us) service_pool.cc:224] Handling call
0709 13:07:57.823813 (+  1285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.190094 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.825286 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:07:57.415172 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.825958 26754 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:07:57.586889 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.0209e+06us
I20260709 13:07:57.826529 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1292) took 1240 ms. Trace:
I20260709 13:07:57.826942 26754 rpcz_store.cc:276] 0709 13:07:56.586091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.825079 (+1238988us) service_pool.cc:224] Handling call
0709 13:07:57.826482 (+  1403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.827759 26756 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:57.827867 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.235193 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.828444 26754 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:57.829255 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1299) took 1238 ms. Trace:
I20260709 13:07:57.087527 28632 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:57.104166 28988 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.636451 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1271) took 2187 ms. Trace:
I20260709 13:07:57.994179 26607 rpcz_store.cc:276] 0709 13:07:55.449688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.449966 (+   278us) service_pool.cc:224] Handling call
0709 13:07:55.450222 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.236930 (+786708us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:56.342938 (+106008us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.520591 (+177653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.520640 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:56.520690 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.082693 (+562003us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400379bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:57.082746 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.082879 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22173,"prepare.queue_time_us":135305,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":24555,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5838,"spinlock_wait_cycles":1808702848,"thread_start_us":243206,"threads_started":2,"wal-append.queue_time_us":258850,"wal-append.run_cpu_time_us":1109,"wal-append.run_wall_time_us":1043795}
I20260709 13:07:57.824338 26681 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:07:57.909787 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1300) took 1307 ms. Trace:
I20260709 13:07:57.998028 26752 rpcz_store.cc:276] 0709 13:07:56.602801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.039352 (+436551us) service_pool.cc:224] Handling call
0709 13:07:57.909729 (+870377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.910074 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1306) took 1275 ms. Trace:
I20260709 13:07:57.999451 26753 rpcz_store.cc:276] 0709 13:07:56.634817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.053720 (+418903us) service_pool.cc:224] Handling call
0709 13:07:57.910025 (+856305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.000551 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:58.001353 26753 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
W20260709 13:07:57.976022 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 143208us
W20260709 13:07:57.909080 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 804060us
I20260709 13:07:58.013991 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:57.912606 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1295) took 1323 ms. Trace:
I20260709 13:07:57.829640 26754 rpcz_store.cc:276] 0709 13:07:56.590455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.827631 (+1237176us) service_pool.cc:224] Handling call
0709 13:07:57.829207 (+  1576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.955907 26682 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:58.014731 26756 rpcz_store.cc:276] 0709 13:07:56.589436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.098665 (+509229us) service_pool.cc:224] Handling call
0709 13:07:57.912527 (+813862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.015393 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.909534 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1302) took 1296 ms. Trace:
I20260709 13:07:57.945897 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:57.911736 26757 raft_consensus.cc:2410] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:57.952515 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:57.993697 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 231) took 1432 ms. Trace:
W20260709 13:07:57.930848 26650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.858s (SENT) [suppressed 16 similar messages]
I20260709 13:07:57.995632 26604 rpcz_store.cc:276] 0709 13:07:55.449349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.449502 (+   153us) service_pool.cc:224] Handling call
0709 13:07:55.449792 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.390135 (+940343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.636086 (+1245951us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b540003edd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:57.636340 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160818432}
I20260709 13:07:58.017109 27321 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.017218 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:58.018374 26753 raft_consensus.cc:2410] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:57.157280 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:58.018895 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1298) took 1428 ms. Trace:
I20260709 13:07:58.019361 26755 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:58.019286 26753 rpcz_store.cc:276] 0709 13:07:56.590179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.016964 (+1426785us) service_pool.cc:224] Handling call
0709 13:07:58.018833 (+  1869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.020166 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1303) took 1396 ms. Trace:
I20260709 13:07:58.020576 26755 rpcz_store.cc:276] 0709 13:07:56.623875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.099209 (+475334us) service_pool.cc:224] Handling call
0709 13:07:58.020104 (+920895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.022305 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 226) took 1517 ms. Trace:
I20260709 13:07:58.022729 26755 rpcz_store.cc:276] 0709 13:07:56.504701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.021341 (+1516640us) service_pool.cc:224] Handling call
0709 13:07:58.021706 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.021913 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.021950 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.022005 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.022053 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.022121 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.022239 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.015766 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:58.024190 26756 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.017051 26761 rpcz_store.cc:276] 0709 13:07:56.613088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.052795 (+439707us) service_pool.cc:224] Handling call
0709 13:07:57.909445 (+856650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.029474 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 227) took 1508 ms. Trace:
I20260709 13:07:58.026769 26760 rpcz_store.cc:276] 0709 13:07:56.561299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.081126 (+519827us) service_pool.cc:224] Handling call
0709 13:07:57.993604 (+912478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.035528 26761 rpcz_store.cc:276] 0709 13:07:56.521267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.028435 (+1507168us) service_pool.cc:224] Handling call
0709 13:07:58.028814 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.029043 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.029078 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.029134 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.029186 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.029252 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.029407 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.041245 29302 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.042276 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 111468us
I20260709 13:07:57.099283 29106 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.058205 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1289) took 1473 ms. Trace:
I20260709 13:07:57.209306 29110 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.072849 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:57.820407 28951 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:57.444713 29241 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.074308 26757 rpcz_store.cc:276] 0709 13:07:56.585133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.234821 (+649688us) service_pool.cc:224] Handling call
0709 13:07:58.058123 (+823302us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:57.240218 29280 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.266s	user 0.000s	sys 0.002s
W20260709 13:07:57.826160 29281 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.824s	user 0.004s	sys 0.007s
I20260709 13:07:58.013156 29198 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:57.588155 29259 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:58.092474 26686 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:57.782697 28976 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.888s	user 0.006s	sys 0.003s
I20260709 13:07:57.952189 27313 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:58.077417 29131 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:57.959090 29265 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:07:57.984484 27314 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:07:57.671254 29121 consensus_meta.cc:287] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.697s	user 0.005s	sys 0.006s
I20260709 13:07:57.109185 29148 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.228550 29260 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.908299 29224 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.128162 26682 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:07:58.088522 26757 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:57.992374 29033 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:57.984869 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:07:57.653812 29254 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:58.047509 28900 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:57.488620 28728 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:57.109297 29011 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:07:57.238356 29287 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:58.048708 29223 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:57.104449 28938 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:58.078282 26752 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:07:58.058701 27319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 316) took 1625 ms (client timeout 1902 ms). Trace:
I20260709 13:07:58.079144 29106 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.222126 29250 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.048193 29116 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:07:57.922904 29200 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.090446 29236 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:57.922500 29197 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:57.922683 29082 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:07:58.128863 28664 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.157s	user 0.010s	sys 0.001s
I20260709 13:07:58.164971 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1296) took 1575 ms. Trace:
I20260709 13:07:58.236853 26752 rpcz_store.cc:276] 0709 13:07:56.589683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.998974 (+1409291us) service_pool.cc:224] Handling call
0709 13:07:58.164909 (+165935us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.237586 26682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2334) took 1470 ms (client timeout 1893 ms). Trace:
W20260709 13:07:58.238014 26682 rpcz_store.cc:269] 0709 13:07:56.767657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.898198 (+130541us) service_pool.cc:224] Handling call
0709 13:07:58.237432 (+1339234us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001ea0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:58.237537 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139588864}
I20260709 13:07:58.180002 28689 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:58.126624 29148 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.090770 29110 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.176503 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2349) took 1013 ms. Trace:
I20260709 13:07:58.247109 26686 rpcz_store.cc:276] 0709 13:07:57.163574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.908320 (+744746us) service_pool.cc:224] Handling call
0709 13:07:58.176226 (+267906us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b54003c64d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:58.176412 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173805440}
I20260709 13:07:58.132036 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 228) took 1607 ms. Trace:
I20260709 13:07:58.235553 27285 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:07:58.090981 29281 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.125566 29248 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:58.218717 26754 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:07:58.249858 26757 rpcz_store.cc:276] 0709 13:07:56.524548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.085873 (+1561325us) service_pool.cc:224] Handling call
0709 13:07:58.086278 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.129143 (+ 42865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.131977 (+  2834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.122722 28976 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.163506 29011 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.162752 29287 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.130227 29131 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:58.267408 26680 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 4: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:07:58.263585 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 229) took 1731 ms. Trace:
I20260709 13:07:58.268184 26752 rpcz_store.cc:276] 0709 13:07:56.532740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.237564 (+1704824us) service_pool.cc:224] Handling call
0709 13:07:58.262909 (+ 25345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.263131 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.263170 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.263227 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.263284 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.263356 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.263511 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.076689 29288 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:07:58.282132 29200 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.282950 29281 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:07:58.283083 29292 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.236s	user 0.001s	sys 0.002s
I20260709 13:07:58.284801 29250 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.289794 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1026) took 1713 ms. Trace:
I20260709 13:07:58.172618 28988 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.173930 29033 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:58.290341 26754 rpcz_store.cc:276] 0709 13:07:56.576252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.288701 (+1712449us) service_pool.cc:224] Handling call
0709 13:07:58.289129 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.289377 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.289416 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.289474 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.289526 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.289593 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.289724 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.131263 29260 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.127735 29121 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:58.293350 29113 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.288s	user 0.006s	sys 0.006s
I20260709 13:07:58.243839 29296 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.294440 29121 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.294783 29296 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:58.296411 29251 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.299124 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:58.299849 26685 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:58.305227 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:58.306044 26682 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:07:58.230270 29254 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.079902 29302 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:58.094419 29241 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:07:58.245957 28689 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:07:58.246734 29236 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.244494 28728 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:07:58.174672 29225 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:58.245209 28664 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:58.134544 29224 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:58.180411 29223 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:58.928423 26687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.027s	sys 0.113s
I20260709 13:07:58.458986 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 234) took 1416 ms. Trace:
W20260709 13:07:59.005180 26687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.035s	sys 0.130s
W20260709 13:07:58.990239 26679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.010s	sys 0.019s
W20260709 13:07:58.943583 27284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.005s	sys 0.005s
W20260709 13:07:59.006803 27284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.005s	sys 0.007s
W20260709 13:07:59.006362 26679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.011s	sys 0.019s
I20260709 13:07:59.005514 26761 rpcz_store.cc:276] 0709 13:07:57.072294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.457970 (+1385676us) service_pool.cc:224] Handling call
0709 13:07:58.458352 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.458577 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.458622 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.458676 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.458726 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.458794 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.458918 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.007484 29312 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.008136 29312 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:59.008842 29223 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:59.009406 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 235) took 1915 ms. Trace:
I20260709 13:07:58.451073 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 233) took 1663 ms. Trace:
I20260709 13:07:59.010675 29312 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:58.705957 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:59.012152 26685 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:07:58.456956 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2322) took 1860 ms (client timeout 2219 ms). Trace:
W20260709 13:07:58.954310 29295 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
W20260709 13:07:59.013000 26680 rpcz_store.cc:269] 0709 13:07:56.596720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.993970 (+397250us) service_pool.cc:224] Handling call
0709 13:07:58.456668 (+1462698us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000c49d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:07:58.456874 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753424256}
I20260709 13:07:59.013583 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:58.955964 29296 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:58.933516 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.036s	sys 0.097s
W20260709 13:07:59.015509 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.036s	sys 0.098s
I20260709 13:07:59.015705 29296 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.016224 29296 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.017853 29251 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.018353 29251 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.019479 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.020351 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:58.665723 29131 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.020686 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:59.020947 29011 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.000s
I20260709 13:07:59.020364 29251 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.021449 26611 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:59.022435 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.022749 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1012) took 2595 ms. Trace:
W20260709 13:07:58.644948 29292 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:07:59.024124 26757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.000s	sys 0.010s
W20260709 13:07:59.024566 26757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.010s
W20260709 13:07:58.783188 27321 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.000s
I20260709 13:07:59.025404 27321 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:07:59.023283 26759 rpcz_store.cc:276] 0709 13:07:56.426829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.431029 (+  4200us) service_pool.cc:224] Handling call
0709 13:07:56.496861 (+ 65832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.539085 (+ 42224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.539120 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.539568 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.820580 (+1281012us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b18003989e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:07:57.968272 (+147692us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:57.968334 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.968432 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.022343 (+1053911us) raft_consensus.cc:1685] finished
0709 13:07:59.022373 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.022669 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25689,"raft.queue_time_us":51114,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":13891,"spinlock_wait_cycles":19743616,"thread_start_us":147425,"threads_started":1,"wal-append.queue_time_us":2058398}
I20260709 13:07:59.025849 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 349) took 1073 ms. Trace:
I20260709 13:07:59.026139 27321 rpcz_store.cc:276] 0709 13:07:57.952089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.952221 (+   132us) service_pool.cc:224] Handling call
0709 13:07:59.025787 (+1073566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.706887 29278 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.027165 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1027) took 1205 ms. Trace:
W20260709 13:07:59.028563 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.01692e+06us
W20260709 13:07:58.977739 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.003s	sys 0.014s
W20260709 13:07:59.029338 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.003s	sys 0.014s
I20260709 13:07:59.028611 26759 rpcz_store.cc:276] 0709 13:07:57.821930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.026188 (+1204258us) service_pool.cc:224] Handling call
0709 13:07:59.026570 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.026812 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.026848 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.026901 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:59.026952 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.027010 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.027114 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:58.378219 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.014554 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:07:59.027231 29278 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.573050 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:58.699776 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.009s
W20260709 13:07:59.049979 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.011s	sys 0.010s
W20260709 13:07:59.050382 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.0004e+06us
W20260709 13:07:59.004943 29106 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.000s
W20260709 13:07:58.996423 26683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.010s
W20260709 13:07:59.063943 26683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.003s	sys 0.010s
I20260709 13:07:59.028031 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2324) took 2430 ms. Trace:
I20260709 13:07:59.065464 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:58.999711 29113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.008s	sys 0.005s
W20260709 13:07:59.030370 26726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.003s	sys 0.012s
W20260709 13:07:58.968811 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.007s	sys 0.008s
W20260709 13:07:58.444347 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 491681us
I20260709 13:07:58.706400 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:59.028842 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.000s	sys 0.016s
W20260709 13:07:58.735651 26756 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.000s
I20260709 13:07:58.710764 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:59.004920 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1288) took 2425 ms. Trace:
W20260709 13:07:58.857424 26753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.063s	sys 0.096s
W20260709 13:07:58.398530 29137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.013s	sys 0.024s
W20260709 13:07:59.069672 26726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.004s	sys 0.012s
W20260709 13:07:59.077950 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 841510us
W20260709 13:07:59.078488 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.079052 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:59.069840 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.007s	sys 0.009s
W20260709 13:07:59.080394 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 983860us
I20260709 13:07:59.072160 26686 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:07:59.072615 26756 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:07:59.082469 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1028) took 1260 ms. Trace:
I20260709 13:07:59.082890 26756 rpcz_store.cc:276] 0709 13:07:57.822216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.015510 (+193294us) service_pool.cc:224] Handling call
0709 13:07:59.082378 (+1066868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.074980 26754 rpcz_store.cc:276] 0709 13:07:56.579467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.291584 (+1712117us) service_pool.cc:224] Handling call
0709 13:07:58.299971 (+  8387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.300206 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.300242 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.300295 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:58.300354 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.300423 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.004851 (+704428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.085248 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1030) took 1262 ms. Trace:
I20260709 13:07:59.075431 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.010918 26760 rpcz_store.cc:276] 0709 13:07:56.787872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.450064 (+1662192us) service_pool.cc:224] Handling call
0709 13:07:58.450433 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.450668 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.450703 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.450756 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:58.450799 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.450868 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.451003 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:59.030966 27285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.008s	sys 0.008s
W20260709 13:07:59.072444 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.000s	sys 0.016s
W20260709 13:07:59.087088 27285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.008s	sys 0.008s
W20260709 13:07:59.087464 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 838384us
I20260709 13:07:59.085750 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1031) took 1262 ms. Trace:
I20260709 13:07:59.090917 26754 rpcz_store.cc:276] 0709 13:07:57.822987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.084781 (+1261794us) service_pool.cc:224] Handling call
0709 13:07:59.085109 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.085340 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.085378 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.085437 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.085493 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.085562 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.085684 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.572849 28988 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.014483 26685 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:07:58.273670 29287 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:59.053391 26610 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:58.574803 26727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.025s	sys 0.079s
W20260709 13:07:59.102350 26727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.027s	sys 0.088s
I20260709 13:07:58.618361 29121 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:07:58.229028 27319 rpcz_store.cc:269] 0709 13:07:56.433269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.472518 (+ 39249us) service_pool.cc:224] Handling call
0709 13:07:57.051455 (+578937us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:07:58.047283 (+995828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5360512}
I20260709 13:07:59.066234 26612 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 3.
I20260709 13:07:59.064687 26678 rpcz_store.cc:276] 0709 13:07:56.597323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.009346 (+412023us) service_pool.cc:224] Handling call
0709 13:07:57.009651 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.011231 (+  1580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.011259 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.011851 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.091622 (+ 79771us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:57.193478 (+101856us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.014057 (+820579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.014134 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.282348 (+268214us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:07:59.027728 (+745380us) raft_consensus.cc:1685] finished
0709 13:07:59.027837 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.027976 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18920,"prepare.queue_time_us":101452,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":23242,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12593,"spinlock_wait_cycles":27555200,"thread_start_us":79332,"threads_started":1,"wal-append.queue_time_us":1034367}
I20260709 13:07:59.119686 26678 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:07:59.069483 29113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.008s	sys 0.005s
I20260709 13:07:58.938856 28976 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:58.343683 29116 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:59.075186 26753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.065s	sys 0.099s
I20260709 13:07:59.076614 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.081167 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:07:59.028652 26684 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:59.134936 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.147655 26612 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:07:59.010058 26761 rpcz_store.cc:276] 0709 13:07:57.093757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.008157 (+1914400us) service_pool.cc:224] Handling call
0709 13:07:59.008576 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.008799 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.008941 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.009001 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:59.009056 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.009129 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.009336 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.148597 26684 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:59.149238 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:59.150600 26761 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [6.3-7.4]
I20260709 13:07:59.031032 29236 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.076810 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:07:59.069252 29305 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:59.027984 29110 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.100557 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:07:59.049374 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 476399us
I20260709 13:07:59.116333 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.075843 29106 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.123760 26754 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:59.090441 29137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.020s	sys 0.041s
I20260709 13:07:59.171608 29298 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:59.184752 29318 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:07:59.185412 29318 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:59.133772 29121 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:59.189188 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:59.188511 26606 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:07:59.170104 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:59.131378 29296 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.132998 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.068219 29302 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:58.349790 29254 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.151212 26684 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:59.085786 26756 rpcz_store.cc:276] 0709 13:07:57.822734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.084219 (+1261485us) service_pool.cc:224] Handling call
0709 13:07:59.084594 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.084831 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.084868 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.084925 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.084979 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.085049 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.085181 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.209919 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:07:59.117204 28988 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.021492 29011 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:59.115944 27287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.009s	sys 0.031s
I20260709 13:07:59.148540 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.164691 29305 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.154856 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.157814 26761 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:58.621661 28689 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.167827 26609 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:07:59.065089 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1029) took 1242 ms. Trace:
I20260709 13:07:59.068689 29278 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:59.168923 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:07:59.054661 28728 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.250102 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 230) took 2702 ms. Trace:
I20260709 13:07:59.260846 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:59.260648 26759 rpcz_store.cc:276] 0709 13:07:57.822475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.030016 (+1207541us) service_pool.cc:224] Handling call
0709 13:07:59.064596 (+ 34580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.064771 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.064801 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.064841 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.064874 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.064927 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.065034 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.170104 29224 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:59.182654 29148 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.899s	user 0.007s	sys 0.001s
W20260709 13:07:59.177368 29238 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.234s	user 0.010s	sys 0.000s
I20260709 13:07:59.306895 29238 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.223305 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:59.152998 29301 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:07:59.309608 26756 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:59.292701 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:59.291867 26757 rpcz_store.cc:276] 0709 13:07:56.547765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.258000 (+1710235us) service_pool.cc:224] Handling call
0709 13:07:58.258305 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.258490 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:59.024976 (+766486us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.249721 (+224745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.249777 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:59.249823 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.249899 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.250036 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":934619,"threads_started":2}
I20260709 13:07:59.310912 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:59.311625 26757 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:59.312575 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:07:59.313109 26757 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:59.222420 29198 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.110s	user 0.011s	sys 0.000s
I20260709 13:07:59.256378 29298 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:59.301193 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:59.300685 29148 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:07:59.278497 29312 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:59.222846 29110 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.177179 29106 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.170878 29223 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:59.300350 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 270307us
I20260709 13:07:59.168728 29306 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:59.264183 29305 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:59.261204 27287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.017s	sys 0.033s
I20260709 13:07:59.222846 29318 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:59.256667 28664 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:07:59.223055 29296 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:07:59.124519 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.285501 26608 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:07:59.286545 26605 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:07:59.996548 26686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.002s	sys 0.006s
W20260709 13:07:59.995908 26682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.013s	sys 0.009s
I20260709 13:07:59.384199 29314 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.734s
I20260709 13:07:59.313485 29236 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.104390 29296 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.105290 29306 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:07:59.877229 29113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.001s	sys 0.014s
W20260709 13:08:00.108528 29113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.001s	sys 0.017s
I20260709 13:07:59.314370 29309 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:00.110566 29309 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.111123 29309 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:59.996274 26687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.004s	sys 0.003s
W20260709 13:07:59.999204 26681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.003s	sys 0.003s
W20260709 13:08:00.116019 26687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.004s	sys 0.009s
I20260709 13:08:00.095901 29137 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.123155 29312 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.128654 29137 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:07:59.999984 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.558346 29121 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:07:59.317589 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 345) took 1367 ms. Trace:
I20260709 13:08:00.132550 29121 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:00.133415 29121 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:07:59.693410 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1025) took 3117 ms. Trace:
W20260709 13:08:00.123129 26682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.016s	sys 0.012s
W20260709 13:08:00.119215 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.000s	sys 0.011s
I20260709 13:07:59.315709 29011 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:00.136246 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.000s	sys 0.012s
I20260709 13:07:59.330322 29086 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:00.127816 26679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.000s	sys 0.006s
W20260709 13:08:00.138605 26679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.000s	sys 0.006s
W20260709 13:07:59.673179 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.007s
W20260709 13:08:00.139599 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.004s	sys 0.011s
W20260709 13:08:00.119688 29289 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 2.074s	user 0.020s	sys 0.018s
I20260709 13:08:00.140257 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 206) took 2772 ms. Trace:
W20260709 13:08:00.095888 26686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.003s	sys 0.011s
I20260709 13:08:00.140802 26679 rpcz_store.cc:276] 0709 13:07:57.367840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.823443 (+455603us) service_pool.cc:224] Handling call
0709 13:07:57.823816 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.824010 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:58.076358 (+252348us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.139197 (+2062839us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.139605 (+   408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.139698 (+    93us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.139790 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.139862 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.140149 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378718,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":92,"raft.queue_time_us":163463,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":2173434,"threads_started":4,"wal-append.queue_time_us":1057506}
I20260709 13:08:00.122596 29298 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:00.143317 29298 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:00.131983 26681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.007s	sys 0.006s
I20260709 13:07:59.314016 29311 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.148181 29311 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.135051 26752 rpcz_store.cc:276] 0709 13:07:56.575962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.269199 (+1693237us) service_pool.cc:224] Handling call
0709 13:07:58.285693 (+ 16494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.285903 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:59.231645 (+945742us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.692934 (+461289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.693005 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.693076 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.693165 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.693331 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28812,"prepare.queue_time_us":1020980,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":65169,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"thread_start_us":673825,"threads_started":2}
W20260709 13:07:59.673372 26753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.005s
W20260709 13:08:00.150102 26753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.010s	sys 0.013s
I20260709 13:08:00.151018 29311 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:07:59.997557 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.002s	sys 0.006s
I20260709 13:08:00.121222 28728 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:00.151961 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.003s	sys 0.011s
I20260709 13:08:00.128976 29278 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.152148 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 225) took 3647 ms. Trace:
I20260709 13:08:00.152606 26753 rpcz_store.cc:276] 0709 13:07:56.504349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.020204 (+1515855us) service_pool.cc:224] Handling call
0709 13:07:58.020488 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.020696 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:59.151642 (+1130946us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.151248 (+999606us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.151505 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.151563 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.151650 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.151786 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.151998 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1169712,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":2129047,"threads_started":2}
I20260709 13:08:00.154824 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.156901 26759 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:07:59.410113 26756 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:00.157703 29148 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.158572 26604 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:07:59.685259 29116 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
I20260709 13:08:00.159776 29116 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:00.140290 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.03156e+06us
I20260709 13:08:00.161322 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.162737 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:07:59.673812 26755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:07:59.313807 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:07:59.982251 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:00.165484 26755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.012s	sys 0.004s
I20260709 13:08:00.171049 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.166045 29198 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.174489 29306 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:07:59.997255 26603 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:00.175635 26678 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.175700 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.176277 27317 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:08:00.170758 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1294) took 1021 ms. Trace:
I20260709 13:08:00.177664 26610 rpcz_store.cc:276] 0709 13:07:59.149306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.981226 (+831920us) service_pool.cc:224] Handling call
0709 13:08:00.170652 (+189426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.179324 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:00.147650 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.121716 29238 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.132797 27316 rpcz_store.cc:276] 0709 13:07:57.950607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.955474 (+  4867us) service_pool.cc:224] Handling call
0709 13:07:57.985335 (+ 29861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.169860 (+184525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.169905 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.169958 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.170006 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.317271 (+1147265us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54005a5854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:07:59.317341 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.317512 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423738752}
I20260709 13:08:00.169445 26757 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.557003 28988 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.183727 26610 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.184959 29110 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.185442 29110 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.185480 29198 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.170543 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1316) took 1002 ms. Trace:
I20260709 13:08:00.186619 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2300) took 1093 ms. Trace:
I20260709 13:08:00.188321 26756 rpcz_store.cc:276] 0709 13:07:59.167934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.220424 (+ 52490us) service_pool.cc:224] Handling call
0709 13:08:00.170324 (+949900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.188778 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.188894 26610 rpcz_store.cc:276] 0709 13:07:59.092812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.178889 (+1086077us) service_pool.cc:224] Handling call
0709 13:08:00.186205 (+  7316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.151340 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.163430 29223 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.501470 29317 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:00.193384 29223 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.192447 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.194908 26610 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:00.196070 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2303) took 1102 ms. Trace:
W20260709 13:07:59.672818 27285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.005s
W20260709 13:08:00.198434 27285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.009s	sys 0.010s
I20260709 13:08:00.198710 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:00.199036 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 1.11089e+06us
I20260709 13:08:00.199991 26611 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.158315 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.196885 26610 rpcz_store.cc:276] 0709 13:07:59.093651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.191451 (+1097800us) service_pool.cc:224] Handling call
0709 13:08:00.195975 (+  4524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.131501 29312 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.192483 26752 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:07:59.672998 26760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.007s
I20260709 13:08:00.207490 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.189873 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.203074 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2305) took 1108 ms. Trace:
I20260709 13:08:00.214309 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2310) took 1118 ms. Trace:
I20260709 13:08:00.215772 26610 rpcz_store.cc:276] 0709 13:07:59.095988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.206679 (+1110691us) service_pool.cc:224] Handling call
0709 13:08:00.214204 (+  7525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.217175 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.218367 26610 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:00.218883 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1301) took 1019 ms. Trace:
I20260709 13:08:00.219223 26610 rpcz_store.cc:276] 0709 13:07:59.199278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.216756 (+1017478us) service_pool.cc:224] Handling call
0709 13:08:00.218803 (+  2047us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:59.788004 29287 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.008s
I20260709 13:08:00.215515 26611 rpcz_store.cc:276] 0709 13:07:59.094358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.198104 (+1103746us) service_pool.cc:224] Handling call
0709 13:08:00.202982 (+  4878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.223804 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:07:59.555796 29326 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:00.206984 29296 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:00.232532 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.003s	sys 0.018s
I20260709 13:08:00.174736 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:00.232962 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.003s	sys 0.018s
I20260709 13:08:00.233088 29241 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.233366 27319 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:08:00.233513 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.15237e+06us
I20260709 13:08:00.235285 26761 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.279106 29310 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.231276 26753 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.239907 29262 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.240461 29262 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:00.241197 27317 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:00.242314 29137 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.242172 29262 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:00.240562 26760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.006s	sys 0.010s
I20260709 13:08:00.243301 26759 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:00.243896 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.244586 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:00.242692 26685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.013s	sys 0.018s
W20260709 13:08:00.250717 26685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.014s	sys 0.019s
I20260709 13:08:00.246385 29336 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.255194 29336 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.258756 29330 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:00.259297 29330 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:00.259872 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1282) took 1240 ms. Trace:
I20260709 13:08:00.260353 26604 rpcz_store.cc:276] 0709 13:07:59.019051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.019185 (+   134us) service_pool.cc:224] Handling call
0709 13:08:00.259595 (+1240410us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003787d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.259785 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617083776}
I20260709 13:08:00.261036 29330 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.258028 29336 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.263406 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1283) took 1244 ms. Trace:
I20260709 13:08:00.261713 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.264711 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.249512 29335 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:00.265674 29335 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.265731 29310 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.263851 26608 rpcz_store.cc:276] 0709 13:07:59.019339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.020107 (+   768us) service_pool.cc:224] Handling call
0709 13:08:00.263047 (+1242940us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400100ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.263224 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608213888}
I20260709 13:08:00.266289 29335 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.270350 29310 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.270545 29320 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:00.268559 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2311) took 1171 ms. Trace:
I20260709 13:08:00.274223 29310 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.274740 29310 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:00.275942 29287 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.278059 26758 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:00.278280 29033 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:00.279386 26758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1294) took 3690 ms (client timeout 2018 ms). Trace:
I20260709 13:08:00.272166 26611 rpcz_store.cc:276] 0709 13:07:59.096292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.230319 (+1134027us) service_pool.cc:224] Handling call
0709 13:08:00.267484 (+ 37165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.281425 29287 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.269237 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:00.283344 26758 rpcz_store.cc:269] 0709 13:07:56.589159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.099169 (+510010us) service_pool.cc:224] Handling call
0709 13:08:00.279119 (+3179950us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400225954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.279299 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5639304064}
I20260709 13:08:00.287868 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.284016 26679 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:00.254256 29121 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.336354 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.336659 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.337206 26611 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:08:00.337764 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1295) took 1183 ms. Trace:
I20260709 13:08:00.338145 26611 rpcz_store.cc:276] 0709 13:07:59.154210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.282563 (+1128353us) service_pool.cc:224] Handling call
0709 13:08:00.337697 (+ 55134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.333390 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2309) took 1232 ms. Trace:
I20260709 13:08:00.339151 26604 rpcz_store.cc:276] 0709 13:07:59.095697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.261363 (+1165666us) service_pool.cc:224] Handling call
0709 13:08:00.328474 (+ 67111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.343384 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1052) took 2043 ms. Trace:
I20260709 13:08:00.343849 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.344795 26611 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:00.343885 26682 rpcz_store.cc:276] 0709 13:07:58.295301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.073428 (+778127us) service_pool.cc:224] Handling call
0709 13:07:59.073840 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.074260 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.074299 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.107267 (+ 32968us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.135416 (+1028149us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:00.135505 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.135617 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.338359 (+202742us) raft_consensus.cc:1685] finished
0709 13:08:00.338379 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.338568 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239644,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":972561,"threads_started":1,"wal-append.queue_time_us":1190745}
I20260709 13:08:00.345331 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2306) took 1250 ms. Trace:
I20260709 13:08:00.345762 26611 rpcz_store.cc:276] 0709 13:07:59.094816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.343458 (+1248642us) service_pool.cc:224] Handling call
0709 13:08:00.345274 (+  1816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.346175 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.346762 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.248696 29312 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:00.348155 29312 consensus_queue.cc:1243] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:00.348816 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.349637 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2312) took 1205 ms. Trace:
I20260709 13:08:00.350039 26604 rpcz_store.cc:276] 0709 13:07:59.145000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.348461 (+1203461us) service_pool.cc:224] Handling call
0709 13:08:00.349582 (+  1121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.351106 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.338865 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1296) took 1182 ms. Trace:
I20260709 13:08:00.351997 26608 rpcz_store.cc:276] 0709 13:07:59.156715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.268835 (+1112120us) service_pool.cc:224] Handling call
0709 13:08:00.338801 (+ 69966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.353180 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.354842 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1079) took 1045 ms. Trace:
I20260709 13:08:00.347524 26611 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:00.355252 26679 rpcz_store.cc:276] 0709 13:07:59.285767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.143549 (+857782us) service_pool.cc:224] Handling call
0709 13:08:00.331138 (+187589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.355603 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1302) took 1098 ms. Trace:
I20260709 13:08:00.356524 26611 rpcz_store.cc:276] 0709 13:07:59.257014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.346459 (+1089445us) service_pool.cc:224] Handling call
0709 13:08:00.355550 (+  9091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.360013 26752 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:00.352072 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1050) took 2044 ms. Trace:
I20260709 13:08:00.367283 26761 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.368111 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1051) took 1056 ms. Trace:
I20260709 13:08:00.368649 26752 rpcz_store.cc:276] 0709 13:07:59.312115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.287436 (+975321us) service_pool.cc:224] Handling call
0709 13:08:00.367986 (+ 80550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.366088 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.372694 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1037) took 1059 ms. Trace:
I20260709 13:08:00.361322 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.374083 26761 rpcz_store.cc:276] 0709 13:07:59.308501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.170513 (+862012us) service_pool.cc:224] Handling call
0709 13:08:00.368032 (+197519us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.378983 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 121995us
I20260709 13:08:00.362895 26681 rpcz_store.cc:276] 0709 13:07:58.294691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.297613 (+  2922us) service_pool.cc:224] Handling call
0709 13:07:58.298045 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.298526 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:58.368921 (+ 70395us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.172208 (+803287us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b18003de760. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a 00007f40f329aa2a
0709 13:08:00.145001 (+972793us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.145798 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.146080 (+   282us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.146486 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.146677 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.146798 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.288159 (+141361us) raft_consensus.cc:1685] finished
0709 13:08:00.288188 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.338697 (+ 50509us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68089,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":9971,"raft.queue_time_us":5587,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":27554,"spinlock_wait_cycles":40683392,"thread_start_us":972289,"threads_started":1,"wal-append.queue_time_us":1864229}
I20260709 13:08:00.380486 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.381319 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1073) took 1113 ms. Trace:
I20260709 13:08:00.381565 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.381632 26681 rpcz_store.cc:276] 0709 13:07:59.268074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.380066 (+1111992us) service_pool.cc:224] Handling call
0709 13:08:00.381246 (+  1180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.382740 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.383245 26754 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:08:00.383831 27286 connection.cc:256] RPC call timeout handler was delayed by -1.5805759159999297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:08:00.384363 27286 connection.cc:256] RPC call timeout handler was delayed by -1.1731744019999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:00.384768 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:00.385746 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1300) took 1188 ms. Trace:
I20260709 13:08:00.386034 26604 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.386117 26611 rpcz_store.cc:276] 0709 13:07:59.197326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.363521 (+1166195us) service_pool.cc:224] Handling call
0709 13:08:00.385663 (+ 22142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.386641 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2301) took 1293 ms. Trace:
I20260709 13:08:00.386979 26604 rpcz_store.cc:276] 0709 13:07:59.093088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.350775 (+1257687us) service_pool.cc:224] Handling call
0709 13:08:00.386587 (+ 35812us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.387455 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 352100us
I20260709 13:08:00.387298 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.387982 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.397603 29296 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.398176 29296 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.398393 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2315) took 1170 ms. Trace:
I20260709 13:08:00.398511 29296 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.398931 26604 rpcz_store.cc:276] 0709 13:07:59.228054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.387628 (+1159574us) service_pool.cc:224] Handling call
0709 13:08:00.398325 (+ 10697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.400024 29345 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.400578 29345 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.400966 29345 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.404393 29330 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:00.406865 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1065) took 2069 ms. Trace:
I20260709 13:08:00.409602 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1290) took 1333 ms. Trace:
I20260709 13:08:00.410099 26605 rpcz_store.cc:276] 0709 13:07:59.076040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.076314 (+   274us) service_pool.cc:224] Handling call
0709 13:08:00.409158 (+1332844us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540003ded4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.409370 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320405888}
I20260709 13:08:00.412031 26756 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.412142 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.411883 29310 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.413004 26761 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.413574 29310 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.413944 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1285) took 1393 ms. Trace:
I20260709 13:08:00.414336 26606 rpcz_store.cc:276] 0709 13:07:59.019923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.022210 (+  2287us) service_pool.cc:224] Handling call
0709 13:08:00.413533 (+1391323us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400162e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.413778 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380156800}
I20260709 13:08:00.416143 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.416802 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:00.416631 29223 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.417361 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2307) took 1322 ms. Trace:
I20260709 13:08:00.417716 26605 rpcz_store.cc:276] 0709 13:07:59.095104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.415831 (+1320727us) service_pool.cc:224] Handling call
0709 13:08:00.417305 (+  1474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.418641 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:00.419195 26607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.000s	sys 0.011s
I20260709 13:08:00.415426 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.419494 26605 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.420076 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.429780 26752 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.430193 29254 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.407351 26680 rpcz_store.cc:276] 0709 13:07:58.337583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.262951 (+925368us) service_pool.cc:224] Handling call
0709 13:07:59.305007 (+ 42056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.124003 (+818996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.124076 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.124166 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.124228 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.406402 (+282174us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400313dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:00.406461 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.406677 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882128128}
I20260709 13:08:00.383459 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1070) took 1116 ms. Trace:
I20260709 13:08:00.431936 26681 rpcz_store.cc:276] 0709 13:07:59.267199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.382447 (+1115248us) service_pool.cc:224] Handling call
0709 13:08:00.383398 (+   951us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.432443 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1315) took 1272 ms (client timeout 1512 ms). Trace:
I20260709 13:08:00.433184 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:00.384770 27286 connection.cc:256] RPC call timeout handler was delayed by -1.1620759159999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:08:00.434656 27286 connection.cc:256] RPC call timeout handler was delayed by -1.1269759159999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:08:00.411827 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.437270 26759 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:00.419593 26607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.000s	sys 0.011s
W20260709 13:08:00.439818 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 277292us
I20260709 13:08:00.430226 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.420578 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:00.432919 26754 rpcz_store.cc:269] 0709 13:07:59.160336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.188860 (+ 28524us) service_pool.cc:224] Handling call
0709 13:08:00.432205 (+1243345us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540014ebd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.432368 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743726464}
I20260709 13:08:00.455564 26608 raft_consensus.cc:2368] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:00.462265 26757 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.464730 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2299) took 1372 ms. Trace:
I20260709 13:08:00.465171 26608 rpcz_store.cc:276] 0709 13:07:59.092521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.352832 (+1260311us) service_pool.cc:224] Handling call
0709 13:08:00.464663 (+111831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.418951 29223 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.467839 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1043) took 1157 ms. Trace:
I20260709 13:08:00.468240 26757 rpcz_store.cc:276] 0709 13:07:59.310071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.313620 (+  3549us) service_pool.cc:224] Handling call
0709 13:08:00.462736 (+1149116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.478678 26682 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:00.472997 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.483713 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:00.477340 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.479422 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1072) took 1211 ms. Trace:
I20260709 13:08:00.486052 26682 rpcz_store.cc:276] 0709 13:07:59.267816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.345817 (+1078001us) service_pool.cc:224] Handling call
0709 13:08:00.479377 (+133560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.458273 29287 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:00.487850 26606 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.488269 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2302) took 1395 ms. Trace:
I20260709 13:08:00.488579 26606 rpcz_store.cc:276] 0709 13:07:59.093354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.415120 (+1321766us) service_pool.cc:224] Handling call
0709 13:08:00.488226 (+ 73106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.487131 28689 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.489524 29255 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:00.490793 27316 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:08:00.490496 29255 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.491793 29314 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.492035 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.492524 29314 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.493431 26611 raft_consensus.cc:2368] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:08:00.493896 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2304) took 1400 ms. Trace:
I20260709 13:08:00.494218 26611 rpcz_store.cc:276] 0709 13:07:59.093917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.386966 (+1293049us) service_pool.cc:224] Handling call
0709 13:08:00.493838 (+106872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.494863 29314 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.495477 29082 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.496726 29259 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.498807 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.499464 27321 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:00.500381 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.501860 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.502593 27318 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:00.504060 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.506743 29110 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.507084 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:00.508314 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 87925us
I20260709 13:08:00.509204 26604 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 3.
I20260709 13:08:00.509563 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.509756 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2316) took 1251 ms. Trace:
I20260709 13:08:00.510041 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.510157 26604 rpcz_store.cc:276] 0709 13:07:59.259161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.437932 (+1178771us) service_pool.cc:224] Handling call
0709 13:08:00.509696 (+ 71764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.511094 29273 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.511607 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.511924 29273 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.513360 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.498201 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.515249 29113 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.515739 29113 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.491806 29346 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:08:00.516335 29113 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.516907 29346 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.517278 29346 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:00.518249 29346 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.520088 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1307) took 3864 ms. Trace:
I20260709 13:08:00.521174 26754 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:00.520102 29287 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.521847 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1038) took 1213 ms. Trace:
I20260709 13:08:00.522193 29296 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:00.520479 26755 rpcz_store.cc:276] 0709 13:07:56.656122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.449404 (+1793282us) service_pool.cc:224] Handling call
0709 13:07:58.638686 (+189282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.066723 (+428037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.066752 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.067233 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.171834 (+1104601us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:00.445697 (+273863us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.467005 (+ 21308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.477766 (+ 10761us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.477806 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:00.477820 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.520008 (+ 42188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":456505,"prepare.queue_time_us":96099,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":491833,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":24667,"thread_start_us":1367180,"threads_started":2,"wal-append.queue_time_us":1194355}
I20260709 13:08:00.524152 26755 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:00.524407 27317 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:08:00.524915 27317 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 3
I20260709 13:08:00.525460 27317 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:08:00.525926 27317 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:08:00.526515 27317 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.528578 29197 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.529959 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.530982 26680 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.531714 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.532287 26605 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.533012 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.508435 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1060) took 2172 ms. Trace:
I20260709 13:08:00.535888 26678 rpcz_store.cc:276] 0709 13:07:58.336243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.122083 (+785840us) service_pool.cc:224] Handling call
0709 13:07:59.122414 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.176280 (+1053866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.508184 (+331904us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003052d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:00.508380 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421158784}
I20260709 13:08:00.536828 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.537137 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.537624 29262 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.537818 26678 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.500283 29106 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.538815 29335 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.538928 29106 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.541272 29106 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.502622 27315 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:00.511374 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:00.544443 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:00.544844 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1291) took 1455 ms (client timeout 1909 ms). Trace:
W20260709 13:08:00.544955 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1299) took 1372 ms (client timeout 1556 ms). Trace:
W20260709 13:08:00.545477 26612 rpcz_store.cc:269] 0709 13:07:59.172284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.510935 (+1338651us) service_pool.cc:224] Handling call
0709 13:08:00.544902 (+ 33967us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.545347 26603 rpcz_store.cc:269] 0709 13:07:59.089102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.089348 (+   246us) service_pool.cc:224] Handling call
0709 13:08:00.527564 (+1438216us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.544784 (+ 17220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838590848}
I20260709 13:08:00.546250 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.546476 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:00.546749 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:00.546881 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.547684 29332 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.548141 29332 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.548523 29332 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.531742 29287 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.549768 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.587337 26604 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.526098 27320 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.551771 29255 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.552019 26603 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:00.601492 26758 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:00.601801 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2314) took 1386 ms. Trace:
I20260709 13:08:00.602161 26603 rpcz_store.cc:276] 0709 13:07:59.215258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.546578 (+1331320us) service_pool.cc:224] Handling call
0709 13:08:00.601750 (+ 55172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.602627 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1047) took 1291 ms. Trace:
I20260709 13:08:00.603008 26758 rpcz_store.cc:276] 0709 13:07:59.311075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.336282 (+1025207us) service_pool.cc:224] Handling call
0709 13:08:00.602474 (+266192us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54002dbed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.602571 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606762368}
I20260709 13:08:00.553217 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.555770 26684 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:00.604043 26681 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:00.604079 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.604542 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1078) took 1335 ms. Trace:
I20260709 13:08:00.604780 26758 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:00.556347 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2348) took 3446 ms. Trace:
I20260709 13:08:00.605257 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.604923 26684 rpcz_store.cc:276] 0709 13:07:59.269443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.506703 (+1237260us) service_pool.cc:224] Handling call
0709 13:08:00.604399 (+ 97696us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54001dae54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.604491 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109972224}
I20260709 13:08:00.605856 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.519517 29346 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.606804 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.605434 26683 rpcz_store.cc:276] 0709 13:07:57.109517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.109758 (+   241us) service_pool.cc:224] Handling call
0709 13:07:58.073879 (+964121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.417217 (+343338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.417262 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.417828 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.064401 (+646573us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:59.064442 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.555627 (+1491185us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:00.555719 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.555785 (+    66us) raft_consensus.cc:1685] finished
0709 13:08:00.555801 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.556138 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1090,"raft.queue_time_us":599490,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":785872768,"thread_start_us":646225,"threads_started":1,"wal-append.queue_time_us":846294}
I20260709 13:08:00.609193 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.609794 26683 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.559741 26608 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:00.612835 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1297) took 1449 ms. Trace:
I20260709 13:08:00.613237 26608 rpcz_store.cc:276] 0709 13:07:59.163003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.559051 (+1396048us) service_pool.cc:224] Handling call
0709 13:08:00.559518 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.612483 (+ 52965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.612712 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.544524 29197 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:00.564165 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 207) took 3130 ms. Trace:
I20260709 13:08:00.564560 29260 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.522205 26754 rpcz_store.cc:276] 0709 13:07:59.308773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.469633 (+1160860us) service_pool.cc:224] Handling call
0709 13:08:00.520757 (+ 51124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.521594 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.521779 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.565054 28632 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:00.566004 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.566593 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:00.531734 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1068) took 1265 ms. Trace:
I20260709 13:08:00.630956 26680 rpcz_store.cc:276] 0709 13:07:59.266404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.444667 (+1178263us) service_pool.cc:224] Handling call
0709 13:08:00.531638 (+ 86971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.631088 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:00.510421 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1298) took 1340 ms (client timeout 1556 ms). Trace:
I20260709 13:08:00.568282 26610 raft_consensus.cc:2368] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9.
I20260709 13:08:00.545421 29259 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:00.569363 29110 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.571251 29329 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:00.568882 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58976.2us
I20260709 13:08:00.568895 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1049) took 1257 ms. Trace:
I20260709 13:08:00.570189 29296 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:00.572567 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57255.8us
I20260709 13:08:00.636453 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.636821 29329 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:00.637241 26680 raft_consensus.cc:2368] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7.
I20260709 13:08:00.638191 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.637936 29329 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.639079 29329 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.630609 29335 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.633635 29262 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:00.639916 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2297) took 1548 ms (client timeout 1892 ms). Trace:
I20260709 13:08:00.572904 26611 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:00.573354 29121 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:00.640345 26610 rpcz_store.cc:269] 0709 13:07:59.091647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.220136 (+1128489us) service_pool.cc:224] Handling call
0709 13:08:00.639709 (+419573us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400163354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.639839 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736640896}
I20260709 13:08:00.632983 29259 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:00.641582 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:00.641949 29259 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:00.642933 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.568317 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.576025 29254 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.639076 26680 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.644883 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.646143 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.629951 29345 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.524832 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1050) took 1213 ms. Trace:
I20260709 13:08:00.592789 29273 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:00.577659 29350 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.579340 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:00.581019 27321 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:00.581379 29336 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.582235 26752 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:00.582448 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1035) took 1191 ms. Trace:
I20260709 13:08:00.664899 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1041) took 1355 ms. Trace:
I20260709 13:08:00.582873 29309 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.583858 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.585584 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:00.549953 26612 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:00.589341 29298 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.592093 26761 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:00.669554 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1044) took 1359 ms. Trace:
I20260709 13:08:00.670012 26761 rpcz_store.cc:276] 0709 13:07:59.310328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.411758 (+1101430us) service_pool.cc:224] Handling call
0709 13:08:00.669474 (+257716us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.672016 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.672456 26678 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:00.572928 26756 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.600914 26604 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.592726 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1056) took 2278 ms. Trace:
I20260709 13:08:00.625262 28988 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.626036 29266 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:00.677511 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.616825 26687 rpcz_store.cc:276] 0709 13:07:57.433690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.920727 (+487037us) service_pool.cc:224] Handling call
0709 13:07:57.959705 (+ 38978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.005760 (+1046055us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:59.170623 (+164863us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.127032 (+956409us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.159161 (+ 32129us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.159419 (+   258us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:00.469196 (+309777us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.478361 (+  9165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.506166 (+ 27805us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b48002826d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:08:00.563797 (+ 57631us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.563938 (+   141us) raft_consensus.cc:1685] finished
0709 13:08:00.563957 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.564102 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8246,"prepare.queue_time_us":631377,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":157211,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":52551,"spinlock_wait_cycles":36953472,"thread_start_us":2315203,"threads_started":4,"wal-append.queue_time_us":1039337}
I20260709 13:08:00.626035 28632 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.628712 26753 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:00.628548 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:00.628916 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 46440us
W20260709 13:08:00.632226 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52496.9us
W20260709 13:08:00.631910 26609 rpcz_store.cc:269] 0709 13:07:59.169589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.509106 (+1339517us) service_pool.cc:224] Handling call
0709 13:08:00.510356 (+  1250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.634826 26608 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.634848 26605 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:00.686364 26754 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:00.637070 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.634289 26759 rpcz_store.cc:276] 0709 13:07:59.311549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.253153 (+941604us) service_pool.cc:224] Handling call
0709 13:08:00.568665 (+315512us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b5400081e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.568817 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185518848}
W20260709 13:08:00.576341 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 108620us
I20260709 13:08:00.544189 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:00.575080 29305 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:00.577158 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1054) took 2277 ms. Trace:
I20260709 13:08:00.657280 26755 rpcz_store.cc:276] 0709 13:07:59.311841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.523482 (+1211641us) service_pool.cc:224] Handling call
0709 13:08:00.523891 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.524536 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.524752 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.662745 26682 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.665091 26757 rpcz_store.cc:276] 0709 13:07:59.293753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.469012 (+1175259us) service_pool.cc:224] Handling call
0709 13:08:00.469404 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.477797 (+  8393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.477832 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.477881 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.485248 (+  7367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.485308 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.485414 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.665899 26752 rpcz_store.cc:276] 0709 13:07:59.309600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.419743 (+1110143us) service_pool.cc:224] Handling call
0709 13:08:00.664823 (+245080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.674490 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1034) took 1382 ms. Trace:
I20260709 13:08:00.691382 26756 rpcz_store.cc:276] 0709 13:07:59.293406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.255427 (+962021us) service_pool.cc:224] Handling call
0709 13:08:00.674434 (+419007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.675853 26679 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:00.678329 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1071) took 1410 ms. Trace:
I20260709 13:08:00.646158 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:00.692584 26678 rpcz_store.cc:276] 0709 13:07:59.267505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.536864 (+1269359us) service_pool.cc:224] Handling call
0709 13:08:00.678273 (+141409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.693707 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:00.685220 26683 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.694991 26681 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:00.605926 29113 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.640338 29262 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.705618 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1074) took 1437 ms. Trace:
I20260709 13:08:00.707437 26681 rpcz_store.cc:276] 0709 13:07:59.268446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.605007 (+1336561us) service_pool.cc:224] Handling call
0709 13:08:00.705438 (+100431us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b54000b5254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.705568 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180431232}
I20260709 13:08:00.706065 26761 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:08:00.709355 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72391.8us
I20260709 13:08:00.706992 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1314) took 1563 ms. Trace:
I20260709 13:08:00.710633 26753 rpcz_store.cc:276] 0709 13:07:59.135571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.425470 (+1289899us) service_pool.cc:224] Handling call
0709 13:08:00.426103 (+   633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.683578 (+257475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.698605 (+ 15027us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400226d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:00.698842 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465036032}
I20260709 13:08:00.688443 26686 rpcz_store.cc:276] 0709 13:07:58.299357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.082512 (+783155us) service_pool.cc:224] Handling call
0709 13:07:59.082942 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.141403 (+1058461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.141445 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.142449 (+  1004us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.339468 (+197019us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:00.467794 (+128326us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.472085 (+  4291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.484598 (+ 12513us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.566892 (+ 82294us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b48002826d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:08:00.576836 (+  9944us) raft_consensus.cc:1685] finished
0709 13:08:00.576936 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.577091 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293,"prepare.queue_time_us":258800,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":241232,"raft.run_cpu_time_us":978,"raft.run_wall_time_us":87109,"spinlock_wait_cycles":23151360,"thread_start_us":1346136,"threads_started":3,"wal-append.queue_time_us":337847}
I20260709 13:08:00.717206 26680 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:00.718693 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:00.674371 26685 rpcz_store.cc:276] 0709 13:07:58.314107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.109855 (+795748us) service_pool.cc:224] Handling call
0709 13:07:59.157258 (+ 47403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.267229 (+1109971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.268136 (+   907us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.273578 (+  5442us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.354325 (+ 80747us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.467986 (+113661us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.478271 (+ 10285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.486898 (+  8627us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.592501 (+105603us) raft_consensus.cc:1685] finished
0709 13:08:00.592522 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.592673 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21074,"prepare.queue_time_us":243469,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":167307,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17289,"thread_start_us":1247651,"threads_started":3,"wal-append.queue_time_us":263053}
I20260709 13:08:00.721135 26604 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:00.722410 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.704551 29273 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:00.675280 27317 raft_consensus.cc:2376] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8. Re-sending same reply.
I20260709 13:08:00.726424 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1075) took 1457 ms. Trace:
I20260709 13:08:00.728351 26679 rpcz_store.cc:276] 0709 13:07:59.268702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.469410 (+1200708us) service_pool.cc:224] Handling call
0709 13:08:00.726251 (+256841us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400127fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:00.726370 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309144320}
W20260709 13:08:00.727454 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.709424 29296 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.733853 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:00.738790 26680 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:08:00.738768 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.720816 28689 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.744685 26683 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:00.744939 26687 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.729871 29273 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:00.747834 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79588.8us
I20260709 13:08:00.746815 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:00.749085 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1069) took 1478 ms. Trace:
I20260709 13:08:00.749629 26683 rpcz_store.cc:276] 0709 13:07:59.266907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.706969 (+1440062us) service_pool.cc:224] Handling call
0709 13:08:00.736194 (+ 29225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.745101 (+  8907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.745300 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.750433 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.754057 28728 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.754364 29260 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.755329 29336 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.755944 26755 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:08:00.756374 26755 pending_rounds.cc:85] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 4
I20260709 13:08:00.756618 26755 pending_rounds.cc:107] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:08:00.756897 26755 raft_consensus.cc:2889] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.743244 29106 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:00.758195 29148 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.758621 29148 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.759654 29148 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.748620 29273 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.718209 29266 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.764776 29309 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.765264 29305 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.742017 28689 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.756636 29298 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.757895 29106 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.766500 29113 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.766571 28689 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.767640 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.768297 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:00.769253 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:00.770869 29110 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.771431 29110 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.771783 29110 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.764766 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1076) took 1495 ms. Trace:
I20260709 13:08:00.776779 26678 rpcz_store.cc:276] 0709 13:07:59.268941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.719199 (+1450258us) service_pool.cc:224] Handling call
0709 13:08:00.744428 (+ 25229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.764391 (+ 19963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.764425 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.764476 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.764521 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.764595 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.764705 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1151,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97}
I20260709 13:08:00.778167 26761 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.770684 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:00.754501 28728 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.779397 29148 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.777499 26682 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:00.790828 29345 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:00.791762 27286 leader_election.cc:336] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 2.220s (SENT)
I20260709 13:08:00.791973 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1308) took 1688 ms. Trace:
I20260709 13:08:00.792374 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:00.793533 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44275.3us
I20260709 13:08:00.792464 26760 rpcz_store.cc:276] 0709 13:07:59.103254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.106219 (+  2965us) service_pool.cc:224] Handling call
0709 13:07:59.106648 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.253358 (+1146710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.255560 (+  2202us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.375276 (+119716us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.617158 (+241882us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:00.617189 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.629047 (+ 11858us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.791742 (+162695us) raft_consensus.cc:1685] finished
0709 13:08:00.791760 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.791914 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1916,"raft.queue_time_us":75303,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":1350861,"threads_started":2,"wal-append.queue_time_us":311756}
I20260709 13:08:00.795329 29310 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.796607 29262 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.799585 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.800662 29262 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:00.801115 29262 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.801499 29262 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.782501 29113 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:00.791742 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1077) took 1515 ms. Trace:
I20260709 13:08:00.808106 26682 rpcz_store.cc:276] 0709 13:07:59.269192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.486697 (+1217505us) service_pool.cc:224] Handling call
0709 13:08:00.784395 (+297698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.808781 26758 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.812186 26687 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:00.785955 29350 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:00.817150 29350 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.816843 29218 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:00.818593 29218 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.816159 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1281) took 1788 ms. Trace:
I20260709 13:08:00.825446 26607 rpcz_store.cc:276] 0709 13:07:59.016837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.017003 (+   166us) service_pool.cc:224] Handling call
0709 13:07:59.017407 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:59.017810 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.017837 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:59.018416 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 13:07:59.232465 (+214049us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:00.469913 (+1237448us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.731007 (+261094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.742990 (+ 11983us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.748415 (+  5425us) raft_consensus.cc:1685] finished
0709 13:08:00.749264 (+   849us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.805493 (+ 56229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11912,"prepare.queue_time_us":1173116,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":9916,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":6975,"spinlock_wait_cycles":13702016,"thread_start_us":1644598,"threads_started":3,"wal-append.queue_time_us":600758,"wal-append.run_cpu_time_us":1763,"wal-append.run_wall_time_us":1040426}
W20260709 13:08:00.827886 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57267.5us
W20260709 13:08:00.829967 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 114973us
I20260709 13:08:00.820369 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:00.745344 29296 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.818162 29350 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.834178 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:00.805043 29298 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:00.825301 29218 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.844499 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.844439 28728 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.845693 28728 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.846334 29259 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.846765 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.846711 29332 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.847748 26681 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:00.848326 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.843727 26577 leader_election.cc:400] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7.
I20260709 13:08:00.850106 26577 leader_election.cc:403] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.840302 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.839604 28664 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.840004 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.840585 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.862077 26684 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:00.864368 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:00.842525 29121 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:00.852238 29336 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.871464 29121 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.854895 29113 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.871223 28689 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.875273 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.865505 28664 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.882290 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:00.866438 29305 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.886718 29296 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.887326 29335 raft_consensus.cc:2764] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:00.887850 27314 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:00.878170 29113 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:00.888618 29113 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.884122 28664 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.892032 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.892640 29332 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.893311 29332 raft_consensus.cc:2764] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:00.893429 26683 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:00.895875 29345 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.882069 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.896301 26724 leader_election.cc:400] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:00.897778 26724 leader_election.cc:403] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.898236 29335 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:00.898485 29330 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:00.898849 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:00.900102 26724 leader_election.cc:400] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:08:00.900461 26724 leader_election.cc:403] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:00.901055 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.901482 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.875744 29121 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.902359 29330 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5.
I20260709 13:08:00.903203 29346 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:00.903816 29346 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:00.904693 29346 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.872404 28632 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.905814 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:00.914618 29110 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.931855 29218 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:00.933110 26724 leader_election.cc:400] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9.
I20260709 13:08:00.933238 29218 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.933480 26724 leader_election.cc:403] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.933712 29266 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.923213 29273 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.915498 27316 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:00.936065 29273 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:00.936336 29335 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.916179 29254 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:00.937034 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:00.937299 29254 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.938055 29255 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:00.938558 29255 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.938396 29254 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:00.917913 29330 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.939486 29254 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:00.939517 29255 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:00.947082 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65190.1us
W20260709 13:08:00.947854 26650 connection.cc:256] RPC call timeout handler was delayed by -2.4104140689998985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:08:00.921833 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.922312 29262 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:00.923898 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51099.7us
I20260709 13:08:00.925163 29259 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:00.925678 29298 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:00.928783 29106 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.897837 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:00.919083 28689 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:00.949246 26650 connection.cc:256] RPC call timeout handler was delayed by -2.4059140689998912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 13:08:00.964581 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:00.964623 26650 connection.cc:256] RPC call timeout handler was delayed by -2.4059140689998912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 13:08:00.933461 29110 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:00.979890 29305 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7.
I20260709 13:08:00.984143 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:00.988873 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55951.9us
I20260709 13:08:00.996373 29332 raft_consensus.cc:2764] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:00.969918 29113 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:00.997382 26650 connection.cc:256] RPC call timeout handler was delayed by -2.0879195599999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:08:00.999547 26650 connection.cc:256] RPC call timeout handler was delayed by -2.0483195599999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:08:00.999763 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 102028us
W20260709 13:08:00.999939 26650 connection.cc:256] RPC call timeout handler was delayed by -2.0483195599999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:08:01.000478 26650 connection.cc:256] RPC call timeout handler was delayed by -2.0483195599999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:08:01.000782 26650 connection.cc:256] RPC call timeout handler was delayed by -1.9826195599999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:08:01.004799 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.005034 29110 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:01.005827 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.007808 29106 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.008315 29106 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:00.987546 29330 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:01.008932 29330 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:00.980778 29372 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.011101 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.009330 29106 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.009341 29330 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.012256 29148 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.020301 28664 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:01.021016 29363 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.003s
I20260709 13:08:01.022526 28664 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:01.022801 28988 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:01.023229 29372 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.013978 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.024082 26681 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:01.008603 29262 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:01.023253 28988 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:01.025454 26650 connection.cc:256] RPC call timeout handler was delayed by -1.8512195600000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:08:01.025707 28689 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:01.026225 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.026221 28988 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.028383 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:01.029613 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.030560 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.031854 29262 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.032328 29262 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.032691 29262 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:01.025899 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6298195599999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:08:01.038125 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.041838 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.042944 29266 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.044423 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.045017 26686 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.045187 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.045894 26684 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:01.046981 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.047210 29113 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:01.044071 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.048336 26685 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:01.049558 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.050432 26682 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:01.051824 29273 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.052328 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.052793 29273 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.053683 29273 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.054018 29273 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:01.054657 29303 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:01.055239 29303 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:01.054909 29273 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.056438 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.094004 26682 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:01.050356 28689 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:01.058337 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.094897 26612 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.055823 29287 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.059631 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.096148 26756 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:01.061255 29366 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.295s	user 0.002s	sys 0.000s
I20260709 13:08:01.061344 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:01.062000 29266 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:01.062461 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:01.064085 29346 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.064469 29330 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.045291 29336 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.070909 29148 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.057446 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.107194 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.057138 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.120515 26755 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:08:01.072269 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:01.072604 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.073745 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.073616 26507 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 4, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 4 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.074429 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.075146 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.075500 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.075909 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.076581 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.123653 26608 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.076802 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:01.077188 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.044020 29372 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.077908 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.078605 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.130777 26759 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.079020 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.079404 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.047951 26687 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:01.080224 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.133064 26754 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:01.081091 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.082104 29335 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9.
I20260709 13:08:01.140080 26761 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:08:01.140133 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 78874.1us
I20260709 13:08:01.143132 26757 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.105753 29346 consensus_queue.cc:1243] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:01.091502 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.092396 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.092746 28988 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.075184 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.056161 29303 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:01.078025 26510 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 113) took 15571 ms (client timeout 15000 ms). Trace:
I20260709 13:08:01.098559 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.094573 28689 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:01.118204 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.121953 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.164067 26680 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:01.122133 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 49998.6us
I20260709 13:08:01.123618 26604 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:01.077795 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.165686 26605 raft_consensus.cc:2368] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
W20260709 13:08:01.125558 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.095477 29287 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:01.100225 29298 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.127774 29336 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.129446 28632 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.088165 26686 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:01.148284 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.149827 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.153158 26685 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.157020 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.158987 29310 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.154788 29273 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:01.159981 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84893.2us
I20260709 13:08:01.160526 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.161085 29350 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:01.164944 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.187824 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.188632 26755 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:01.166965 26612 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:01.167320 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:01.190544 26756 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:01.167698 26606 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.122926 26760 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:01.174253 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.191733 26687 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 4: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.175681 26752 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:01.179530 26681 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:01.167958 28689 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.178586 26684 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:08:01.182260 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:01.184140 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.184854 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.181015 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.193022 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:01.196955 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.197427 26680 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:08:01.197611 26759 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.193348 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.197902 26605 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:01.129824 29266 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.180814 26682 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:01.189770 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.200394 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.200019 29350 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.201189 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:01.201406 26681 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:01.195864 29106 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.203127 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:01.209113 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 200876us
I20260709 13:08:01.244603 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.245397 26683 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:01.245640 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.246502 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.213722 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.213958 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.215317 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.261689 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.263418 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.257283 26684 pending_rounds.cc:85] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 6
I20260709 13:08:01.264633 26684 pending_rounds.cc:107] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:08:01.264966 26684 raft_consensus.cc:2889] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.195560 29113 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:01.213369 29137 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:01.258500 26507 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:01.272951 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 108483us
I20260709 13:08:01.186677 29262 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.202880 29329 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.271559 26758 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.273644 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.273339 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.273283 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.273398 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.277542 26682 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:01.272634 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65305.9us
I20260709 13:08:01.256017 29218 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:01.284256 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.292300 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:01.267920 29335 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:01.295737 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:01.299863 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 98786.8us
I20260709 13:08:01.300639 26761 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:01.273391 29336 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:01.273464 28664 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:01.312341 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.272984 29137 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:01.313634 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:01.297962 29346 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.327211 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.334897 26683 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.328974 26612 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.328336 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.277191 29329 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:01.294147 29218 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:01.343384 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.312294 29306 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.331055 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.332334 26687 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:01.333421 26507 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 4, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 4 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.324628 29106 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:01.360301 29330 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:01.340324 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.360225 26507 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 4, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:01.325893 29336 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:01.371187 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57642.8us
I20260709 13:08:01.334173 29137 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.325127 28664 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.345019 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.360330 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.333470 29346 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:01.349426 29218 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:01.155054 26510 rpcz_store.cc:269] 0709 13:07:45.506183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.506827 (+   644us) service_pool.cc:224] Handling call
0709 13:08:01.077797 (+15570970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:56.619442 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:56.905710 (+286268us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:56.905775 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:07:56.905804 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:56.907160 (+  1356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:56.907255 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:56.907298 (+    43us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:56.908455 (+  1157us) tablet.cc:701] Row locks acquired
0709 13:07:56.908519 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:07:56.908749 (+   230us) write_op.cc:270] Start()
0709 13:07:56.908933 (+   184us) write_op.cc:276] Timestamp: P: 1783602476908667 usec, L: 0
0709 13:07:56.908965 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:56.909876 (+   911us) log.cc:844] Serialized 3691 byte log entry
0709 13:07:59.324865 (+2414989us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800303dc0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db
0709 13:07:59.325478 (+   613us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:00.404850 (+1079372us) op_driver.cc:464] REPLICATION: finished
0709 13:08:00.702300 (+297450us) write_op.cc:301] APPLY: starting
0709 13:08:00.718372 (+ 16072us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:00.791125 (+ 72753us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:00.791165 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:00.797241 (+  6076us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:00.797668 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:08:00.797721 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:00.798196 (+   475us) log.cc:844] Serialized 70 byte log entry
0709 13:08:00.798425 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:00.798781 (+   356us) write_op.cc:454] Released schema lock
0709 13:08:00.798846 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:00.802561 (+  3715us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:00.802590 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2619573,"reported_tablets":18,"spinlock_wait_cycles":14080,"child_traces":[["op",{"apply.queue_time_us":241554,"apply.run_cpu_time_us":4629,"apply.run_wall_time_us":131783,"num_ops":9,"prepare.queue_time_us":223153,"prepare.run_cpu_time_us":160584,"prepare.run_wall_time_us":1389563,"raft.queue_time_us":262243,"raft.run_cpu_time_us":7655,"raft.run_wall_time_us":76090,"replication_time_us":3495613,"spinlock_wait_cycles":36799232,"thread_start_us":577688,"threads_started":4,"wal-append.queue_time_us":1135236}]]}
I20260709 13:08:01.396961 26685 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
W20260709 13:08:01.375591 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44643.2us
I20260709 13:08:01.382160 26507 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.364427 29335 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:01.402765 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56801.6us
I20260709 13:08:01.400461 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.406263 26682 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:01.377848 29336 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:01.408460 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.411829 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.388581 28664 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.386798 29296 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.301096 29287 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:01.421268 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.444514 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.383284 29121 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.384704 29223 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:01.422701 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.367556 26683 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:01.425561 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:01.358299 26758 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
W20260709 13:08:01.433149 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.392908 29346 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.445254 26604 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:01.325747 29298 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.461598 26507 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 4, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 4 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:01.464686 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57054.5us
I20260709 13:08:01.490198 26507 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:01.488677 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47109.7us
I20260709 13:08:01.448458 29113 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:01.494318 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 51280.2us
I20260709 13:08:01.450008 29296 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:01.450378 29223 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:01.506973 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 106564us
I20260709 13:08:01.495317 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.520179 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.506697 29113 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.490304 29121 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:01.536836 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.418807 29329 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.536021 26507 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:01.520746 29296 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.520632 29223 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.527797 29332 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:01.520234 29266 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:01.505450 29309 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:08:01.562507 26650 leader_election.cc:336] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.858s (SENT)
I20260709 13:08:01.536281 29287 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:01.559725 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72717us
I20260709 13:08:01.535194 28632 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.565603 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.553241 26752 pending_rounds.cc:85] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:08:01.575762 26752 pending_rounds.cc:107] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:01.576090 26752 raft_consensus.cc:2889] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.577406 26507 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:01.578953 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58859.3us
I20260709 13:08:01.549857 29262 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:01.581385 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.554827 29303 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:01.546089 29350 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:01.537328 29392 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.593320 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:01.584154 26608 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
W20260709 13:08:01.600663 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.602823 26612 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:01.603062 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.600718 26507 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 4, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:08:01.608837 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 49719.6us
I20260709 13:08:01.624353 29357 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:01.625834 29388 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:08:01.626351 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.627769 29382 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:08:01.632644 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:01.636224 29379 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:08:01.621671 26507 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 4, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 4 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:01.648322 29377 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:01.649004 29377 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.649690 29110 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.650238 29110 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.649962 29377 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.651932 28689 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.653854 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.654049 28689 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:01.656175 26754 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:01.656778 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.614418 29378 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.657778 29378 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.658136 29378 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:01.658751 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.020s
W20260709 13:08:01.659060 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.010s	sys 0.020s
I20260709 13:08:01.662420 28632 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:01.662917 28632 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.563009 29335 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:01.665485 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 54068.1us
W20260709 13:08:01.659314 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 511006us
I20260709 13:08:01.611865 29106 raft_consensus.cc:2764] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:01.612306 29372 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:01.687583 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 94361.1us
I20260709 13:08:01.618273 29383 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.678277 29392 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:01.618835 29350 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.702492 26683 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:01.651166 29110 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.708667 26507 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:01.713757 26761 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:01.715209 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.710402 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.718505 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.719244 26612 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.655521 29336 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.723860 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:01.707772 29383 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.725031 29137 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.724375 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.728333 26612 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:01.728979 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.729558 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.730162 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.730314 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.731467 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.732436 26607 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:01.731470 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.740275 26724 leader_election.cc:400] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:01.607375 29121 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.704146 29357 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:01.743522 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.746105 26608 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:01.726444 26507 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to -1, leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) evicted, now has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 2 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:08:01.711119 29372 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.744401 26724 leader_election.cc:403] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.765276 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:01.744750 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62277.6us
W20260709 13:08:01.751291 29385 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:08:01.751420 29137 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:01.752328 29386 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:08:01.752231 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:01.753827 29380 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:08:01.754747 29332 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:01.710196 28689 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:08:01.756747 28988 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
W20260709 13:08:01.757184 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.761700 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:01.779835 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.794804 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.795954 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.786085 26604 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:01.755965 29403 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:01.790405 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94537.2us
I20260709 13:08:01.791363 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:01.797981 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67375.9us
I20260709 13:08:01.801745 26605 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:01.792344 29332 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.804359 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.819649 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:01.781916 26507 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 5, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.723265 29113 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.813210 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:01.823230 26683 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.802471 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:01.823940 26612 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.803792 29266 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:01.805932 29306 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.751581 29399 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:08:01.828184 26608 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:01.830369 26612 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:01.811946 29262 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:01.825481 29303 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:01.766240 29357 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:01.849341 29400 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:01.849809 29400 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:01.812096 29392 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:08:01.851994 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 167263us
I20260709 13:08:01.852206 29401 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:01.853091 29401 consensus_queue.cc:1243] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:01.853284 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:01.852499 28946 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.825907 29266 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:01.860142 26683 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:01.863013 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:01.836524 29306 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:01.838004 29402 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.866585 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:01.837577 29383 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:01.854761 29303 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:01.875831 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:01.854270 29262 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:01.909075 29303 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.864032 29266 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:01.873625 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44858.2us
W20260709 13:08:01.916255 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 106748us
I20260709 13:08:01.934788 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:01.863893 29412 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:01.881870 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.873639 29407 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.911584 29402 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:01.865944 29410 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:01.973143 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.974278 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.971063 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.859869 29372 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:01.971484 26683 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:01.978752 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112233us
I20260709 13:08:01.980769 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:01.950264 29309 raft_consensus.cc:2764] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:01.994397 26678 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:01.957213 29412 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:02.002169 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.003024 26686 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:02.016028 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81356.8us
W20260709 13:08:02.017388 28664 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:08:02.036226 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:02.037451 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:02.043711 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:01.974836 29306 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.019312 29399 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:02.050099 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.052686 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.053498 26678 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:02.050760 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:01.947599 29400 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:02.061439 29394 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:08:02.062073 29414 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.062786 29412 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.066808 29423 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.067260 29406 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:02.073988 26686 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.046437 29383 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:02.003130 29262 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.080678 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.086565 26686 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:02.052394 29399 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:02.042531 28664 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:02.096560 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.078727 29406 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.113132 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.114473 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76032.1us
I20260709 13:08:02.099186 29400 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.084888 29383 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.134249 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:02.106938 29223 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:08:02.136930 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.106491 29399 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:02.140565 26686 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.141215 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.116158 29406 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.148797 26680 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:02.134649 29357 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:02.143877 29273 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.004s
I20260709 13:08:02.153241 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.085601 29423 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.141856 29383 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:02.160065 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44753.2us
I20260709 13:08:02.079761 29414 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.171775 26752 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:02.078500 29402 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.180528 26680 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.188251 29395 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:02.188803 29395 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.189190 29395 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.145465 29223 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.191133 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.163038 29428 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:02.218577 26686 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:02.230585 26754 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:02.228650 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:02.232359 29296 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
I20260709 13:08:02.243149 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.211175 29428 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.202821 29398 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.215s
I20260709 13:08:02.245385 29428 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.264305 29329 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:02.267275 29390 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.706s	user 0.002s	sys 0.000s
W20260709 13:08:02.269860 29378 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 13:08:02.270406 29378 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.271854 26607 raft_consensus.cc:2368] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7.
I20260709 13:08:02.276151 29223 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:02.277750 28632 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.003s
I20260709 13:08:02.278184 28632 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.282114 29336 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.282729 29332 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.283161 29106 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:02.283721 29106 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:02.286239 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.288039 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123270us
I20260709 13:08:02.301568 26761 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:02.316143 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.329638 26758 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:02.248423 29296 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:02.340288 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.300340 28664 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.376345 28632 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.377689 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.378609 26681 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:02.379134 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.380051 26682 raft_consensus.cc:2368] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:02.386214 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.331693 29336 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.390019 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 524507us
I20260709 13:08:02.394770 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.395598 26678 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:02.403939 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 115065us
I20260709 13:08:02.415061 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.417075 26680 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.397670 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:02.441980 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49505us
I20260709 13:08:02.442837 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.443192 26682 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:02.444738 26681 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.451861 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:02.441447 29218 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.003s
W20260709 13:08:02.456138 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59100.6us
I20260709 13:08:02.443681 29273 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.461017 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.458262 26682 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:02.396584 29336 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:02.474052 29350 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.002s
I20260709 13:08:02.474804 29441 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.475378 29441 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.460737 29218 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.477578 29218 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.478128 29441 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.478312 29377 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:02.478812 29377 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:02.479600 29446 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.480197 29446 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:02.480819 28946 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:08:02.481256 28946 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:02.481549 29442 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:08:02.479696 29377 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.475332 29106 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.484063 29350 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.482641 29446 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.490840 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.456341 29414 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.492112 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:02.487195 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 462332us
I20260709 13:08:02.459781 29262 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:02.483718 29266 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
W20260709 13:08:02.467223 29346 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.003s
I20260709 13:08:02.489457 29423 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:02.467547 29398 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:02.511894 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.513736 29398 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:02.513720 26681 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:02.499050 28946 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:02.506789 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.499915 29378 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.498582 29273 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:02.520969 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75763.9us
I20260709 13:08:02.504149 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.523351 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:02.520979 26609 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
W20260709 13:08:02.508734 29440 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:02.517612 29332 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.501376 29266 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.531323 29306 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:02.524284 29296 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.502864 29346 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.530663 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.539752 29350 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.527727 29423 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.561417 29306 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:02.562739 29336 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.525666 29262 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:08:02.566401 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.569725 29273 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.580093 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.583832 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.528360 29406 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:02.585829 29432 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:08:02.599275 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.599923 26761 raft_consensus.cc:2376] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8. Re-sending same reply.
I20260709 13:08:02.601217 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.601856 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:02.602712 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.603468 26758 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:08:02.604905 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.605762 26755 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.605964 29399 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.606956 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.607832 29416 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:02.608063 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.608217 29399 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.608956 29218 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:02.609463 29384 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.876s	user 0.000s	sys 0.003s
I20260709 13:08:02.609519 29218 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:02.610603 29218 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.612200 29306 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.608234 29416 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:02.615600 29416 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.616739 29416 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:02.605062 26757 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:02.622632 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:02.623479 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.624178 26758 raft_consensus.cc:2376] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7. Re-sending same reply.
I20260709 13:08:02.629321 29395 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.630074 29406 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.578517 29378 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:02.634539 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.635319 26758 raft_consensus.cc:2376] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7. Re-sending same reply.
I20260709 13:08:02.637148 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:02.637503 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.638248 26758 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:02.638317 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.643513 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.585825 29412 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:02.642055 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.650349 27315 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:02.605785 29346 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.658509 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.660637 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.662473 26752 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:02.663434 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.670120 26757 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:02.671388 29448 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.677632 29392 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.678179 29392 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.680227 29392 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:02.680382 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2329) took 1622 ms (client timeout 2092 ms). Trace:
W20260709 13:08:02.680799 26611 rpcz_store.cc:269] 0709 13:08:01.057822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.078361 (+ 20539us) service_pool.cc:224] Handling call
0709 13:08:02.680232 (+1601871us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400065254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:02.680329 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541284224}
W20260709 13:08:02.681305 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 700558us
I20260709 13:08:02.682017 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:02.683111 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.683990 29424 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.684664 29424 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:02.685011 29424 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.685348 29424 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.687865 29407 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.691033 29336 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:02.691932 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.693041 29309 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.693321 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.693905 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.694404 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.695201 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.695387 29429 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:02.696095 29425 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.694511 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1110) took 1042 ms. Trace:
I20260709 13:08:02.699996 26679 rpcz_store.cc:276] 0709 13:08:01.652057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.652873 (+   816us) service_pool.cc:224] Handling call
0709 13:08:01.653248 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.851645 (+198397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.854622 (+  2977us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.872169 (+ 17547us) log.cc:844] Serialized 52 byte log entry
0709 13:08:02.015634 (+143465us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:02.084412 (+ 68778us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.694029 (+609617us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.694236 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.694303 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.694340 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:02.694350 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.694461 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803836,"prepare.queue_time_us":137621,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6721,"raft.queue_time_us":806106,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":245,"thread_start_us":124640,"threads_started":2,"wal-append.queue_time_us":153476}
I20260709 13:08:02.696058 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:02.703079 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.703531 29392 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:02.694469 26757 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.691428 29336 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:02.704198 29262 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.718598 26753 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:02.730294 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.687371 29113 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:02.751940 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44257us
I20260709 13:08:02.752091 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.753898 26752 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:02.754992 26761 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:02.758989 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.760103 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.761663 26757 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:02.718425 29273 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.655107 29428 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.770313 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.771011 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.768690 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.768343 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.777135 26605 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 5: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:02.767235 26759 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:02.778497 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.778736 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.751114 29137 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:02.702414 29424 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:02.756910 29383 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.002s
I20260709 13:08:02.779986 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.781840 29429 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:02.782346 29303 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
I20260709 13:08:02.756573 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:02.783231 28946 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.786751 26756 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.787307 26753 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.773908 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:02.793133 26606 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:02.793462 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.774793 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.774513 28728 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.796232 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.797302 27313 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.797595 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.826449 27318 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:02.797911 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:02.799614 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.758183 29346 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.801278 26612 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:02.788663 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.773214 26757 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:02.806452 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.795184 29398 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.904937 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:02.905799 27318 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.767933 29392 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.809832 26752 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:02.774837 29425 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:02.814250 26755 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 3. Current term is 5. Ops: []
I20260709 13:08:02.805030 29113 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.807009 29266 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:02.824599 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50736.1us
I20260709 13:08:02.829366 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:02.832180 29451 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:08:02.814119 29303 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.833506 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.914036 26756 raft_consensus.cc:2368] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
I20260709 13:08:02.841084 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.803268 29336 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.851336 29137 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:02.826882 29401 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:02.852864 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 82628.4us
I20260709 13:08:02.854866 29429 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:02.855595 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:02.919840 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64337.4us
I20260709 13:08:02.856808 29397 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.860010 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.922911 26605 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.860769 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.860843 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:02.861429 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.861598 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.861743 26611 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:02.862262 26606 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:02.926340 26604 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.824753 29121 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.788342 29273 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.809026 29383 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.863075 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1323) took 1149 ms. Trace:
I20260709 13:08:02.934897 26609 rpcz_store.cc:276] 0709 13:08:01.713891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.714017 (+   126us) service_pool.cc:224] Handling call
0709 13:08:02.862912 (+1148895us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b540003f2d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:02.863008 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740317056}
I20260709 13:08:02.867749 29296 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:02.869187 29405 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.869676 29254 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:02.871591 29306 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.872473 28946 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.872010 27314 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:02.874569 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:02.955914 26607 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.874799 29428 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:02.875203 28689 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.824471 27312 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.882383 26683 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:02.883291 29453 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.126s	user 0.003s	sys 0.000s
W20260709 13:08:02.962869 29387 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.373s	user 0.008s	sys 0.000s
I20260709 13:08:02.965951 29405 consensus_queue.cc:1243] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:02.949671 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:02.884009 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.968639 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.969287 26681 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.884610 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.885089 26682 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:02.887895 26754 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:02.972031 26680 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.893193 26685 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:02.893198 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.918171 29113 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.898608 26726 leader_election.cc:400] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7.
I20260709 13:08:02.909752 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:02.981369 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 82983.2us
I20260709 13:08:02.981431 26758 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:02.893455 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:02.982190 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.828707 29395 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:02.916188 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:02.909675 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.987743 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.988081 26678 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:02.988411 26754 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.920722 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.988806 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.987798 26612 raft_consensus.cc:606] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.989440 26682 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:02.989745 26612 raft_consensus.cc:614] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:02.928174 26684 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:02.929776 29429 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.931593 26605 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:02.937649 29266 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:08:02.828810 28728 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.864188 29424 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:02.999264 26758 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:02.936167 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:02.939824 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.917665 29425 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:02.947732 26760 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:02.953788 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:03.012037 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:02.954747 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:02.956825 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50497.4us
I20260709 13:08:02.934048 29418 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:02.938026 29448 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.960235 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:02.883890 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.017758 26687 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:02.922748 29223 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:08:02.750226 29262 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.975251 26604 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:02.941022 29137 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:02.983261 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:02.948931 29254 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:02.990463 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:02.991422 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70787us
I20260709 13:08:03.028944 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:02.932746 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:03.029951 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97334us
I20260709 13:08:02.997548 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:02.998340 26681 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:03.000612 26686 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:03.000590 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64508.9us
I20260709 13:08:02.940269 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:02.958326 28946 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.005179 28728 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.005422 29113 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.005515 29273 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:02.953143 29309 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:08:02.980549 28689 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:02.956995 29306 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.089020 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.006881 29429 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:02.995936 29218 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:03.007946 29395 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:03.096027 29395 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.095712 29137 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.096457 29395 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.983745 29346 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:08:03.100695 29254 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.093389 29113 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.102576 29254 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:03.102691 29113 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:03.103286 29113 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.009845 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:03.104979 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 95205.9us
I20260709 13:08:02.938436 29121 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.106473 27319 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:03.107802 29121 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.012714 26755 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:03.108075 29303 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.033982 29406 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.109120 29425 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:03.109867 29425 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:03.013235 26757 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:03.110038 29461 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:03.110373 29425 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.110898 29425 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.111124 29465 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.112285 26757 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:03.016347 26754 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:03.113415 26757 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.089162 29402 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:03.017262 26683 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:08:03.110176 26755 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:03.018077 26607 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:03.019557 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.116276 26758 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:03.116641 26678 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:03.020933 29266 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.015252 29418 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.998068 29405 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:03.027405 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44210us
I20260709 13:08:02.999821 29455 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.030459 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.040376 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:03.060254 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.062819 26687 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:03.016911 27315 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:03.093343 26682 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:03.094166 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.093683 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.095549 27314 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.015554 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.124558 26686 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:03.024552 29448 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:03.128484 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 99603.3us
I20260709 13:08:03.295303 26683 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:03.245323 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 231970us
I20260709 13:08:03.295966 29455 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.296553 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:08:03.297138 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 256821us
I20260709 13:08:03.297228 29402 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.297487 29303 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:03.297887 29402 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.298091 29303 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.298842 29402 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.299059 29303 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.126340 29397 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.150549 28728 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 13:08:03.301604 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.284217 29406 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:03.302680 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:03.303036 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.303391 26607 raft_consensus.cc:606] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:03.304668 29406 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.306123 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.307552 29406 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:03.175377 26678 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:03.310352 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.151583 29266 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.093144 29396 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.312183 29429 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.312314 29396 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.308513 26682 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:03.327201 26680 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:03.309262 29397 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.329967 27312 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:03.330191 26680 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.148859 27286 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:03.331140 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 182376us
W20260709 13:08:03.332212 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.332357 26680 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:03.172967 28946 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.315358 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.334020 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.334326 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.334575 26680 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:03.335829 29345 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:03.336476 29345 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.336513 28946 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:03.337126 28946 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:03.337212 29345 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.337508 28946 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.337594 26680 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.176862 29262 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.338819 29262 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.317380 29406 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.164474 29465 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.340045 29465 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:03.231575 29464 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:03.322050 29418 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.295887 26683 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:03.327198 26685 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.344280 29310 raft_consensus.cc:2764] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:08:03.344784 29462 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.336s	user 0.000s	sys 0.002s
I20260709 13:08:03.344964 26683 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.345489 26685 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:03.327348 29296 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.303385 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.316545 29266 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:03.316707 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 286267us
W20260709 13:08:03.348867 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45584.5us
I20260709 13:08:03.352397 29406 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:03.352344 29296 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.353783 29406 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.346438 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:03.361127 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.362560 26685 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:03.363605 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.352083 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:03.330747 29448 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.329355 29396 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.349201 29310 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:03.372857 26685 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.365702 29414 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:03.384759 26685 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:03.409529 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57550.8us
I20260709 13:08:03.418172 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:03.423135 26685 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.432369 26685 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:03.409196 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48150.8us
I20260709 13:08:03.433925 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.409737 29148 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.377599 29306 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:03.442054 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 127011us
I20260709 13:08:03.429411 29218 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.385524 29414 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.449975 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.447831 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.437232 29403 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:03.490514 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 187535us
I20260709 13:08:03.433292 26685 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.447261 29254 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.470012 26684 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:03.454133 29218 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.441406 29406 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.461711 29148 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.389154 29448 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:03.408126 29441 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:03.490557 29396 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:03.448565 29121 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:03.471689 29296 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:03.492148 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 156235us
I20260709 13:08:03.493328 26685 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.448297 29416 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:08:03.458912 29414 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:03.492121 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44372.3us
I20260709 13:08:03.567368 26685 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:03.569801 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.494537 29218 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.493048 29305 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.454228 28728 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:08:03.586908 26759 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.587428 29305 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:03.588249 29392 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:08:03.589202 29398 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.589251 29218 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.562346 29309 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:03.591933 29218 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.592273 29397 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:03.592715 29397 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:03.593523 29397 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.594717 29397 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:03.507864 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.497946 29383 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.496361 29403 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:03.502540 29470 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:03.518450 28946 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:03.607151 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.522672 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:03.524874 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 80154us
I20260709 13:08:03.608757 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.608911 28946 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:03.609589 28946 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:03.609624 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.610196 28946 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.526153 29306 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.611326 29403 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.557685 29418 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.612598 29306 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.613068 29306 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.614306 29418 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.533054 28689 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.541980 29395 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:03.548642 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50944us
I20260709 13:08:03.505862 29396 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.548728 29473 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.553299 29425 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.557648 29404 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:03.560209 29405 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.560580 29465 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.561013 29416 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:03.575209 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:03.622377 26752 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:03.576113 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:03.577044 29476 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:03.578171 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:03.580138 29121 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.520653 29148 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.613888 29306 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.551610 29310 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:03.611541 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:03.619388 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 177493us
I20260709 13:08:03.624742 26756 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:03.626099 29416 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:03.633718 29416 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.634176 29410 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:03.634717 29410 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:03.634925 29416 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:03.629160 29310 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:03.635994 29121 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.636588 29310 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.637444 29121 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.637912 29310 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:03.639170 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:03.639454 29396 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:03.639597 29254 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.640081 29254 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.640924 29254 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.641577 29425 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.642059 29254 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.643445 29423 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:03.643356 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:03.643920 29423 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.644136 27317 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:03.640097 28946 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.644788 29423 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.645139 29266 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.645964 29423 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:03.646447 29266 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.646961 29266 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.648084 29395 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.648682 28689 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:03.648797 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:03.649159 28689 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.649236 28728 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.649545 28689 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.649814 28728 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.649915 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.650964 28728 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.651856 29472 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:03.652279 29303 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:03.668493 29472 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:03.668756 29303 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.668965 29472 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.669768 29303 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.672370 28728 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.643313 29262 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:08:03.673346 29262 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.673779 29262 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:03.674746 29262 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.677130 29405 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.619352 29404 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.677434 29262 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.680899 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:03.681106 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.677569 29405 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:03.683519 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.683997 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.683467 29405 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.685791 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.686426 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.657789 29266 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.658986 26680 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:03.689249 26609 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:03.689600 26609 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:03.690327 26609 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.691174 26609 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.655552 29402 raft_consensus.cc:993] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:08:03.660960 29455 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:03.665915 29113 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.656697 29336 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:03.620792 29467 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:08:03.666947 29273 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.711099 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:03.668047 26754 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:03.652694 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:03.712875 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 60253.4us
I20260709 13:08:03.714130 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.714891 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.715040 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:03.654768 29428 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.679978 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.715551 26756 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.687512 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:03.659520 29410 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.684559 26610 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:03.699515 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:03.702039 26683 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:03.702828 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153787us
I20260709 13:08:03.704859 26605 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:03.722963 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:03.705313 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 199884us
I20260709 13:08:03.724776 26650 leader_election.cc:400] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7.
I20260709 13:08:03.711702 26608 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.726550 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.726974 26650 leader_election.cc:403] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:03.725281 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.730182 29346 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7.
I20260709 13:08:03.720455 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:03.702639 29465 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.732764 26758 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
W20260709 13:08:03.708582 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127713us
I20260709 13:08:03.739172 26680 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:03.739718 26682 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:03.725772 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.750238 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.751399 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.751968 26682 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:03.753444 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.742934 26609 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:03.743808 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.744086 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.744185 29455 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.722787 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:03.762485 26755 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.762593 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.711989 29223 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.756810 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:03.757016 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:03.718432 29402 raft_consensus.cc:1081] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:08:03.757551 26686 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:03.755113 29465 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.759007 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:03.787951 26687 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:03.790797 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:03.718946 29428 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:03.760722 26757 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:03.726954 29395 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.793263 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:03.770213 26683 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:03.771070 29441 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:03.718173 29273 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.733249 29113 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:08:03.764385 29346 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.764581 29410 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:03.787194 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:03.800983 26680 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:03.804236 26608 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:03.814620 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:03.761322 26682 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:03.841048 26687 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.755406 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:03.819283 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.820997 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:03.678309 29404 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.774643 29477 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.822140 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:03.872473 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53313.4us
I20260709 13:08:03.878726 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.825537 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:03.880000 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57923.1us
I20260709 13:08:03.880669 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.852212 26576 leader_election.cc:400] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
W20260709 13:08:03.824034 29401 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:08:03.874588 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 241721us
W20260709 13:08:03.876165 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 169196us
W20260709 13:08:03.887710 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.882372 26576 leader_election.cc:403] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:03.883219 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 61262.8us
I20260709 13:08:03.881711 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.888356 26687 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:03.886314 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.764915 29472 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:03.894418 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 50164.8us
I20260709 13:08:03.899260 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.890087 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.902899 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.904733 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:03.884697 27312 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:03.909067 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:03.911062 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:03.817842 29414 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.876924 29346 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:03.816779 29223 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:03.880803 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:03.888875 29480 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.910609 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:03.884192 29148 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.880241 29429 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.908747 29218 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.914327 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.872080 29402 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:03.875768 29403 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:08:03.914995 29306 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:03.905472 29396 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.927289 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:03.912933 27319 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:03.907821 29113 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.905651 29424 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:03.884137 29425 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:03.925379 27313 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:03.912269 29404 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:03.912974 29345 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.905802 29483 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 4. Current term is 5.
W20260709 13:08:03.925633 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.923434 29137 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:03.947381 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:03.925683 29266 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:03.928620 29480 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.909720 29428 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:03.930195 29305 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:03.964350 29113 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.931890 29310 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.924319 29482 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.929553 29406 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:08:03.978821 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67849us
I20260709 13:08:03.938784 29218 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:03.982678 26755 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:03.949520 29396 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.964540 29494 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.994330 27316 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 5 LEARNER]: Advancing to term 7
I20260709 13:08:04.000852 29223 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:04.000541 29346 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:04.002036 29484 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:04.002938 29491 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:04.003845 29273 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:04.005290 29465 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:04.006605 26756 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
W20260709 13:08:03.955437 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.013064 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:03.976306 29266 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.005787 29113 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.005692 29472 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:03.984076 29480 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:04.034845 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99903.7us
I20260709 13:08:04.088660 27316 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 7 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:04.089192 29218 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:04.090634 29303 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:04.091017 29303 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:04.091800 29303 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.092609 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.093149 29303 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:04.094872 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.099741 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:04.100111 26684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:08:04.100015 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.100788 26684 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:08:04.038959 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.530s (SENT) [suppressed 28 similar messages]
I20260709 13:08:04.019510 29310 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:04.099339 26608 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:04.100916 26610 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:04.101909 29310 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.102800 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.104590 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.106385 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.108305 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.109097 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1081) took 1326 ms. Trace:
I20260709 13:08:04.109441 26761 rpcz_store.cc:276] 0709 13:08:02.782932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.788431 (+  5499us) service_pool.cc:224] Handling call
0709 13:08:04.108940 (+1320509us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400139054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:04.109042 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369238400}
I20260709 13:08:04.110569 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.110839 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.111570 26604 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:04.112015 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.112319 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.113183 26609 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:04.113344 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:04.085095 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72123.3us
I20260709 13:08:04.114297 26605 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.083827 29482 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.115504 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.115868 29418 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:04.115926 29482 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.116427 29418 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:04.117475 29418 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.118348 29482 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:04.118796 29418 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.086196 29483 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.119432 29483 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.120008 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.120750 26603 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:04.087096 29406 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:04.100457 26687 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.083791 29305 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:04.005924 29254 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:08:04.124398 29305 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.126673 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.129478 29309 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:04.130429 29488 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.196s	user 0.004s	sys 0.004s
I20260709 13:08:04.123303 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:04.109550 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.006099 29306 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:04.113593 26604 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:04.023382 29396 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.192523 26687 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:04.192963 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:04.193030 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:04.206336 26686 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:04.194208 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.206854 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:04.208240 26761 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:04.201689 26611 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
W20260709 13:08:04.202636 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79414.5us
I20260709 13:08:04.204737 26682 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:04.101173 26684 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:04.214401 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 287161us
I20260709 13:08:04.217655 26755 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.220070 26755 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:04.218714 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.245863 26606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:04.246698 26606 raft_consensus.cc:606] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.247007 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:04.248546 26756 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:04.249475 26682 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:04.254690 26759 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:04.073530 29266 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.257210 26755 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:04.131718 29273 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:04.259490 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124371us
I20260709 13:08:04.266484 26759 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:04.026117 29477 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.186s
I20260709 13:08:04.262746 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.265050 26608 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:04.269861 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:04.265777 26754 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:04.215034 29423 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.023s
I20260709 13:08:04.259980 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:04.267462 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.259490 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:04.142139 29406 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:04.195307 29306 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.273213 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:04.275188 29414 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:04.277527 26758 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:04.247756 29309 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.212618 29483 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:04.292097 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 377825us
I20260709 13:08:04.202484 29148 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:04.268173 29429 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:04.311558 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44153.3us
I20260709 13:08:04.321753 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.266258 29273 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.305786 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 266839us
I20260709 13:08:04.322110 26754 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:08:04.332799 27284 leader_election.cc:336] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.571s (SENT)
I20260709 13:08:04.342021 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:04.310900 29306 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:04.371189 29506 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:04.378799 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.364427 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:04.381680 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 188991us
I20260709 13:08:04.391968 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.334676 27316 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:04.337086 29476 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.339628 29273 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:04.395483 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.396504 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.410699 26605 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:04.411814 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.413101 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.413985 26605 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:04.362658 29397 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:04.415207 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.364024 29345 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:04.364651 29500 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.340600 29309 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:04.419888 26605 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:08:04.400141 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 137470us
I20260709 13:08:04.420143 29416 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:04.420821 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.428428 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:04.400183 29398 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.383736 29508 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.428969 26603 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:04.434041 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.394204 29429 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:08:04.451848 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.428643 29137 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:04.472458 29416 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:04.492501 29137 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:04.469914 29496 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:04.544015 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.550266 29223 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:04.550827 29223 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:04.550588 29137 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.551230 29223 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:04.552000 29137 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.544554 29395 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:04.554745 29395 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.545496 29523 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:04.445832 29507 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:08:04.558748 28689 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.909s	user 0.008s	sys 0.000s
I20260709 13:08:04.444571 29406 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.568118 29416 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.450091 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:04.572249 29480 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:04.573401 29410 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.002s
I20260709 13:08:04.573467 26681 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:04.575079 27312 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:04.578998 29404 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 13:08:04.579698 29309 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.559157 28689 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.581591 26753 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:04.484288 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 100848us
I20260709 13:08:04.585450 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:04.587250 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.588824 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:04.617398 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:04.600198 26684 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.621593 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:04.429461 29500 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.626580 26686 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:04.644573 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 216221us
I20260709 13:08:04.627236 26687 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:04.548259 29505 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:04.679936 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 93251.4us
I20260709 13:08:04.684355 26684 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:04.686950 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.607803 27314 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:04.624089 29483 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:04.693197 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.639279 29121 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:04.623910 29404 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.707288 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:04.695694 26687 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:04.700085 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:08:04.708582 26757 raft_consensus.cc:606] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:04.709031 26757 raft_consensus.cc:614] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.710659 26754 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:04.644337 29510 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:04.671193 29303 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:04.684063 28689 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:04.723484 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:04.717906 29406 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.701424 29523 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:04.708575 29121 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.712724 29418 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.004s
I20260709 13:08:04.696226 29345 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:04.708030 29476 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.696660 29505 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:04.741779 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 420803us
W20260709 13:08:04.742422 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 153653us
I20260709 13:08:04.735127 29406 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.754206 29406 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:04.727687 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.755131 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.719311 29483 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:04.756398 29483 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.762017 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:04.763157 29418 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:04.763634 29418 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:04.764101 29418 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.780545 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:04.781705 29448 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:04.782325 29448 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:04.783382 29448 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.690239 29502 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:04.683559 29516 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 13:08:04.747264 29113 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.003s
W20260709 13:08:04.814843 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 91410.6us
I20260709 13:08:04.719223 29404 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.735498 29522 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.749946 29507 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:04.803718 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:04.744972 29121 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.689390 29518 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:08:04.728772 29303 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.805205 26680 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.832376 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:04.806484 29397 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:04.818856 29406 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.738540 29309 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:08:04.806809 29502 consensus_queue.cc:1243] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:04.806556 29527 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:04.800109 29523 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:04.898445 29455 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.129s	user 0.019s	sys 0.000s
I20260709 13:08:04.824468 29113 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.894829 27316 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:04.797988 29476 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:04.866168 29507 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:04.956003 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.971694 29524 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:08:04.972827 29530 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:08:04.975189 29529 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:04.976468 29397 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:04.964118 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 131806us
W20260709 13:08:04.918548 29509 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:08:04.923897 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:04.895237 29418 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:04.977092 29397 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.001832 26759 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:05.069023 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.978184 29410 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.085011 26678 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:05.044930 26612 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:04.915201 29406 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.050740 26607 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:05.046736 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:05.047274 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:05.098001 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:04.952527 29455 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:05.099392 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:05.113991 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:04.978909 29396 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
W20260709 13:08:04.977103 29515 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:08:05.115371 26605 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:04.977875 29538 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:05.103018 26606 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:05.125751 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:04.956630 29480 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.126282 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:05.139639 26609 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:05.143976 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:05.144418 29534 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.144853 29546 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.145360 29546 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.126217 29396 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.150249 29396 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.150906 26685 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:05.145157 29534 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.151307 26605 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
W20260709 13:08:05.153203 29528 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:08:05.147571 29546 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.156600 29546 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.154829 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:04.941148 29505 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.157181 27316 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:08:05.116382 29306 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.015s
I20260709 13:08:05.155853 29507 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.115172 29500 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:05.167351 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.100510 29346 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:05.158768 29534 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:04.962126 29345 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.169715 27314 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:05.185645 29310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.002s	sys 0.028s
I20260709 13:08:05.192826 29548 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:05.196537 29346 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:05.174279 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.112936 29410 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.176962 29480 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:05.207041 29310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.028s
W20260709 13:08:05.206607 29223 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.001s
W20260709 13:08:05.218983 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133848us
I20260709 13:08:05.201992 29309 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.199031 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 376) took 1485 ms. Trace:
I20260709 13:08:05.176152 29306 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.207768 29396 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.223337 27319 pending_rounds.cc:85] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 5
I20260709 13:08:05.213801 29551 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.165872 29523 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.264891 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:05.222077 29404 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:05.240849 29273 consensus_meta.cc:287] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.004s
I20260709 13:08:05.238401 29303 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:05.265054 27319 pending_rounds.cc:107] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:05.210199 29548 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.214802 29546 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.232854 29223 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.231554 29480 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.279742 29113 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:05.286356 27319 raft_consensus.cc:2889] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.234491 29309 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.282234 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:05.280293 29542 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.268968 29552 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:05.272483 29551 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.230862 27315 rpcz_store.cc:276] 0709 13:08:03.714054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.732688 (+ 18634us) service_pool.cc:224] Handling call
0709 13:08:03.783950 (+ 51262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.910546 (+126596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.913007 (+  2461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.967027 (+ 54020us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.314336 (+347309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:04.333516 (+ 19180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.333646 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.170839 (+837193us) raft_consensus.cc:1685] finished
0709 13:08:05.172957 (+  2118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.189506 (+ 16549us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":705,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":2432,"thread_start_us":404297,"threads_started":2,"wal-append.queue_time_us":467141}
I20260709 13:08:05.306350 29531 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:05.304787 29508 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.253134 29533 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:05.266048 29396 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.337733 26756 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:05.300426 29476 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.314204 27312 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:05.336048 29416 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.309900 29543 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260709 13:08:05.350939 29481 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.466s	user 0.008s	sys 0.000s
W20260709 13:08:05.312808 29137 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.001s
I20260709 13:08:05.352064 29406 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:05.353600 29401 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.285295 29273 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.360641 26680 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:05.308909 29554 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:05.308264 29549 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.355881 29542 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.309777 29555 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:08:05.328878 29548 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:05.462133 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.003s	sys 0.010s
I20260709 13:08:05.480386 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:05.517649 26761 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:05.353608 29510 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:05.498507 26610 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:08:05.490926 29416 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.361174 29552 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:05.500093 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:05.500761 29401 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.507771 26755 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:05.510931 29526 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:05.513055 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:05.495996 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.516393 29223 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:05.516703 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:05.368328 29531 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:05.528571 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.729533 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1148) took 1635 ms. Trace:
I20260709 13:08:05.729985 26681 rpcz_store.cc:276] 0709 13:08:04.094121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.094235 (+   114us) service_pool.cc:224] Handling call
0709 13:08:04.094507 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.574028 (+479521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.729286 (+1155258us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400187c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:05.729475 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101112576}
I20260709 13:08:05.731866 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:05.736397 26681 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:05.738466 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:05.376585 29508 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.744354 26681 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:05.740447 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:05.745644 29508 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:05.741928 29346 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.515606 29549 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.748220 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:05.749055 29549 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:05.752326 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:05.758898 29346 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:05.759311 26681 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:05.763453 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:05.767068 26681 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:08:05.710896 29266 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.438s	user 0.013s	sys 0.000s
W20260709 13:08:05.585350 29121 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.003s
I20260709 13:08:05.522511 29510 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:05.749872 26760 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:08:05.518554 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.010s
I20260709 13:08:05.650410 29424 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.691929 28728 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:05.817857 29428 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:05.816570 29566 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:08:05.816751 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.582360 29306 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:05.693254 29273 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:05.512014 29554 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.816602 29405 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:05.546986 26761 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:05.820824 29121 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.828152 28728 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:05.550066 29556 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.531s
I20260709 13:08:05.787837 29345 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:05.816368 29266 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.874963 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:05.919196 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44313.5us
I20260709 13:08:05.838080 29542 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.869601 29560 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:05.918478 26605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.021s	sys 0.034s
I20260709 13:08:05.920202 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:05.924183 26605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.021s	sys 0.035s
I20260709 13:08:05.923084 26757 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:05.940091 26758 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:08:05.940514 26758 pending_rounds.cc:85] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:08:05.940768 26758 pending_rounds.cc:107] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:05.941288 26758 raft_consensus.cc:2889] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.940699 26761 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:05.918606 29113 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.955427 26760 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:05.993010 26754 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:05.918025 29508 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:05.993964 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:05.919894 29522 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:05.923384 29425 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:05.996345 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1155) took 1744 ms. Trace:
I20260709 13:08:06.000813 29522 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.001260 26682 rpcz_store.cc:276] 0709 13:08:04.252130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.252247 (+   117us) service_pool.cc:224] Handling call
0709 13:08:04.256543 (+  4296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.261237 (+  4694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.261268 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.312364 (+1051096us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:05.312726 (+   362us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.481066 (+168340us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:05.481128 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.482844 (+  1716us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.955601 (+472757us) raft_consensus.cc:1685] finished
0709 13:08:05.955626 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.996265 (+ 40639us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4341,"raft.queue_time_us":4450,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6102,"spinlock_wait_cycles":131012480,"thread_start_us":167913,"threads_started":1,"wal-append.queue_time_us":247193}
I20260709 13:08:06.003505 26682 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:05.830403 29424 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:05.927793 29480 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.011240 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:05.939894 29310 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.951016 29531 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:05.955832 29535 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.956132 29563 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.028241 28689 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:05.994347 29346 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:06.015457 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:05.875281 29345 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:05.999640 29546 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:05.943078 29560 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:06.012712 29557 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:08:06.072216 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:06.054025 29571 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:08:06.042850 29572 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:08:06.053488 29567 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:08:06.014621 29306 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:06.053306 29570 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:05.999769 29113 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.015717 29494 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:06.026206 29522 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.029353 29505 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:06.122594 27284 leader_election.cc:336] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.530s (SENT)
I20260709 13:08:06.122695 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.136190 26682 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:06.072585 29425 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:06.127441 29565 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:08:06.031636 29310 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.127866 29554 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.081233 29346 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.131227 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.012379 28728 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.152524 29121 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.080353 29563 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.154894 29425 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.133867 29560 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.012025 29508 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.160156 29306 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.140668 29505 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:06.187332 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 255) took 2488 ms (client timeout 1565 ms). Trace:
I20260709 13:08:06.178086 29556 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:08:06.188081 26753 rpcz_store.cc:269] 0709 13:08:03.699174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.699284 (+   110us) service_pool.cc:224] Handling call
0709 13:08:06.187104 (+2487820us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540014ebd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:06.187259 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987902848}
I20260709 13:08:06.040212 29535 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.124496 29546 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.139914 29494 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.123311 29555 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.208246 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.239401 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.249985 29546 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.268043 26681 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:06.182392 29522 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.256352 29555 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:06.292454 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.294754 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1141) took 2202 ms. Trace:
I20260709 13:08:06.300426 29522 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:06.318706 29537 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.273s	user 0.002s	sys 0.010s
I20260709 13:08:06.321743 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1357) took 2600 ms. Trace:
I20260709 13:08:06.322156 26752 rpcz_store.cc:276] 0709 13:08:03.721165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.721314 (+   149us) service_pool.cc:224] Handling call
0709 13:08:03.749685 (+ 28371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.258998 (+509313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.259025 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:05.813505 (+1554480us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b2c0008c4d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:05.814234 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:08:06.027802 (+213568us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.027933 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.321361 (+293428us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400226354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.321408 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.321449 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:06.321462 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.321676 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3733,"raft.queue_time_us":88101,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12020,"spinlock_wait_cycles":443504896,"thread_start_us":490007,"threads_started":2,"wal-append.queue_time_us":316962}
I20260709 13:08:06.327132 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:06.330627 26684 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:06.331458 29545 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.154s	user 0.005s	sys 0.009s
W20260709 13:08:06.331856 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.334720 29492 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:06.335281 29492 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:06.336351 29492 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.349948 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:06.349890 26685 rpcz_store.cc:276] 0709 13:08:04.092084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.203380 (+111296us) service_pool.cc:224] Handling call
0709 13:08:04.203813 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.151321 (+947508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.294444 (+1143123us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54000140d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.294675 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177578240}
I20260709 13:08:06.350625 26687 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.351153 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.351717 26685 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:06.352483 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.353462 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.358595 29423 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.358800 29506 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:06.359293 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1160) took 1672 ms. Trace:
I20260709 13:08:06.359339 29423 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.359730 26678 rpcz_store.cc:276] 0709 13:08:04.687248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.726560 (+ 39312us) service_pool.cc:224] Handling call
0709 13:08:04.732297 (+  5737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.085465 (+353168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.359052 (+1273587us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003c1754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.359218 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691831168}
I20260709 13:08:06.359380 29506 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.364274 29336 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.364815 29336 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.365195 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1101) took 2136 ms. Trace:
I20260709 13:08:06.365568 26759 rpcz_store.cc:276] 0709 13:08:04.228536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.273792 (+ 45256us) service_pool.cc:224] Handling call
0709 13:08:04.274055 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.098938 (+824883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.364963 (+1266025us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540010fed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.365141 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673175296}
I20260709 13:08:06.359501 29472 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.366791 29336 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.366923 29472 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.367332 29336 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.375032 29402 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.405421 29336 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.408530 29223 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.409163 29223 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.412160 29403 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:06.412671 29403 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:06.413687 29403 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:06.417876 29485 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 2.529s	user 0.005s	sys 0.014s
I20260709 13:08:06.417903 29416 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.420665 29273 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:06.376199 29501 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:06.374127 29534 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.378741 29507 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.414918 29403 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.374334 29552 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.422960 29507 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.424062 29418 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.368943 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2375) took 1139 ms. Trace:
I20260709 13:08:06.428447 29551 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.428617 26608 rpcz_store.cc:276] 0709 13:08:05.229081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.229199 (+   118us) service_pool.cc:224] Handling call
0709 13:08:05.264408 (+ 35209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.521270 (+256862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.521316 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.521805 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.874763 (+352958us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:05.874798 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.368446 (+493648us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400064d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.368523 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.368586 (+    63us) raft_consensus.cc:1685] finished
0709 13:08:06.368606 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.368877 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1618,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3043,"spinlock_wait_cycles":589608192,"thread_start_us":295193,"threads_started":1,"wal-append.queue_time_us":512050}
I20260709 13:08:06.384145 29218 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.373005 28689 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:06.370522 29401 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.430305 28689 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.394727 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:06.393519 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 381) took 1335 ms. Trace:
I20260709 13:08:06.396313 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:06.435565 29483 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:06.436074 29483 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.436496 29483 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.382153 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:06.437947 26610 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.389732 29397 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.385062 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2374) took 1156 ms. Trace:
I20260709 13:08:06.441856 26605 rpcz_store.cc:276] 0709 13:08:05.228617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.228783 (+   166us) service_pool.cc:224] Handling call
0709 13:08:05.229154 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.306996 (+ 77842us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:05.367025 (+ 60029us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.924821 (+557796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.924888 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:05.924946 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.341152 (+416206us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b18000ee0c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1
0709 13:08:06.341824 (+   672us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18000ee0c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:06.384767 (+ 42943us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b5400100ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.384834 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.384982 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":687769,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":16045,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":13394,"spinlock_wait_cycles":196030976,"thread_start_us":616965,"threads_started":2,"wal-append.queue_time_us":636893}
I20260709 13:08:06.399356 29466 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.400040 28946 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.444528 28946 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.432906 29218 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.446918 28946 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.447013 29396 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.388015 29514 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.447965 29514 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.362078 29309 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.369053 29560 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.450596 29560 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:06.373692 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.396126 29148 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.452499 29148 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.453917 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2395) took 1177 ms. Trace:
I20260709 13:08:06.444473 29466 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.454507 26680 rpcz_store.cc:276] 0709 13:08:05.276491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.276645 (+   154us) service_pool.cc:224] Handling call
0709 13:08:05.276911 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.502467 (+225556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.453515 (+951048us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54001252d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.453820 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180022656}
I20260709 13:08:06.456703 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1150) took 2362 ms. Trace:
I20260709 13:08:06.457192 26679 rpcz_store.cc:276] 0709 13:08:04.094671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.102295 (+  7624us) service_pool.cc:224] Handling call
0709 13:08:04.102632 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.242194 (+139562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.242224 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:05.313669 (+1071445us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:05.314214 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.479812 (+165598us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:05.502477 (+ 22665us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.510725 (+  8248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.456304 (+945579us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5400187754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.456374 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.456429 (+    55us) raft_consensus.cc:1685] finished
0709 13:08:06.456448 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.456635 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48935,"prepare.queue_time_us":22130,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":62544,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8524,"spinlock_wait_cycles":226840064,"thread_start_us":165175,"threads_started":1,"wal-append.queue_time_us":505897}
I20260709 13:08:06.407433 26681 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:06.460479 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2403) took 1178 ms. Trace:
I20260709 13:08:06.460928 26681 rpcz_store.cc:276] 0709 13:08:05.283434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.406692 (+1123258us) service_pool.cc:224] Handling call
0709 13:08:06.407027 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.460159 (+ 53132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.460413 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.464473 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1363) took 1823 ms. Trace:
I20260709 13:08:06.464968 26756 rpcz_store.cc:276] 0709 13:08:04.641564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.671486 (+ 29922us) service_pool.cc:224] Handling call
0709 13:08:04.700738 (+ 29252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.368835 (+668097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.464193 (+1095358us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540014fad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:06.464400 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464533888}
I20260709 13:08:06.472437 29395 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.472966 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2405) took 1189 ms. Trace:
I20260709 13:08:06.473480 26680 rpcz_store.cc:276] 0709 13:08:05.283991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.471919 (+1187928us) service_pool.cc:224] Handling call
0709 13:08:06.472319 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.472554 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.472591 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.472648 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.472699 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.472768 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.472898 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.476333 29492 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.477674 26679 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:06.479163 26679 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:06.481593 29429 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.481709 29554 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.482352 29429 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.483621 29561 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.482498 29554 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.484265 29561 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.488111 29309 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.489781 29396 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.490417 29396 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.492616 29397 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.492942 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:06.493219 29397 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.493971 29401 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:06.516090 26755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.002s
W20260709 13:08:06.516752 26755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.006s	sys 0.002s
I20260709 13:08:06.524281 29502 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.525046 29502 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.529711 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:06.530472 26607 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:06.530834 26607 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:06.531956 26607 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.533097 26607 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.534408 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1158) took 1889 ms. Trace:
I20260709 13:08:06.354019 26685 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:06.542205 26685 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:06.543141 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:06.488729 29309 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.546809 29576 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.547412 29555 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.547614 29576 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.549146 29476 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:06.549368 29546 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.405426 29402 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:06.549758 29476 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.552932 29345 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.431434 27319 rpcz_store.cc:276] 0709 13:08:05.058212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.084267 (+ 26055us) service_pool.cc:224] Handling call
0709 13:08:05.202817 (+118550us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:05.425313 (+222496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.482124 (+ 56811us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:05.520725 (+ 38601us) log.cc:844] Serialized 78 byte log entry
0709 13:08:05.745585 (+224860us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:06.000285 (+254700us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.159982 (+159697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.177393 (+ 17411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.392008 (+214615us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b540052fba0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3205dbe 00007f40f3210930 00007f40f32108d8 00007f40f3210858 00007f40f3210813 00007f40f320fa9c 00007f40f90fb626 00007f40f90f5dd8 00007f40f324c7cb 00007f40f324f2c0
0709 13:08:06.393129 (+  1121us) raft_consensus.cc:1685] finished
0709 13:08:06.393253 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.393451 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":325696,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4703,"raft.queue_time_us":142546,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":62133,"spinlock_wait_cycles":6491520,"thread_start_us":584139,"threads_started":3,"wal-append.queue_time_us":297571}
I20260709 13:08:06.555898 29423 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.556448 29346 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.557053 29306 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.557103 29418 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.557690 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.549431 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1152) took 2355 ms. Trace:
I20260709 13:08:06.558362 29466 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.535010 26686 rpcz_store.cc:276] 0709 13:08:04.645200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.658797 (+ 13597us) service_pool.cc:224] Handling call
0709 13:08:04.659221 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.691492 (+ 32271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.692841 (+  1349us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.693402 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 13:08:04.752710 (+ 59308us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:04.753477 (+   767us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.533697 (+1780220us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800332d40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:08:06.533857 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.533957 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.534014 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:06.534148 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.534332 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46493,"prepare.queue_time_us":250,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":36,"raft.queue_time_us":171786,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16887,"spinlock_wait_cycles":24473856,"thread_start_us":113007,"threads_started":2,"wal-append.queue_time_us":132570,"wal-append.run_cpu_time_us":3909,"wal-append.run_wall_time_us":1649122}
I20260709 13:08:06.560570 29494 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.561434 29396 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:06.561857 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 161426us
I20260709 13:08:06.563133 29502 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.565093 29554 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.422199 29501 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:06.547775 29534 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:06.560657 29223 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:06.565716 29510 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 13:08:06.566154 29560 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.566571 29522 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.572768 29561 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.573132 29113 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.573825 29410 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.575007 29506 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.568174 26687 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:06.573465 29266 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:06.578708 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.577138 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:06.580615 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.577977 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.588625 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:06.590348 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:06.597958 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 105112us
I20260709 13:08:06.681030 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:06.601121 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.612047 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.612385 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:06.618806 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 218119us
I20260709 13:08:06.686450 27318 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 5: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:06.630947 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2404) took 1347 ms. Trace:
I20260709 13:08:06.634559 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.688199 26681 rpcz_store.cc:276] 0709 13:08:05.283745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.461851 (+1178106us) service_pool.cc:224] Handling call
0709 13:08:06.462302 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.477745 (+ 15443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.477776 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.478487 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.630613 (+152126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.630652 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.630719 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.630758 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:06.630770 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.630887 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12678,"raft.queue_time_us":12785,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":151761,"threads_started":1,"wal-append.queue_time_us":150339}
I20260709 13:08:06.689680 26756 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:06.635177 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.690989 26760 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:06.642277 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.637235 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:07.086047 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.086226 26686 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:07.087257 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:06.794073 27284 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.692s (SENT)
W20260709 13:08:06.592056 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.042s	sys 0.054s
W20260709 13:08:07.088922 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.049s	sys 0.078s
W20260709 13:08:07.089059 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 295035us
I20260709 13:08:07.089443 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:06.637673 26753 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:06.637687 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.629221 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.675594 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.659646 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.572400 29551 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.520s
I20260709 13:08:06.868676 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.622305 26679 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:06.610217 27320 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:07.096345 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.706907 28689 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:06.639912 26607 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:07.092619 26687 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:06.711098 26610 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:06.646685 29254 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.445s
I20260709 13:08:06.610997 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.637995 26684 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:06.635821 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.993023 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:06.939744 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.922175 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 249061us
I20260709 13:08:06.636724 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.982699 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:06.636415 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:07.097051 26679 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:07.084717 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 403728us
W20260709 13:08:06.913523 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 254775us
I20260709 13:08:07.092712 26758 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:07.090634 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:07.099582 26612 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:06.612572 26683 rpcz_store.cc:276] 0709 13:08:04.193806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.193921 (+   115us) service_pool.cc:224] Handling call
0709 13:08:04.194244 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.241845 (+ 47601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.241876 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.348024 (+2106148us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:06.348515 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.548972 (+200457us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:06.549010 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.549104 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.549152 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:06.549166 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.549374 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47237,"raft.queue_time_us":65690,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4367,"spinlock_wait_cycles":180927232,"thread_start_us":200026,"threads_started":1,"wal-append.queue_time_us":198315}
I20260709 13:08:06.843590 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:07.091333 26605 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:06.738420 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:07.102403 27284 leader_election.cc:336] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.604s (SENT)
I20260709 13:08:06.958613 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:07.103014 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.576045 29428 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.005s
I20260709 13:08:07.263659 26506 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 5, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.266067 26506 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 2 to 6, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.262795 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:07.268417 29483 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.831s	user 0.009s	sys 0.004s
I20260709 13:08:07.268545 27320 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:07.268841 29483 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:07.270124 27320 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:07.270650 29254 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.271327 29483 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:07.271876 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2408) took 1263 ms. Trace:
I20260709 13:08:07.272254 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:07.104372 29410 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:07.273507 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.599541 27313 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:07.263091 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.274453 26604 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:07.274765 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:07.275050 29395 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.275300 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.275496 26757 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:07.275544 29395 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:07.276419 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.276543 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:07.277426 26757 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:07.277755 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.278216 29395 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:07.278486 26604 raft_consensus.cc:2410] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:07.267495 28689 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:07.272900 26753 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:07.279383 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.280011 26604 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 4.
I20260709 13:08:07.280862 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:06.601766 29514 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.612958 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.586306 29309 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.593091 29336 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:07.281430 26753 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:07.268872 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.282207 29395 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:07.273824 29410 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:07.285027 27319 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 4: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:07.282569 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 439073us
I20260709 13:08:06.994593 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:06.659816 29516 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.624s
I20260709 13:08:07.090938 26761 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:07.283653 26685 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:07.284027 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:07.263774 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:07.061268 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:07.350850 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 241913us
I20260709 13:08:07.422326 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.319379 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:07.653533 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1357) took 1118 ms. Trace:
W20260709 13:08:08.221071 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2390) took 1638 ms (client timeout 1887 ms). Trace:
W20260709 13:08:08.221320 27284 leader_election.cc:336] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.806s (SENT)
W20260709 13:08:07.340592 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54736.7us
I20260709 13:08:08.222014 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:08.221846 26610 rpcz_store.cc:269] 0709 13:08:06.582434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.319050 (+736616us) service_pool.cc:224] Handling call
0709 13:08:08.220977 (+901927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.222987 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:08.223311 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1382) took 1586 ms (client timeout 1883 ms). Trace:
I20260709 13:08:07.456103 26756 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:08.223917 26761 rpcz_store.cc:269] 0709 13:08:06.637297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.637399 (+   102us) service_pool.cc:224] Handling call
0709 13:08:08.223251 (+1585852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.225255 26607 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:08.225386 26653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.011s
I20260709 13:08:07.285450 26604 raft_consensus.cc:2368] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
I20260709 13:08:07.412775 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:07.422806 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:08.225915 27318 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:08.226989 27320 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:08.226588 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1374) took 1623 ms. Trace:
I20260709 13:08:07.498934 27321 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:06.890666 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.227751 26604 rpcz_store.cc:276] 0709 13:08:06.603328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.280631 (+677303us) service_pool.cc:224] Handling call
0709 13:08:08.226535 (+945904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.228523 26611 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:07.345309 29514 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.887s
I20260709 13:08:08.228840 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:07.078004 29583 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:08:08.229277 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1375) took 1625 ms (client timeout 1516 ms). Trace:
I20260709 13:08:06.667542 29534 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.599731 27312 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:06.601008 27317 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:08.230062 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.230373 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 385) took 1631 ms. Trace:
I20260709 13:08:07.413357 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.231261 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1169) took 1674 ms. Trace:
I20260709 13:08:07.290093 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.231317 26605 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
W20260709 13:08:08.232528 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 942482us
W20260709 13:08:08.225742 26607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2388) took 1643 ms (client timeout 1870 ms). Trace:
W20260709 13:08:08.225914 26653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.011s
W20260709 13:08:07.053864 29596 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
W20260709 13:08:08.289776 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.218839 29591 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.517s	user 0.000s	sys 0.000s
I20260709 13:08:07.346309 26759 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:08.277683 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.605973 29476 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:08.273365 27318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 374) took 1617 ms (client timeout 1789 ms). Trace:
I20260709 13:08:08.227763 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1379) took 1591 ms. Trace:
W20260709 13:08:08.229758 26611 rpcz_store.cc:269] 0709 13:08:06.603560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.677333 (+ 73773us) service_pool.cc:224] Handling call
0709 13:08:08.229157 (+1551824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.231791 26679 rpcz_store.cc:276] 0709 13:08:06.556690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.096529 (+539839us) service_pool.cc:224] Handling call
0709 13:08:07.096776 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.231024 (+1134248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.231210 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:06.620064 29405 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.744s	user 0.021s	sys 0.021s
W20260709 13:08:08.299611 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1380) took 1663 ms (client timeout 1842 ms). Trace:
W20260709 13:08:08.270615 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1170) took 1668 ms (client timeout 1667 ms). Trace:
W20260709 13:08:08.314218 26759 rpcz_store.cc:269] 0709 13:08:06.636388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.636494 (+   106us) service_pool.cc:224] Handling call
0709 13:08:08.299517 (+1663023us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:08.314416 26685 rpcz_store.cc:269] 0709 13:08:06.556970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.610764 (+ 53794us) service_pool.cc:224] Handling call
0709 13:08:08.225437 (+1614673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.315507 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:08.316284 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93369.5us
W20260709 13:08:06.868512 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.794111 26507 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 216) took 28401 ms (client timeout 15000 ms). Trace:
I20260709 13:08:06.593298 29148 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:07.461401 29403 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.038s	user 0.013s	sys 0.000s
I20260709 13:08:07.572932 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.569828 29310 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:07.412655 29395 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:06.642910 29273 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.232836 26606 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:08.331460 26678 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:08:08.331759 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1368) took 1729 ms (client timeout 1558 ms). Trace:
I20260709 13:08:06.593926 29218 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.298707 27320 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:07.501192 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:08.333268 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1370) took 1731 ms (client timeout 1842 ms). Trace:
I20260709 13:08:07.341585 29346 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.567886 29429 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.613031 29402 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.669317 29401 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:06.890255 29526 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:08.349869 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:08.299736 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1361) took 1708 ms (client timeout 1578 ms). Trace:
W20260709 13:08:08.361259 26603 rpcz_store.cc:269] 0709 13:08:06.591458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.685533 (+ 94075us) service_pool.cc:224] Handling call
0709 13:08:08.299632 (+1614099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:07.651929 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:08.221135 26612 rpcz_store.cc:276] 0709 13:08:06.535255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.535403 (+   148us) service_pool.cc:224] Handling call
0709 13:08:07.099307 (+563904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.355524 (+256217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.653239 (+297715us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400065c50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:07.653446 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295789824}
I20260709 13:08:08.291038 27314 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
W20260709 13:08:08.364707 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 319359us
I20260709 13:08:07.272277 26684 rpcz_store.cc:276] 0709 13:08:06.008537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.326871 (+318334us) service_pool.cc:224] Handling call
0709 13:08:07.271822 (+944951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:07.456740 26683 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:08.292645 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1394) took 1018 ms. Trace:
W20260709 13:08:08.298868 26607 rpcz_store.cc:269] 0709 13:08:06.581854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.283806 (+701952us) service_pool.cc:224] Handling call
0709 13:08:08.225688 (+941882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.598320 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.227157 26760 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:06.644157 29499 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 1.649s
I20260709 13:08:06.959316 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.233379 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:07.422413 26506 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.345872 29546 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.663314 29492 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 1.628s
I20260709 13:08:07.572602 29410 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.385684 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.343223 29310 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.389145 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.230849 27312 rpcz_store.cc:276] 0709 13:08:06.599048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.599170 (+   122us) service_pool.cc:224] Handling call
0709 13:08:06.599488 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.230123 (+1630635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.230318 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:07.093158 29554 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.589414 29424 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:08.231415 29551 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.309937 27318 rpcz_store.cc:269] 0709 13:08:06.610306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.853611 (+243305us) service_pool.cc:224] Handling call
0709 13:08:08.227502 (+1373891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.589349 29508 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:08.332185 26606 rpcz_store.cc:269] 0709 13:08:06.601849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.685200 (+ 83351us) service_pool.cc:224] Handling call
0709 13:08:08.331576 (+1646376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:07.355751 29536 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:06.585501 29563 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:08.333388 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:06.588949 28728 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.572276 29505 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:08.333789 26608 rpcz_store.cc:269] 0709 13:08:06.602350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.340235 (+737885us) service_pool.cc:224] Handling call
0709 13:08:08.333215 (+992980us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:07.494488 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.403738 26682 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:08:08.234452 29598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.017s	sys 0.012s
I20260709 13:08:06.666090 29501 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.607693 29576 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:06.642614 29523 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.096133 29396 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.689800 29121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.000s	sys 0.035s
I20260709 13:08:06.891091 29482 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:06.637919 29383 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.691639 29425 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.266454 29605 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:07.501713 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.402108 29508 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:06.565977 29507 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:06.586796 29397 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:07.093255 29506 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:08.342001 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 249) took 1589 ms. Trace:
I20260709 13:08:08.366741 29402 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:08:07.355707 29345 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.645696 29503 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 1.685s
I20260709 13:08:08.230926 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 386) took 1630 ms. Trace:
I20260709 13:08:08.343930 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.359395 26685 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:08.343981 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2402) took 3064 ms. Trace:
I20260709 13:08:06.567323 29535 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:08.300541 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.362788 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.300309 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.364209 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1359) took 1773 ms. Trace:
I20260709 13:08:08.311896 26752 rpcz_store.cc:276] 0709 13:08:06.636093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.636207 (+   114us) service_pool.cc:224] Handling call
0709 13:08:08.227708 (+1591501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.868244 29561 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 1.486s
I20260709 13:08:06.687325 29510 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.382790 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:08.384820 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 151543us
I20260709 13:08:08.385007 26684 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:08.439174 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 251) took 1562 ms. Trace:
I20260709 13:08:07.104176 29266 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 1.245s
I20260709 13:08:08.411789 29505 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:08.385810 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1176) took 1827 ms. Trace:
I20260709 13:08:08.339097 29562 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.386199 26753 rpcz_store.cc:276] 0709 13:08:07.274466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.280832 (+  6366us) service_pool.cc:224] Handling call
0709 13:08:07.281106 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.292273 (+1011167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.292566 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.387135 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1386) took 1114 ms. Trace:
I20260709 13:08:07.275772 29556 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.395090 26506 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 5 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:08:08.349468 26494 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.013s
I20260709 13:08:08.362375 29218 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:08.349650 29429 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.400324 26606 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:08:08.400550 27320 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 5: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:08.455039 26609 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:08.397543 29536 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:08.387302 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 388) took 1783 ms. Trace:
I20260709 13:08:08.460227 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.344095 29405 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:08.410526 26682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 247) took 1658 ms (client timeout 1667 ms). Trace:
W20260709 13:08:08.406180 29598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.018s	sys 0.013s
I20260709 13:08:08.352636 29346 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:08.453460 26494 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.007s	sys 0.015s
I20260709 13:08:08.436605 29576 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:08:08.473387 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.475046 26603 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:08.476058 29613 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:08.476809 28728 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:08.477689 29601 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.477807 28728 consensus_queue.cc:1243] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:08.478356 29601 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.435061 29345 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.400401 29309 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.398589 29410 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:08.415831 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2386) took 1834 ms. Trace:
I20260709 13:08:06.608785 29418 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:08.419015 26652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.021s
W20260709 13:08:08.485528 26652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.021s
I20260709 13:08:08.391440 29546 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.424705 26679 rpcz_store.cc:276] 0709 13:08:06.752400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.310370 (+1557970us) service_pool.cc:224] Handling call
0709 13:08:08.341541 (+ 31171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.341707 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.341729 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.341768 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:08.341798 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.341849 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.341952 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.633451 29472 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:08.425269 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:08.413827 29121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.738s	user 0.015s	sys 0.036s
I20260709 13:08:08.397717 29502 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:08:08.413260 29501 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:08:08.366133 29526 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:08.426939 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.33626e+06us
I20260709 13:08:08.398054 29310 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.499262 29526 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:08.413880 27315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 383) took 1814 ms (client timeout 1667 ms). Trace:
I20260709 13:08:08.431800 26678 rpcz_store.cc:276] 0709 13:08:05.279132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.360717 (+1081585us) service_pool.cc:224] Handling call
0709 13:08:06.361054 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.331881 (+1970827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.343767 (+ 11886us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54001eaad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:08.343928 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4528055680}
I20260709 13:08:08.416370 29383 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.347260 29273 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.431326 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 250) took 1555 ms. Trace:
I20260709 13:08:08.505874 26685 rpcz_store.cc:276] 0709 13:08:06.876238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.315597 (+1439359us) service_pool.cc:224] Handling call
0709 13:08:08.340065 (+ 24468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.431088 (+ 91023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.431273 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.483372 29309 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.418330 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.434511 27321 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:08.402936 29551 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.418037 29482 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:08.439507 26684 rpcz_store.cc:276] 0709 13:08:06.876524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.384337 (+1507813us) service_pool.cc:224] Handling call
0709 13:08:08.384658 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.438958 (+ 54300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.439127 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:08.321616 26507 rpcz_store.cc:269] 0709 13:07:39.332567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.332915 (+   348us) service_pool.cc:224] Handling call
0709 13:08:07.733641 (+28400726us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:02.460539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:02.509548 (+ 49009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:02.509594 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:08:02.509611 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:02.604037 (+ 94426us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:02.632526 (+ 28489us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:02.639714 (+  7188us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:02.877479 (+237765us) tablet.cc:701] Row locks acquired
0709 13:08:02.877528 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:08:02.877702 (+   174us) write_op.cc:270] Start()
0709 13:08:02.877846 (+   144us) write_op.cc:276] Timestamp: P: 1783602482877630 usec, L: 0
0709 13:08:02.877864 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:02.881980 (+  4116us) log.cc:844] Serialized 5863 byte log entry
0709 13:08:03.744273 (+862293us) op_driver.cc:464] REPLICATION: finished
0709 13:08:04.130378 (+386105us) write_op.cc:301] APPLY: starting
0709 13:08:04.130492 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:04.130757 (+   265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:04.130879 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:04.542365 (+411486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:04.568264 (+ 25899us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:08:04.568317 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:04.568665 (+   348us) log.cc:844] Serialized 101 byte log entry
0709 13:08:04.568836 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:04.568969 (+   133us) write_op.cc:454] Released schema lock
0709 13:08:04.569018 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:04.569433 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:04.569462 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":27143,"mutex_wait_us":2893,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":281067,"apply.run_cpu_time_us":5435,"apply.run_wall_time_us":497818,"num_ops":14,"prepare.queue_time_us":276954,"prepare.run_cpu_time_us":8250,"prepare.run_wall_time_us":464909,"raft.queue_time_us":386246,"raft.run_cpu_time_us":29630,"raft.run_wall_time_us":180846,"replication_time_us":866240,"thread_start_us":638087,"threads_started":4,"wal-append.queue_time_us":126636,"wal-append.run_cpu_time_us":25348,"wal-append.run_wall_time_us":2561907}]]}
W20260709 13:08:08.444002 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.445957 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.447717 26683 rpcz_store.cc:276] 0709 13:08:06.558556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.456108 (+897552us) service_pool.cc:224] Handling call
0709 13:08:07.456356 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.385478 (+929122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.385742 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.511243 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:08.511283 26610 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:08.464560 29429 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.460621 27314 rpcz_store.cc:276] 0709 13:08:06.601431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.868378 (+266947us) service_pool.cc:224] Handling call
0709 13:08:08.385235 (+1516857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.449402 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:08.450299 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 228999us
W20260709 13:08:08.514966 27284 leader_election.cc:336] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.086s (SENT)
I20260709 13:08:08.515386 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:08.403128 29554 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.450356 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.516376 27316 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:08.516536 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66246us
I20260709 13:08:08.515556 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.414813 29523 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.452917 26612 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:08:08.519058 27284 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.709s (SENT)
I20260709 13:08:08.426494 27313 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:08.456784 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2385) took 1875 ms. Trace:
I20260709 13:08:08.521461 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.520674 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2387) took 1939 ms. Trace:
I20260709 13:08:08.418325 29425 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.416684 29396 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:08.451841 26506 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: config changed from index 2 to 4, term changed from 2 to 3, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to <none>, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:08.462132 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2379) took 2081 ms. Trace:
I20260709 13:08:08.419768 29605 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.411921 29395 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:08.463124 26682 rpcz_store.cc:269] 0709 13:08:06.751766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.891477 (+139711us) service_pool.cc:224] Handling call
0709 13:08:08.410299 (+1518822us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54001e91d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:08.410447 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43852032}
I20260709 13:08:08.451494 29401 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:08:08.446410 29534 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:08:08.413971 26757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.010s	sys 0.018s
I20260709 13:08:08.480301 26604 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
W20260709 13:08:08.529232 26757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.010s	sys 0.018s
I20260709 13:08:08.475603 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2391) took 1892 ms. Trace:
I20260709 13:08:08.483647 26608 rpcz_store.cc:276] 0709 13:08:06.581238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.402501 (+1821263us) service_pool.cc:224] Handling call
0709 13:08:08.415274 (+ 12773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.415445 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.415475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.415516 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:08.415557 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.415625 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.415772 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.487121 29536 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:08.543959 27285 leader_election.cc:336] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.565s (SENT)
I20260709 13:08:08.488933 26607 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:08.496053 26681 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:08.496852 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:08.464223 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:08.462958 29405 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.434888 26611 rpcz_store.cc:276] 0709 13:08:06.590815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.322781 (+1731966us) service_pool.cc:224] Handling call
0709 13:08:08.364146 (+ 41365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.499699 29310 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:08.433463 27317 rpcz_store.cc:276] 0709 13:08:06.600429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.600556 (+   127us) service_pool.cc:224] Handling call
0709 13:08:06.600832 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.230628 (+1629796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.230870 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.508260 26754 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:08.484951 29598 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:08.448354 26760 rpcz_store.cc:276] 0709 13:08:07.272248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.341430 (+ 69182us) service_pool.cc:224] Handling call
0709 13:08:08.387079 (+1045649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.512835 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.577801 26605 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:08.578471 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1360) took 1987 ms. Trace:
W20260709 13:08:08.578471 26681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 246) took 2008 ms (client timeout 1897 ms). Trace:
I20260709 13:08:08.578897 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.517930 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.579821 27320 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:08.580113 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1173) took 2022 ms. Trace:
W20260709 13:08:08.580224 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62360.6us
I20260709 13:08:08.516337 29410 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.519872 26680 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:08:08.584259 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87489.9us
I20260709 13:08:08.521839 29611 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:08.585024 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:08.454370 29562 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:08.521791 26606 rpcz_store.cc:276] 0709 13:08:06.580958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.397277 (+1816319us) service_pool.cc:224] Handling call
0709 13:08:08.400103 (+  2826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.456516 (+ 56413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.456731 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.522104 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.590315 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:08.590878 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68841us
W20260709 13:08:08.591868 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 303249us
I20260709 13:08:08.592167 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.593892 29424 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.522130 27321 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:08.524860 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:08.523561 26686 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.595122 26753 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.595341 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.597193 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:08.598299 29576 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:08.525218 27284 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.994s (SENT)
I20260709 13:08:08.599481 29576 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:08.599987 29576 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:08.600224 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75029.7us
I20260709 13:08:08.600478 29576 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.510597 29309 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.603152 29492 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.603888 29609 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.522142 26612 rpcz_store.cc:276] 0709 13:08:06.581542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.452305 (+1870763us) service_pool.cc:224] Handling call
0709 13:08:08.452594 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.520417 (+ 67823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.520620 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.605881 29609 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:08.606426 29609 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:08.607013 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1366) took 2005 ms. Trace:
I20260709 13:08:08.524950 26609 rpcz_store.cc:276] 0709 13:08:06.381087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.382586 (+  1499us) service_pool.cc:224] Handling call
0709 13:08:06.382949 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.455381 (+2072432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.461921 (+  6540us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400065754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:08.462076 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4764950400}
I20260709 13:08:08.536791 26603 rpcz_store.cc:276] 0709 13:08:06.701348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.474425 (+1773077us) service_pool.cc:224] Handling call
0709 13:08:08.474726 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.475381 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.475552 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.548996 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.520292 29472 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.566386 26506 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 3 to 6, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:08.501603 27315 rpcz_store.cc:269] 0709 13:08:06.597900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.598027 (+   127us) service_pool.cc:224] Handling call
0709 13:08:08.412131 (+1814104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.522848 29526 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.521613 29508 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:08.579228 26681 rpcz_store.cc:269] 0709 13:08:06.570089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.689798 (+119709us) service_pool.cc:224] Handling call
0709 13:08:08.578300 (+1888502us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001257d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:08.578407 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616616704}
I20260709 13:08:08.580590 26687 rpcz_store.cc:276] 0709 13:08:06.557794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.098180 (+540386us) service_pool.cc:224] Handling call
0709 13:08:07.098463 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.495874 (+1397411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.495908 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.495954 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:08.495994 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.579914 (+ 83920us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001db854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:08.579962 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.580065 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213307136}
I20260709 13:08:08.578823 26605 rpcz_store.cc:276] 0709 13:08:06.591144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.527714 (+1936570us) service_pool.cc:224] Handling call
0709 13:08:08.577462 (+ 49748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.578237 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.578419 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.587778 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.589129 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.521461 29612 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.594446 29424 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.601377 29218 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.626650 29310 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:08.641940 29526 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:08.642468 29526 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.643208 29310 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.643781 29424 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.645439 27320 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:08.646227 29612 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.649217 29612 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.648983 26506 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 3 to 5, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.620263 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:08.672299 26756 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:08.608016 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:08.673928 26605 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:08.595114 26610 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.570843 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 383) took 1143 ms. Trace:
I20260709 13:08:08.675735 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2394) took 1255 ms. Trace:
I20260709 13:08:08.527618 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 379) took 1168 ms. Trace:
I20260709 13:08:08.607398 26612 rpcz_store.cc:276] 0709 13:08:06.601363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.606248 (+2004885us) service_pool.cc:224] Handling call
0709 13:08:08.606539 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.606717 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.606739 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.606779 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.606819 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.606868 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.606963 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:08.673844 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65885.7us
W20260709 13:08:08.634186 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.659276 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1376) took 2015 ms. Trace:
I20260709 13:08:08.680510 26606 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:08.719435 26606 pending_rounds.cc:85] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:08:08.719823 26606 pending_rounds.cc:107] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:08.720175 26606 raft_consensus.cc:2889] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.585255 29536 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:08.667652 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 386) took 1020 ms. Trace:
I20260709 13:08:08.721097 27318 rpcz_store.cc:276] 0709 13:08:07.647721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.404529 (+756808us) service_pool.cc:224] Handling call
0709 13:08:08.404883 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.405201 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.405229 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.405698 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.667156 (+261458us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.667213 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.667294 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.667371 (+    77us) raft_consensus.cc:1685] finished
0709 13:08:08.667388 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.667578 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97062,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":260735,"threads_started":1,"wal-append.queue_time_us":250811}
I20260709 13:08:08.590554 29535 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.585840 29598 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:08.750581 27313 rpcz_store.cc:276] 0709 13:08:07.357987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.411673 (+ 53686us) service_pool.cc:224] Handling call
0709 13:08:08.526040 (+1114367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.716732 26753 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:08.727329 26605 rpcz_store.cc:276] 0709 13:08:07.420197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.659911 (+1239714us) service_pool.cc:224] Handling call
0709 13:08:08.673505 (+ 13594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.674549 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.675639 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.696378 26686 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:08.582943 29405 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.730535 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1365) took 2129 ms. Trace:
I20260709 13:08:08.753054 26606 rpcz_store.cc:276] 0709 13:08:06.601146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.659791 (+2058645us) service_pool.cc:224] Handling call
0709 13:08:08.668140 (+  8349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.730307 (+ 62167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.730478 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:08.741861 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.742597 29561 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:08.753993 26608 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:08.754752 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1362) took 2163 ms. Trace:
I20260709 13:08:08.755149 26608 rpcz_store.cc:276] 0709 13:08:06.600389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.659653 (+2059264us) service_pool.cc:224] Handling call
0709 13:08:08.724303 (+ 64650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.754435 (+ 30132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.754684 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.722975 26609 rpcz_store.cc:276] 0709 13:08:06.643642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.658376 (+2014734us) service_pool.cc:224] Handling call
0709 13:08:08.658673 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.658871 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.658909 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.658985 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:08.659036 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.659105 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.659219 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.765049 26610 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:08.766893 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.767194 29492 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.767539 26679 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
I20260709 13:08:08.770067 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.773351 26679 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:08.774940 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 187252us
I20260709 13:08:08.775880 26687 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:08.670614 29610 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:08.778097 26682 raft_consensus.cc:1217] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Deduplicated request from leader. Original: 7.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:08:08.778774 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.782125 26682 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:08:08.784308 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 158037us
I20260709 13:08:08.786574 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.790694 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:08.791137 26683 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:08.791513 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:08.787317 26506 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:08.784408 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 352743us
I20260709 13:08:08.729803 29516 consensus_queue.cc:1243] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:08.718915 29472 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:08.531342 29482 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.758358 29535 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:08.666913 29563 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:08.804584 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 485773us
I20260709 13:08:08.757454 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:08.805464 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:08.801077 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 368655us
I20260709 13:08:08.719606 29619 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:08.806867 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.809091 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.804654 26506 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:08.830108 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.847790 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.799998 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.863566 26685 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:08.675091 29507 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
W20260709 13:08:08.843858 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.659502 29410 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:08.781803 29610 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.845636 26683 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:08:08.845604 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 248) took 2093 ms (client timeout 1648 ms). Trace:
I20260709 13:08:08.839843 29418 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.837074 29254 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:08:08.786206 29510 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.718390 27319 rpcz_store.cc:276] 0709 13:08:07.422475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.402277 (+979802us) service_pool.cc:224] Handling call
0709 13:08:08.566089 (+163812us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:08.872424 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.811954 29611 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:08.752995 29309 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:08.861534 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54750.9us
W20260709 13:08:08.858085 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 267800us
I20260709 13:08:08.867785 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:08.838105 29505 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.863062 26687 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:08.836946 29612 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.847455 29619 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:08.868151 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:08.918175 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50106us
I20260709 13:08:08.918921 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:08.919346 26686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1175) took 2361 ms (client timeout 1988 ms). Trace:
W20260709 13:08:08.919770 26686 rpcz_store.cc:269] 0709 13:08:06.558326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.087029 (+528703us) service_pool.cc:224] Handling call
0709 13:08:08.919175 (+1832146us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003052d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:08.919263 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3301680384}
I20260709 13:08:08.911736 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1392) took 1637 ms. Trace:
I20260709 13:08:08.845774 29535 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.880788 29383 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.884104 29273 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:08.887709 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.887081 26506 catalog_manager.cc:5697] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 3, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 3 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.782107 29621 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:08:08.888357 29345 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:08.846388 29508 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:08.788837 29561 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:08.900738 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.911080 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.872413 29346 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:08.607575 29609 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:08.912791 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:09.007953 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:08.913856 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 46172.6us
I20260709 13:08:08.910388 29505 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.881309 29610 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:08.925064 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:08.945756 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:08.921239 26757 rpcz_store.cc:276] 0709 13:08:07.273970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.277888 (+  3918us) service_pool.cc:224] Handling call
0709 13:08:07.278144 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.278362 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:08.529732 (+1251370us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.910939 (+381207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.911401 (+   462us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.911448 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.911514 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.911651 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22376,"prepare.queue_time_us":1211449,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":85588,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1500,"spinlock_wait_cycles":6398336,"thread_start_us":1625242,"threads_started":3,"wal-append.queue_time_us":306904}
I20260709 13:08:08.950417 26683 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:08.911949 29612 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:08.913959 29628 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:08.956765 27316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 387) took 2318 ms (client timeout 1798 ms). Trace:
I20260709 13:08:08.957510 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:08.958828 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:08.956344 26506 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 4, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:08.896354 29611 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:09.004994 27285 leader_election.cc:336] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.897s (SENT)
I20260709 13:08:08.904719 27312 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:08.874959 26680 rpcz_store.cc:269] 0709 13:08:06.752112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.868419 (+116307us) service_pool.cc:224] Handling call
0709 13:08:08.845366 (+1976947us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400013bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:08.845506 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3279069056}
I20260709 13:08:08.956149 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:08.910809 29472 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:09.095338 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 90596.9us
W20260709 13:08:09.097790 27285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.735s (SENT) [suppressed 33 similar messages]
W20260709 13:08:09.092499 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 167548us
W20260709 13:08:09.092224 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 179502us
I20260709 13:08:09.097541 26506 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 2 to 7, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.023048 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:08.944650 29607 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.104743 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:08.944856 29619 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.108507 26506 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.101513 26686 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:08:09.102620 27316 rpcz_store.cc:269] 0709 13:08:06.600768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.600877 (+   109us) service_pool.cc:224] Handling call
0709 13:08:08.918660 (+2317783us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400642dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:08.918767 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4218005248}
I20260709 13:08:09.098831 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:09.099519 26687 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:09.022886 29630 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:08:09.004076 29554 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:09.020871 29505 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.118531 29266 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:09.113381 29273 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:08:08.856746 29598 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:09.127214 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:09.156668 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57888.3us
W20260709 13:08:09.221566 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.217909 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 301319us
I20260709 13:08:09.007684 29634 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:09.024670 29425 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.120414 29514 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:09.103694 29612 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.097184 29507 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:09.217849 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1388) took 1945 ms (client timeout 1572 ms). Trace:
I20260709 13:08:09.099982 29611 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.110788 29628 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:09.238755 26687 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:09.176827 26506 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 3 to 6, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.179632 29616 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:09.213497 29629 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:08:09.268497 26754 rpcz_store.cc:269] 0709 13:08:07.272850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.353228 (+ 80378us) service_pool.cc:224] Handling call
0709 13:08:09.217645 (+1864417us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:09.217775 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332537216}
W20260709 13:08:09.255208 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.270941 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 352071us
I20260709 13:08:09.108244 29472 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:09.024313 29346 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.255884 29514 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.228742 29601 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.248032 29634 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.295358 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:09.319391 26650 leader_election.cc:400] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
I20260709 13:08:09.320092 26650 leader_election.cc:403] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.278312 29598 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.258247 29637 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:09.279532 29605 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.301044 29514 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.283182 29616 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:09.282874 29562 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.300887 29607 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.253050 29647 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:09.246701 29508 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:09.344442 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 217332us
I20260709 13:08:09.339062 29425 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.323382 29637 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.325525 29634 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.337766 29554 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6.
I20260709 13:08:09.341845 29266 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.343386 29309 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.348753 29616 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.359938 29410 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:09.375555 29633 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:08:09.346793 29605 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:08:09.378146 29526 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.004s
I20260709 13:08:09.366015 29425 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:09.374941 29637 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.362675 29607 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:09.397138 29561 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.350736 29627 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:08:09.425436 27311 tablet_service.cc:1558] Processing DeleteTablet for tablet 272d473e821e4c15a9f3fa0471adfdc6 with delete_type TABLET_DATA_TOMBSTONED (TS 77c617823f2e4a938ef247a8924e299b not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:54848
I20260709 13:08:09.414742 29526 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:09.428669 29472 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:09.434399 29536 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.002s
I20260709 13:08:09.435338 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:09.444800 26506 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.449904 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:09.449904 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.408790 29266 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
W20260709 13:08:09.487885 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 163248us
I20260709 13:08:09.542116 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.660422 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:09.506074 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 52811.9us
I20260709 13:08:09.563289 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.661682 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:09.539542 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 295094us
W20260709 13:08:09.487150 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.652570 27316 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:09.663195 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.414577 29425 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:09.448156 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.670940 26685 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:09.680979 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.007s	sys 0.011s
I20260709 13:08:09.678295 26680 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:09.678658 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:09.681341 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.007s	sys 0.011s
W20260709 13:08:09.681805 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 809702us
W20260709 13:08:09.589207 29576 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.001s
W20260709 13:08:09.481882 29424 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.001s
W20260709 13:08:09.565137 29626 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:08:09.673789 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:09.624297 27313 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.010s
W20260709 13:08:09.650748 29653 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:08:09.688366 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:09.718236 26604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1371) took 3115 ms (client timeout 3065 ms). Trace:
W20260709 13:08:09.718731 26604 rpcz_store.cc:269] 0709 13:08:06.602619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.229800 (+1627181us) service_pool.cc:224] Handling call
0709 13:08:09.718046 (+1488246us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:09.718160 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573775104}
I20260709 13:08:09.691594 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.696300 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.539419 29516 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.696878 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.694576 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:09.669848 29647 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.705895 26685 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:09.675496 29607 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:09.706027 27313 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.012s
W20260709 13:08:09.812184 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 117669us
I20260709 13:08:09.722210 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.724260 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.686023 29605 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:09.725183 26679 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:09.752434 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:09.814299 26608 raft_consensus.cc:2376] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8. Re-sending same reply.
W20260709 13:08:09.817418 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 88469.2us
I20260709 13:08:09.821157 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.822247 26686 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:09.823117 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:09.454128 29503 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.269s
I20260709 13:08:09.723269 29536 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:09.969594 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76325us
I20260709 13:08:09.878850 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.854749 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.859328 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.968894 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.972195 26686 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:09.972292 26679 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:09.970985 26685 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:09.725335 29561 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:09.704878 29576 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:09.816825 29605 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.853762 29672 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.014678 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:09.721446 29424 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.075699 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:10.018476 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.728004 29621 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.254s
W20260709 13:08:10.118862 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.856707 29526 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:09.983027 29561 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.124197 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:09.740110 29516 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.148705 26681 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:10.153760 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:10.157430 26680 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:09.854677 29618 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.273s
I20260709 13:08:10.168697 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1398) took 1245 ms. Trace:
I20260709 13:08:10.169961 26684 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:10.015434 29503 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.166038 29662 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.312s	user 0.000s	sys 0.000s
I20260709 13:08:10.166473 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:10.166663 29121 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:10.175920 29121 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:10.176856 26680 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:08:10.177199 29656 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 13:08:10.166745 29661 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.443s	user 0.000s	sys 0.000s
I20260709 13:08:10.176729 29121 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.169226 26753 rpcz_store.cc:276] 0709 13:08:08.923139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.925658 (+  2519us) service_pool.cc:224] Handling call
0709 13:08:08.926132 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.003643 (+ 77511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.003694 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.008599 (+  4905us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.272029 (+263430us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:09.272073 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.272145 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.163026 (+890881us) raft_consensus.cc:1685] finished
0709 13:08:10.163054 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.168613 (+  5559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77852,"raft.queue_time_us":97780,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":15176,"thread_start_us":115502,"threads_started":1,"wal-append.queue_time_us":254655}
I20260709 13:08:10.166479 29546 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.203419 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:10.144134 29672 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.208629 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1191) took 1421 ms. Trace:
I20260709 13:08:10.209195 26683 rpcz_store.cc:276] 0709 13:08:08.787351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.020964 (+233613us) service_pool.cc:224] Handling call
0709 13:08:09.097569 (+ 76605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.097899 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.097926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.120579 (+ 22653us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.274606 (+154027us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:09.274643 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.274706 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.208334 (+933628us) raft_consensus.cc:1685] finished
0709 13:08:10.208365 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.208551 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58239,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":45937,"thread_start_us":60123,"threads_started":1,"wal-append.queue_time_us":466128}
I20260709 13:08:09.970343 29617 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.190s
I20260709 13:08:09.982606 29613 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 13:08:10.019822 29501 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:08:10.160890 29561 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:10.225533 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.228264 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.232863 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:10.236250 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:09.856472 29635 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:10.265362 26755 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:10.265512 26758 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:10.270174 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.257076 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:10.239292 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 348) took 1397 ms. Trace:
I20260709 13:08:10.050007 29266 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:10.240010 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:10.264878 29514 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.933s	user 0.012s	sys 0.008s
I20260709 13:08:10.268589 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:10.257263 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.288458 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.227113 29605 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:10.211167 29503 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.286813 29396 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.231917 29676 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:10.308096 26754 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:10.274031 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:10.289476 29671 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:08:10.273078 27318 rpcz_store.cc:276] 0709 13:08:08.841501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.842069 (+   568us) service_pool.cc:224] Handling call
0709 13:08:08.846831 (+  4762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.272340 (+425509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.272371 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.274937 (+  2566us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.413021 (+138084us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:09.413057 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.413121 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.239024 (+825903us) raft_consensus.cc:1685] finished
0709 13:08:10.239052 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.239220 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79903,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":562808,"threads_started":2,"wal-append.queue_time_us":335191}
W20260709 13:08:10.290261 29670 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:10.273370 29635 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.328037 29676 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.297869 29536 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.285192 29266 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:10.337598 29672 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.291276 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 392) took 1404 ms. Trace:
I20260709 13:08:10.304539 29514 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:10.352447 29563 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.495s	user 0.011s	sys 0.001s
I20260709 13:08:10.394847 29635 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.539180 29563 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:10.542799 29610 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.442s	user 0.007s	sys 0.007s
W20260709 13:08:10.544019 29666 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
W20260709 13:08:10.545306 29505 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.293s	user 0.006s	sys 0.008s
W20260709 13:08:10.549049 29669 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
W20260709 13:08:10.549226 29667 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:08:10.434711 29536 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.546932 29576 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.552475 29556 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:10.583357 29676 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:10.584872 29692 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:10.585345 29692 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:10.586267 29692 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.560276 29551 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:10.602226 29637 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.150s	user 0.012s	sys 0.004s
I20260709 13:08:10.590035 29536 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.618465 29690 tablet_replica.cc:333] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
W20260709 13:08:10.621867 29616 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.216s	user 0.002s	sys 0.007s
I20260709 13:08:10.622308 29561 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.554557 29610 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.625934 29610 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:10.626427 29619 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.467s	user 0.004s	sys 0.006s
W20260709 13:08:10.629313 29535 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.625s	user 0.011s	sys 0.006s
I20260709 13:08:10.629988 29535 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:10.635281 29611 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.353s	user 0.010s	sys 0.000s
I20260709 13:08:10.627097 29619 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.640937 29611 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.643543 29619 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.634203 29605 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:10.630414 29612 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.354s	user 0.006s	sys 0.003s
I20260709 13:08:10.648754 29612 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:10.638178 29634 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.241s	user 0.006s	sys 0.005s
I20260709 13:08:10.651986 29634 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.654381 29634 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:10.622466 29616 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.644169 29611 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:10.636544 29598 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.307s	user 0.008s	sys 0.003s
I20260709 13:08:10.656898 29616 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.632140 29637 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.661334 29637 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:10.708494 26575 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.013s
W20260709 13:08:10.709561 26575 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.010s	sys 0.013s
W20260709 13:08:10.710225 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 583853us
I20260709 13:08:10.716162 26611 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:10.274443 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.727429 26680 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:08:10.727619 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 255) took 1902 ms. Trace:
I20260709 13:08:10.728288 26687 rpcz_store.cc:276] 0709 13:08:08.825491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.275898 (+450407us) service_pool.cc:224] Handling call
0709 13:08:09.298453 (+ 22555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.298810 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.298835 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.315976 (+ 17141us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.508988 (+193012us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:09.509035 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.509128 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.726843 (+1217715us) raft_consensus.cc:1685] finished
0709 13:08:10.726892 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.727281 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16057,"thread_start_us":158916,"threads_started":1,"wal-append.queue_time_us":398886}
W20260709 13:08:10.730792 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.731487 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.732208 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 428426us
I20260709 13:08:10.738543 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:10.740260 26607 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:10.742640 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:10.743677 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.745697 26607 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:10.748457 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.749171 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.749866 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.749234 26610 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.762169 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:10.768805 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.000s	sys 0.011s
W20260709 13:08:10.771170 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.772464 26752 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:10.773852 26753 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:10.776511 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.433976 29418 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.797644 29634 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:10.800026 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.000s	sys 0.012s
I20260709 13:08:10.797739 29637 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.799432 29676 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:10.569389 29516 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.394219 29266 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:10.817292 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55422.8us
I20260709 13:08:10.829818 29619 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.830708 29619 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:10.831566 26684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 253) took 2048 ms (client timeout 1735 ms). Trace:
I20260709 13:08:10.558460 29505 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:10.832152 26684 rpcz_store.cc:269] 0709 13:08:08.783368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.805148 (+ 21780us) service_pool.cc:224] Handling call
0709 13:08:10.831086 (+2025938us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003c64d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:10.831358 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008508800}
I20260709 13:08:10.833174 29418 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:10.834904 27311 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.002s	sys 0.013s
W20260709 13:08:10.835496 27311 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.002s	sys 0.013s
W20260709 13:08:10.837081 29425 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.145s	user 0.012s	sys 0.003s
W20260709 13:08:10.837518 29405 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 2.085s	user 0.004s	sys 0.011s
I20260709 13:08:10.838020 29405 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.448676 27315 rpcz_store.cc:276] 0709 13:08:08.870900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.873876 (+  2976us) service_pool.cc:224] Handling call
0709 13:08:09.004837 (+130961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.091137 (+ 86300us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:09.319123 (+227986us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.177818 (+858695us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800155620. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf 00007f40f32aa038
0709 13:08:10.208560 (+ 30742us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.222707 (+ 14147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.225040 (+  2333us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:10.237603 (+ 12563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.258240 (+ 20637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.274901 (+ 16661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21450,"prepare.queue_time_us":332360,"prepare.run_wall_time_us":5319,"raft.queue_time_us":14700,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":39651,"spinlock_wait_cycles":265250304,"thread_start_us":241122,"threads_started":2,"wal-append.queue_time_us":662475}
I20260709 13:08:10.841777 29535 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:10.842154 26686 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:10.842321 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.844669 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.837848 29425 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:10.863373 26610 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:10.847682 26760 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:08:10.846169 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.817004 29526 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.846452 27312 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.732s	user 0.013s	sys 0.001s
I20260709 13:08:10.818538 29610 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:08:10.907070 27312 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:10.908169 29418 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:10.908495 29610 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.908902 29636 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:10.909322 29610 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.910480 29688 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:10.911008 29688 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:10.912640 29688 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:10.915952 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.916869 29508 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.917654 29508 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.920229 29503 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.920344 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.921445 26609 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:10.910586 27313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.007s
W20260709 13:08:10.906838 26506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.023s	sys 0.019s
I20260709 13:08:10.845872 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.909765 29636 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:10.925125 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:10.925841 26757 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:10.926167 29636 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.926704 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:10.927659 26757 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:10.928431 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.929965 26757 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 7. Ops: []
I20260709 13:08:10.837169 29561 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.920274 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.545043 29424 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.829845 29563 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:10.921455 29637 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:08:10.951581 26608 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.952109 29505 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:10.935369 27313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.007s
I20260709 13:08:10.953441 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:10.954216 27315 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 4.
W20260709 13:08:10.935928 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.000s	sys 0.020s
I20260709 13:08:10.937268 26606 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:08:10.955762 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.001s	sys 0.020s
I20260709 13:08:10.955631 29526 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.937197 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:10.957207 26605 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:10.958482 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:10.959440 26606 raft_consensus.cc:2376] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9. Re-sending same reply.
I20260709 13:08:10.959722 27318 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:10.960561 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:10.962188 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.962572 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:10.963238 26612 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:10.963299 29535 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.651548 29612 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:10.931393 26506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.024s	sys 0.019s
I20260709 13:08:10.947961 29688 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.968568 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:10.968722 29605 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.969409 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.974538 26755 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:10.974817 29526 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.975433 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.978672 29514 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:10.968621 29405 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.980456 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.981366 26754 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:10.982316 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:10.983019 26754 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:10.980579 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:10.984473 29619 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.984650 29676 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:10.971037 29499 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.985131 29425 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.985203 29676 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:10.986702 29676 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:10.963698 29637 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:10.992642 29637 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.993335 29637 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.960496 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:10.994748 29429 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:10.970973 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:08:10.991652 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.999514 29535 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.000671 29535 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:11.001945 29535 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.003993 29499 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.005213 29610 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:11.005980 29508 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:11.007560 29635 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.011152 26604 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:11.012230 26612 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:11.012950 26754 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:11.013420 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.013839 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.014055 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.014341 26612 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:11.014916 29635 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.015373 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:11.025120 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 60714.1us
I20260709 13:08:11.024700 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.015307 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.026273 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:11.041985 26603 raft_consensus.cc:2376] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9. Re-sending same reply.
I20260709 13:08:11.049649 26758 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:11.063443 26609 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:11.024247 29266 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.064530 26612 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
W20260709 13:08:11.064678 27286 connection.cc:256] RPC call timeout handler was delayed by -1.7785920439999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:08:11.026252 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:11.025689 29510 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:11.065513 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.044118 29563 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:11.025051 29618 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.072618 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.073951 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.075572 26612 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:11.061373 29429 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.071205 29618 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.069041 29510 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.085278 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.086584 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:11.087059 29121 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.087383 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 388) took 2170 ms. Trace:
I20260709 13:08:11.091791 29640 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.083878 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.292212 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1400) took 2347 ms. Trace:
I20260709 13:08:11.111114 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:11.233816 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.389266 26608 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:11.093305 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 67209.1us
I20260709 13:08:11.116291 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:11.326653 26757 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:08:11.106688 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1178) took 2350 ms. Trace:
I20260709 13:08:11.073782 29410 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.410531 26760 rpcz_store.cc:276] 0709 13:08:08.945065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.945523 (+   458us) service_pool.cc:224] Handling call
0709 13:08:08.945884 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.900693 (+1954809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.291863 (+391170us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003f16d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:11.292151 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4372074752}
I20260709 13:08:11.112547 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1396) took 2499 ms. Trace:
I20260709 13:08:11.412979 26755 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:11.322026 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.266633 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.417985 29613 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.421764 29613 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:11.423137 27312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 390) took 2994 ms (client timeout 1696 ms). Trace:
I20260709 13:08:11.423830 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:11.424212 29613 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.425686 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:11.427124 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:11.358708 29667 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.776s	user 0.000s	sys 0.001s
I20260709 13:08:11.413254 26681 rpcz_store.cc:276] 0709 13:08:08.755749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.755863 (+   114us) service_pool.cc:224] Handling call
0709 13:08:08.800504 (+ 44641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.157277 (+1356773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.106088 (+948811us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003138d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:11.106446 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3099970816}
I20260709 13:08:11.412689 26757 pending_rounds.cc:85] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 3
I20260709 13:08:11.419885 27319 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:11.432811 29613 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.423566 27312 rpcz_store.cc:269] 0709 13:08:08.429269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.429841 (+   572us) service_pool.cc:224] Handling call
0709 13:08:11.422891 (+2993050us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:11.423037 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734244736}
I20260709 13:08:11.433566 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:11.433738 29613 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.434242 29612 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.434762 29612 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:11.435173 29612 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.435992 29658 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.291049 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.107211 29403 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:11.415208 26752 rpcz_store.cc:276] 0709 13:08:08.613204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.613413 (+   209us) service_pool.cc:224] Handling call
0709 13:08:08.613811 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.805815 (+2192004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.112243 (+306428us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540014fad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:11.112467 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4962663680}
I20260709 13:08:11.288259 29266 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.105851 29499 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:11.437515 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:11.116179 27285 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.542s (SENT)
I20260709 13:08:11.293849 29628 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:11.432374 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:11.116569 29148 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.365525 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.438405 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.410949 29640 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.413990 29510 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:11.440240 27318 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:11.417006 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.291927 29523 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:11.441026 27320 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.383906 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 347) took 2575 ms. Trace:
I20260709 13:08:11.447420 27321 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.436470 29658 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:11.449499 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.383466 29618 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.432619 26757 pending_rounds.cc:107] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:11.115880 29698 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.457752 26609 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:11.464705 27317 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:11.460960 26756 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:11.471529 26609 pending_rounds.cc:85] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 7
I20260709 13:08:11.472440 26609 pending_rounds.cc:107] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:11.069866 29689 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.390s
I20260709 13:08:11.461545 26612 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:08:11.458789 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 342809us
I20260709 13:08:11.458196 27316 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.459307 29148 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.434177 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:11.443339 29609 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.286445 29429 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.479996 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.463415 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.465608 29679 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.469159 26757 raft_consensus.cc:2889] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.467492 26758 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 4.
I20260709 13:08:11.459894 29410 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.472782 26609 raft_consensus.cc:2889] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.470902 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.472040 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1123) took 1237 ms. Trace:
I20260709 13:08:11.480531 26603 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.470116 29658 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.438714 29403 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.481781 26755 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.483398 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.484265 26756 rpcz_store.cc:276] 0709 13:08:10.234739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.460082 (+1225343us) service_pool.cc:224] Handling call
0709 13:08:11.460452 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.471747 (+ 11295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.471966 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.486243 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.486938 26752 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:11.104794 29563 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:11.488590 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.485986 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.489585 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.478900 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.492336 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.497605 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.502341 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.491904 29266 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.503041 26755 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.491693 29679 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:11.505283 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.506184 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.504448 29628 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.510233 26756 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:11.513055 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.484439 29637 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.518082 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.518863 27318 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:11.519963 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.517449 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.521186 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1126) took 1279 ms. Trace:
I20260709 13:08:11.522432 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.522122 26752 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.527295 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.529336 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.530402 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.521836 26757 rpcz_store.cc:276] 0709 13:08:10.235372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.930853 (+695481us) service_pool.cc:224] Handling call
0709 13:08:10.973384 (+ 42531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.511785 (+538401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.514927 (+  3142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.515283 29628 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.517889 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.521826 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.532779 26758 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.541893 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.542238 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.556767 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.540261 27319 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:11.542868 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.543043 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.510591 29266 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.408558 27314 rpcz_store.cc:276] 0709 13:08:08.917174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.991868 (+2074694us) service_pool.cc:224] Handling call
0709 13:08:10.992438 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.993120 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.993160 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.993754 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.078276 (+ 84522us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.079483 (+  1207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.079589 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.086924 (+  7335us) raft_consensus.cc:1685] finished
0709 13:08:11.086955 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.087140 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":74043,"threads_started":1,"wal-append.queue_time_us":85826}
I20260709 13:08:11.554517 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:11.558809 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.559085 26752 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:11.563681 26603 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:11.566390 26756 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.563001 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:11.565727 26650 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.541s (SENT)
I20260709 13:08:11.570351 26608 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:11.571305 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:11.564085 29618 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.576159 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.579963 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.581487 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.582476 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.583515 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.555414 29403 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.584084 26609 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:11.585162 29403 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.590387 27316 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:11.580120 29429 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:11.588372 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.594753 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.595019 26612 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:11.596504 27320 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:11.592099 26757 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.597921 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.599450 26609 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:11.529127 29679 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.602144 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.605849 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.598785 29687 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.537475 29148 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.605340 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.607635 26607 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:11.607651 26752 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.609051 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.612164 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.611862 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:11.611853 26724 leader_election.cc:336] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.666s (SENT)
I20260709 13:08:11.612959 26608 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:11.619621 29266 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.619999 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.621291 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.622381 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.623569 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.616868 29429 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:11.626024 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 101262us
I20260709 13:08:11.623590 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.576148 29640 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:11.630677 26651 connection.cc:256] RPC call timeout handler was delayed by -1.0422427900000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:08:11.633805 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.634232 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.635396 29345 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:11.636859 26724 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.705s (SENT)
I20260709 13:08:11.637485 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:11.637596 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.634683 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.640887 26607 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:08:11.640837 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 152898us
I20260709 13:08:11.642815 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.644081 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:11.644456 29410 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:11.646996 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:11.647778 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1183) took 2868 ms. Trace:
I20260709 13:08:11.648161 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.649349 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.648125 26678 rpcz_store.cc:276] 0709 13:08:08.764079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.765152 (+  1073us) service_pool.cc:224] Handling call
0709 13:08:08.802523 (+ 37371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.802721 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:08.865574 (+ 62853us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.576710 (+2711136us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b1800332500. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:08:11.600398 (+ 23688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.607103 (+  6705us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:11.623894 (+ 16791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.624011 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.632123 (+  8112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44707,"prepare.queue_time_us":494146,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":83234,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":13090,"spinlock_wait_cycles":18252672,"thread_start_us":233564,"threads_started":3,"wal-append.queue_time_us":249407,"wal-append.run_cpu_time_us":1188,"wal-append.run_wall_time_us":1091413}
I20260709 13:08:11.651504 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.652227 29523 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.652442 26679 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:11.652837 29523 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.653497 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.653826 29346 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.654158 26679 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 3.
I20260709 13:08:11.654475 29346 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.655100 29523 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.650355 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.650378 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.644151 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.639038 26612 raft_consensus.cc:2376] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7. Re-sending same reply.
I20260709 13:08:11.663635 27321 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:11.667014 29687 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.641677 29148 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.670089 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.622793 29658 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.673774 29472 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:11.673914 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.673945 26684 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:08:11.675185 26683 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:11.675457 26682 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:11.676661 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.637218 29637 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:11.682904 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.684437 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:11.682564 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 170186us
I20260709 13:08:11.467561 27313 rpcz_store.cc:276] 0709 13:08:08.839324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.839619 (+   295us) service_pool.cc:224] Handling call
0709 13:08:08.840003 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.915075 (+ 75072us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:09.890100 (+975025us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.953613 (+1063513us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.954460 (+   847us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.954736 (+   276us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.221125 (+266389us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.328996 (+107871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.383493 (+ 54497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.383572 (+    79us) raft_consensus.cc:1685] finished
0709 13:08:11.383587 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.383804 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35476,"prepare.queue_time_us":892854,"prepare.run_cpu_time_us":355,"prepare.run_wall_time_us":1281,"raft.queue_time_us":76558,"raft.run_cpu_time_us":12939,"raft.run_wall_time_us":18224,"thread_start_us":1520811,"threads_started":3,"wal-append.queue_time_us":985764}
I20260709 13:08:11.695472 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.696569 26679 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.699951 26612 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.700035 26759 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.700402 26607 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.675899 29628 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:11.707903 27285 leader_election.cc:336] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.648s (SENT)
I20260709 13:08:11.705300 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.715387 29640 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.715565 27312 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:11.716428 29551 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:11.717042 29551 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.719278 29551 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:11.719817 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:11.720420 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 91833us
W20260709 13:08:11.721506 26724 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.780s (SENT)
W20260709 13:08:11.722321 26724 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.789s (SENT)
I20260709 13:08:11.722638 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.722796 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:11.724128 29346 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:11.724901 27285 leader_election.cc:336] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.667s (SENT)
I20260709 13:08:11.725615 29692 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:11.726742 27285 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.865s (SENT)
I20260709 13:08:11.727965 29678 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:11.720027 29620 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 2.848s	user 0.014s	sys 0.011s
I20260709 13:08:11.720643 26612 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.729517 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.707749 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.730129 26612 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.730845 26759 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:11.728493 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.732749 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.733688 26607 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.699765 29266 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.737380 26679 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:11.741602 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:11.738080 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:11.744508 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:11.746814 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99909.5us
I20260709 13:08:11.746907 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:11.745754 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:11.749552 26752 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:11.749687 26612 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:11.750569 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.751123 26612 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:11.753067 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.754299 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:11.754364 29698 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.754766 29678 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.755002 26679 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.755505 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:11.755898 29534 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.756400 29534 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.756906 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.757579 26678 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:11.757340 29534 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:11.760861 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89307.7us
W20260709 13:08:11.762099 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.763084 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.763768 27285 leader_election.cc:336] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.603s (SENT)
I20260709 13:08:11.765334 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.747112 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.769088 26756 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:11.770795 29492 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:11.771346 29492 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:11.772280 29492 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.776151 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.769038 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:11.764478 27285 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.735s (SENT)
I20260709 13:08:11.729458 29345 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:11.783902 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:11.784796 26684 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:11.788694 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2409) took 2861 ms. Trace:
I20260709 13:08:11.789389 29690 raft_consensus.cc:2243] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 LEARNER]: Raft consensus shutting down.
I20260709 13:08:11.789767 27314 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:11.790199 29690 raft_consensus.cc:2272] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 4 LEARNER]: Raft consensus is shut down!
I20260709 13:08:11.791543 26758 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:11.795254 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.796535 29345 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:11.777253 26577 connection.cc:256] RPC call timeout handler was delayed by -1.4925567220000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:08:11.797082 26577 connection.cc:256] RPC call timeout handler was delayed by -1.4763567219999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:08:11.797412 26577 connection.cc:256] RPC call timeout handler was delayed by -1.3629567220000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:08:11.797677 26577 connection.cc:256] RPC call timeout handler was delayed by -1.2981567220000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:08:11.797940 26577 connection.cc:256] RPC call timeout handler was delayed by -1.2594567219999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:08:11.798197 26577 connection.cc:256] RPC call timeout handler was delayed by -1.083956722000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 13:08:11.799934 29254 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.792677 26683 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.802286 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:11.802924 26678 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:11.803839 27284 connection.cc:256] RPC call timeout handler was delayed by -2.0542279950000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:08:11.804581 27284 connection.cc:256] RPC call timeout handler was delayed by -1.5579449079999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 13:08:11.805881 29410 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:11.806619 29410 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:11.801806 26752 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:11.808604 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:11.802363 26758 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:11.808964 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:12.184876 26609 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:11.809232 26752 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.185873 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:12.186982 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.825472 26608 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:11.964475 29345 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.821112 29510 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:11.964637 27285 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 2.151s (SENT)
I20260709 13:08:12.190168 29640 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:12.190637 26605 raft_consensus.cc:2368] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 4. Current term is 5.
W20260709 13:08:12.190500 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 225889us
I20260709 13:08:12.190893 29640 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:11.812841 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:11.799563 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:11.834333 26607 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:11.812954 29658 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:12.205914 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:12.160601 26757 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:08:12.194562 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:12.153663 29609 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.669s	user 0.002s	sys 0.006s
I20260709 13:08:11.954489 26683 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:12.208437 26757 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:11.821117 26604 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:11.820356 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:11.950845 26679 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:11.850900 26678 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
W20260709 13:08:12.199419 26686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.001s
I20260709 13:08:11.866700 29618 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.318s
I20260709 13:08:12.200841 26759 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:12.213521 26684 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.213704 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 273) took 1226 ms. Trace:
W20260709 13:08:12.178577 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.014104 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.203085 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.869189 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 101164us
W20260709 13:08:12.195854 26755 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.000s
I20260709 13:08:11.789152 26611 rpcz_store.cc:276] 0709 13:08:08.927523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.944795 (+ 17272us) service_pool.cc:224] Handling call
0709 13:08:09.014551 (+ 69756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.717123 (+1702572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.788385 (+1071262us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400064d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:11.788604 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3911615872}
I20260709 13:08:12.191425 29345 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.207746 26758 raft_consensus.cc:2410] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:12.180017 29410 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:12.210212 29676 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:12.211560 26686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.010s	sys 0.002s
I20260709 13:08:11.881440 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:12.217021 26755 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
W20260709 13:08:11.962771 29612 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.003s
W20260709 13:08:12.214272 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 401544us
W20260709 13:08:12.214576 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.962900 29692 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.240s
I20260709 13:08:12.214160 26759 rpcz_store.cc:276] 0709 13:08:10.987786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.808615 (+820829us) service_pool.cc:224] Handling call
0709 13:08:12.213647 (+405032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.243643 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:12.216037 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 416554us
I20260709 13:08:12.220523 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:12.244511 26687 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:12.245461 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.246161 26687 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:12.246258 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:12.246102 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:12.253841 29618 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.253970 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:12.254244 29618 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.254326 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.255102 29618 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.255283 26611 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:12.255762 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:12.256775 29254 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.254571 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.257385 29254 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:12.257790 29254 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.258160 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:12.261390 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:12.261761 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.262108 27312 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:12.264906 29640 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:12.229974 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 507665us
I20260709 13:08:12.231276 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.231498 29659 raft_consensus.cc:2764] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:12.225183 29345 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:12.217945 29551 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:12.232681 29534 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:12.272183 29534 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:12.224858 29410 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:12.272871 29551 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:12.234834 26606 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:08:12.273368 26606 pending_rounds.cc:85] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:08:12.246574 29403 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:12.273838 26606 pending_rounds.cc:107] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:08:12.273871 29499 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:12.274271 26606 raft_consensus.cc:2889] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.247463 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.244480 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:12.274657 29499 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:12.275103 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:12.276415 26687 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:12.275735 29618 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.277336 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:12.274194 26724 leader_election.cc:336] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.866s (SENT)
I20260709 13:08:12.278505 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:12.278708 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.217804 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:11.813207 29346 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.407s
I20260709 13:08:12.279258 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:12.251225 26685 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:12.255297 29121 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.279872 29609 raft_consensus.cc:2764] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:12.275748 29499 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:12.280220 29121 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.280730 29609 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:12.281129 29640 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:12.281239 29609 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:12.282267 29121 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.275996 29345 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.276139 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:12.284271 26759 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.284222 29254 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.284869 29345 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.272086 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.288906 29429 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.289558 29429 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:12.255918 29510 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:12.256636 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.254068 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.268003 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.286231 29254 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.291850 26757 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:12.294349 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.295022 26683 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 3.
I20260709 13:08:12.295053 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.295842 26681 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:12.295861 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:12.296339 26683 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:12.296779 26757 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.222605 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 282) took 1231 ms. Trace:
I20260709 13:08:12.224301 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:12.224484 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:12.269035 26684 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:12.273334 29551 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.278195 26687 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:12.248226 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:12.226383 29148 raft_consensus.cc:2764] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:12.276240 26611 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:12.308763 26758 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.301362 26752 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:12.309677 26678 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:12.310361 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 490072us
I20260709 13:08:12.311484 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:12.312755 29659 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:12.310477 26759 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:12.297701 26683 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:12.308933 26755 rpcz_store.cc:276] 0709 13:08:10.990977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.502082 (+511105us) service_pool.cc:224] Handling call
0709 13:08:12.222549 (+720467us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:12.315850 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133844us
I20260709 13:08:12.230858 29612 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:12.319223 26757 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:12.320684 26679 raft_consensus.cc:2410] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:12.317353 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:12.315822 29692 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.323880 26683 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:12.327265 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.327570 26687 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:12.327801 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.328465 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.328742 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.330904 26758 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:12.329494 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.337895 27312 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:12.339359 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:12.332846 26684 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.350831 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.351643 26611 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:12.351893 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:12.352583 26757 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.353111 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1405) took 1302 ms. Trace:
I20260709 13:08:12.353385 26757 rpcz_store.cc:276] 0709 13:08:11.060387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.322671 (+1262284us) service_pool.cc:224] Handling call
0709 13:08:12.323047 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.352946 (+ 29899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.353073 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.413916 26752 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:12.323046 29254 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:12.423450 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 84160.6us
I20260709 13:08:12.282315 29609 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.435221 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 260) took 1613 ms. Trace:
I20260709 13:08:12.330778 29658 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:12.443084 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 281) took 1452 ms. Trace:
W20260709 13:08:12.439363 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 158523us
W20260709 13:08:12.440629 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 162014us
I20260709 13:08:12.441248 26752 rpcz_store.cc:276] 0709 13:08:10.801510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.318585 (+1517075us) service_pool.cc:224] Handling call
0709 13:08:12.324750 (+  6165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.414710 (+ 89960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.415067 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:12.424399 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70214.8us
I20260709 13:08:12.444082 26755 rpcz_store.cc:276] 0709 13:08:10.990662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.318379 (+1327717us) service_pool.cc:224] Handling call
0709 13:08:12.327795 (+  9416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.435329 (+107534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.435357 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.442765 (+  7408us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.442818 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.442889 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.443024 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.347307 29618 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.330969 29692 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.422840 29492 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:12.438463 29563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.000s	sys 0.022s
I20260709 13:08:12.459414 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:12.423197 29659 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:12.485106 26678 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:12.634613 29556 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.214s
I20260709 13:08:12.637060 26609 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.481141 29492 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:12.517508 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 185331us
I20260709 13:08:12.592286 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.564975 26684 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:12.585956 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 316361us
I20260709 13:08:12.485790 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:12.659744 26604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1377) took 1524 ms (client timeout 1600 ms). Trace:
I20260709 13:08:12.595330 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:12.647405 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.667514 26612 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:12.604717 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.660296 26604 rpcz_store.cc:269] 0709 13:08:11.114399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.117015 (+  2616us) service_pool.cc:224] Handling call
0709 13:08:12.638918 (+1521903us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400379bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:12.639038 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861400960}
W20260709 13:08:12.596127 29719 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:08:12.585232 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1409) took 1152 ms. Trace:
W20260709 13:08:12.638206 29717 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:08:12.692543 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 246421us
I20260709 13:08:12.650573 29612 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:12.565821 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:12.694067 26758 rpcz_store.cc:276] 0709 13:08:11.413017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.341017 (+928000us) service_pool.cc:224] Handling call
0709 13:08:12.351647 (+ 10630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.500215 (+148568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.500247 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.565191 (+ 64944us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.565258 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.565341 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.565487 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.699899 26610 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:12.525693 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49012.3us
I20260709 13:08:12.441783 29510 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:12.711239 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.442865 29640 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:12.718940 29563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.006s	sys 0.030s
I20260709 13:08:12.744674 26758 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:12.745546 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1138) took 1291 ms. Trace:
I20260709 13:08:12.745934 26758 rpcz_store.cc:276] 0709 13:08:11.453918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.723403 (+1269485us) service_pool.cc:224] Handling call
0709 13:08:12.732371 (+  8968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.745207 (+ 12836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.745477 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.739357 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.740746 29492 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:12.748596 29727 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:12.749344 29721 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.749518 29535 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.749876 29721 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:12.750322 29721 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.750923 29640 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.752075 29675 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:12.753101 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2438) took 2547 ms. Trace:
I20260709 13:08:12.753463 26680 rpcz_store.cc:276] 0709 13:08:10.205707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.205929 (+   222us) service_pool.cc:224] Handling call
0709 13:08:10.207866 (+  1937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.728224 (+520358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.752830 (+2024606us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54000c3fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:12.753046 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192840448}
W20260709 13:08:12.754431 29723 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:08:12.752471 29675 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:12.756408 29675 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.757400 29675 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.761055 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:12.762032 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:12.760383 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:12.770361 26760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 275) took 1780 ms (client timeout 1648 ms). Trace:
W20260709 13:08:12.770903 26760 rpcz_store.cc:269] 0709 13:08:10.988530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.462596 (+474066us) service_pool.cc:224] Handling call
0709 13:08:12.760239 (+1297643us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:12.768575 (+  8336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067200}
I20260709 13:08:12.772282 26760 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.772922 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1141) took 1318 ms. Trace:
I20260709 13:08:12.773231 26760 rpcz_store.cc:276] 0709 13:08:11.454703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.771722 (+1317019us) service_pool.cc:224] Handling call
0709 13:08:12.772100 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.772682 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.772868 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:12.780299 29741 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.634907 29726 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.181s
I20260709 13:08:12.767160 29523 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:12.785919 29740 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:12.786495 29740 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.723490 29690 ts_tablet_manager.cc:1916] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:12.788694 29740 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:12.500041 29658 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.262s
I20260709 13:08:12.723322 29737 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.737699 29510 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:12.833612 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:12.875802 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95451.8us
W20260709 13:08:12.875211 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 145677us
W20260709 13:08:12.879573 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.880038 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.877961 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:12.880806 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.742511 29499 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:08:12.866556 29403 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:12.890790 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 569034us
I20260709 13:08:12.892192 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:12.903151 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 112624us
I20260709 13:08:12.903923 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.906205 26610 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:12.886951 29254 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.887233 29523 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.889187 29737 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:12.906145 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 187330us
I20260709 13:08:12.888917 29692 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:12.915912 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:12.879305 29659 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:12.917339 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 436385us
I20260709 13:08:12.902769 29727 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:12.920884 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:12.888134 29121 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:08:12.924695 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:12.920758 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:12.929867 26610 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:12.914839 29737 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:12.918283 29492 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.920946 29346 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.938463 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:12.957504 26612 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:12.939349 26607 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.939937 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:12.940105 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58193us
I20260709 13:08:12.959308 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:12.959784 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:12.940393 29726 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:12.941162 29733 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:12.942032 29721 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:12.933090 29732 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:12.943392 26754 raft_consensus.cc:2410] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:12.933187 29551 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:08:12.948133 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 404) took 1170 ms. Trace:
I20260709 13:08:12.934938 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:12.948642 29492 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.950498 29563 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.950692 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2449) took 1295 ms. Trace:
I20260709 13:08:12.951143 29535 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.951920 29743 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.952317 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:13.003808 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51563.6us
I20260709 13:08:12.952873 29121 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:12.955850 29727 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:12.982748 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46520.6us
I20260709 13:08:12.921136 29499 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:08:13.000192 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.000898 26682 rpcz_store.cc:276] 0709 13:08:11.655353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.714364 (+ 59011us) service_pool.cc:224] Handling call
0709 13:08:12.920644 (+1206280us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016beee 0000000000375939 00007f40f81df1e0 00007f40f82a80c4 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:12.950626 (+ 29982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729728}
W20260709 13:08:13.017871 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 97064.2us
W20260709 13:08:13.007226 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 78323.7us
I20260709 13:08:12.986548 29523 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.000504 29726 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.009954 29346 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:13.010684 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:13.010771 29659 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.011493 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:13.012045 29721 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.012153 29429 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.013262 27321 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.986171 29732 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:13.003002 29535 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.002231 29492 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.990226 29551 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.017201 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.032088 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:13.038712 27320 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:13.044003 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:13.045168 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.015442 29743 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.049613 27316 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:13.052186 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:13.054253 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54160.1us
I20260709 13:08:13.055019 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.045270 29732 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:13.060696 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.001580 29510 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.048743 29346 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.041391 29618 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:08:13.058365 29609 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.058955 29721 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:13.081293 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1117) took 2854 ms. Trace:
I20260709 13:08:13.141722 26753 rpcz_store.cc:276] 0709 13:08:10.227217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.227310 (+    93us) service_pool.cc:224] Handling call
0709 13:08:10.227574 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.795649 (+568075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.077295 (+2281646us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400081954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:13.081234 (+  3939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254054784}
I20260709 13:08:13.144078 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.106333 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:13.071430 29563 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.147416 26753 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:13.090142 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45070.7us
I20260709 13:08:13.149293 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.151471 29744 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:13.152621 29729 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:08:13.152884 29535 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:13.154426 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1140) took 1700 ms. Trace:
W20260709 13:08:13.162690 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.156162 29346 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.157514 29738 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:13.158095 29551 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.159072 29613 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.151033 29743 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:13.176373 27286 leader_election.cc:336] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.648s (SENT)
W20260709 13:08:13.188138 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 153962us
I20260709 13:08:13.200691 26756 rpcz_store.cc:276] 0709 13:08:11.454437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.758918 (+1304481us) service_pool.cc:224] Handling call
0709 13:08:12.759287 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.759687 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.759725 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.760241 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.996789 (+236548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:12.996845 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.996939 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.154159 (+157220us) raft_consensus.cc:1685] finished
0709 13:08:13.154179 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.154333 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1104,"raft.queue_time_us":33095,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4897,"thread_start_us":229570,"threads_started":1,"wal-append.queue_time_us":279061}
I20260709 13:08:13.145174 27318 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:13.087781 29728 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.203925 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1144) took 1744 ms. Trace:
I20260709 13:08:13.081269 29429 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:13.088930 29121 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.200167 29721 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.215616 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.215910 26753 rpcz_store.cc:276] 0709 13:08:11.455469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.146606 (+1691137us) service_pool.cc:224] Handling call
0709 13:08:13.147100 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.161449 (+ 14349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.199952 (+ 38503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.081000 29523 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:08:13.200472 29744 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:13.224689 29760 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.224534 29721 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.225153 29345 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.225376 26753 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:13.217320 29728 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.225834 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:13.076460 29737 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.226568 29720 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.081454 29726 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.226969 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50642us
I20260709 13:08:13.228507 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2443) took 1575 ms. Trace:
I20260709 13:08:13.228561 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1420) took 1764 ms. Trace:
W20260709 13:08:13.261863 27284 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.542s (SENT)
I20260709 13:08:13.230227 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1413) took 1810 ms. Trace:
I20260709 13:08:13.262508 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.263270 26757 rpcz_store.cc:276] 0709 13:08:11.420113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.457044 (+1036931us) service_pool.cc:224] Handling call
0709 13:08:12.495049 (+ 38005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.719240 (+224191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.719270 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.791051 (+ 71781us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.989888 (+198837us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.989940 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.990017 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.230021 (+240004us) raft_consensus.cc:1685] finished
0709 13:08:13.230037 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.230168 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92292,"raft.queue_time_us":278633,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"thread_start_us":178559,"threads_started":2,"wal-append.queue_time_us":184876}
W20260709 13:08:13.230813 29751 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:13.240029 29551 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:13.241276 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2435) took 3063 ms (client timeout 1590 ms). Trace:
I20260709 13:08:13.247201 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:12.988801 27313 rpcz_store.cc:276] 0709 13:08:11.778241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.869389 (+ 91148us) service_pool.cc:224] Handling call
0709 13:08:11.869923 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.447249 (+577326us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:12.455838 (+  8589us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.593624 (+137786us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.893339 (+299715us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:12.894970 (+  1631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.905495 (+ 10525us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.947850 (+ 42355us) raft_consensus.cc:1685] finished
0709 13:08:12.947873 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.948044 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10068,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2713,"thread_start_us":437954,"threads_started":2,"wal-append.queue_time_us":324815}
W20260709 13:08:13.268613 26685 rpcz_store.cc:269] 0709 13:08:10.156747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.225605 (+ 68858us) service_pool.cc:224] Handling call
0709 13:08:13.202208 (+2976603us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400127ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:13.219715 (+ 17507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4469335296}
I20260709 13:08:13.262280 26608 rpcz_store.cc:276] 0709 13:08:11.463968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.693327 (+229359us) service_pool.cc:224] Handling call
0709 13:08:13.228295 (+1534968us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b5400162e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:13.228483 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175960832}
I20260709 13:08:13.260612 26681 rpcz_store.cc:276] 0709 13:08:11.653579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.297646 (+644067us) service_pool.cc:224] Handling call
0709 13:08:12.297983 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.313196 (+ 15213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.313226 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.317276 (+  4050us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.498179 (+180903us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:12.498556 (+   377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.498650 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.228307 (+729657us) raft_consensus.cc:1685] finished
0709 13:08:13.228326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.228450 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52673,"raft.queue_time_us":147657,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":33980,"thread_start_us":178574,"threads_started":1,"wal-append.queue_time_us":575593}
I20260709 13:08:13.253232 29728 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.202365 29254 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:08:13.283818 26756 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:13.284909 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1145) took 1829 ms. Trace:
I20260709 13:08:13.285406 26756 rpcz_store.cc:276] 0709 13:08:11.457628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.220025 (+1762397us) service_pool.cc:224] Handling call
0709 13:08:13.242147 (+ 22122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.284529 (+ 42382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.284838 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.287227 26756 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:13.288264 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1147) took 1801 ms. Trace:
I20260709 13:08:13.288771 26756 rpcz_store.cc:276] 0709 13:08:11.486595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.286480 (+1799885us) service_pool.cc:224] Handling call
0709 13:08:13.286936 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.287961 (+  1025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.288197 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.267239 29760 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:08:13.292476 29734 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:13.292953 29734 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:13.293303 29734 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.244143 29345 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.243326 29744 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:13.300732 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.302960 26761 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:13.303231 29728 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.304697 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1142) took 1849 ms. Trace:
I20260709 13:08:13.305945 29254 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.306488 29254 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.312546 29551 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.313133 29551 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.315116 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1124) took 3080 ms. Trace:
I20260709 13:08:13.305081 26760 rpcz_store.cc:276] 0709 13:08:11.454971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.773997 (+1319026us) service_pool.cc:224] Handling call
0709 13:08:12.774352 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.874371 (+100019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.874420 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.892940 (+ 18520us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.043822 (+150882us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:13.043887 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.043976 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.304464 (+260488us) raft_consensus.cc:1685] finished
0709 13:08:13.304486 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.304636 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19364,"raft.queue_time_us":111937,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":18344,"thread_start_us":121943,"threads_started":1,"wal-append.queue_time_us":165012}
W20260709 13:08:13.333240 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.338181 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.319177 26761 rpcz_store.cc:276] 0709 13:08:10.234952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.091374 (+2856422us) service_pool.cc:224] Handling call
0709 13:08:13.218373 (+126999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.303608 (+ 85235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.315026 (+ 11418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.356839 29121 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.314530 29720 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.305640 29728 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:13.373335 29640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.003s	sys 0.032s
W20260709 13:08:13.385778 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 138712us
I20260709 13:08:13.386535 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:13.387773 29345 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.389358 29736 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.740s	user 0.003s	sys 0.000s
I20260709 13:08:13.314297 29551 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.391141 29640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.004s	sys 0.032s
I20260709 13:08:13.311193 29254 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.415318 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:13.419927 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:13.423034 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.423846 26687 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.406272 29429 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.450448 26682 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:13.450660 26685 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:13.453922 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1139) took 1999 ms. Trace:
I20260709 13:08:13.455580 26758 rpcz_store.cc:276] 0709 13:08:11.454192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.746853 (+1292661us) service_pool.cc:224] Handling call
0709 13:08:12.790601 (+ 43748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.894286 (+103685us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:12.961424 (+ 67138us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.240571 (+279147us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180038fda0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a 00007f40f329aa2a
0709 13:08:13.453497 (+212926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.453561 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:13.453613 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.453693 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.453853 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4090,"prepare.queue_time_us":43967,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":22291,"raft.queue_time_us":4624,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":4051200,"thread_start_us":249292,"threads_started":2}
W20260709 13:08:13.458246 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 196409us
W20260709 13:08:13.459162 27284 leader_election.cc:336] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.648s (SENT)
W20260709 13:08:13.459422 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.463281 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.463904 26684 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:13.451730 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.407099 29492 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.478576 26680 raft_consensus.cc:2376] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7. Re-sending same reply.
I20260709 13:08:13.458491 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.447876 29345 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.480118 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:13.480010 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:13.450852 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:13.496415 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 406523us
I20260709 13:08:13.462584 29563 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:13.518003 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 439729us
I20260709 13:08:13.465037 29726 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:13.452147 29732 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.478502 29523 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:13.543362 27285 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.603s (SENT)
I20260709 13:08:13.547286 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.557521 29492 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.557909 29534 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.559005 29534 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:13.560190 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 265) took 2601 ms (client timeout 1806 ms). Trace:
W20260709 13:08:13.560813 26605 rpcz_store.cc:269] 0709 13:08:10.958259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.971817 (+ 13558us) service_pool.cc:224] Handling call
0709 13:08:13.559912 (+2588095us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001004d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:13.560084 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578576128}
W20260709 13:08:13.563062 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 274) took 2574 ms (client timeout 1542 ms). Trace:
W20260709 13:08:13.563570 26754 rpcz_store.cc:269] 0709 13:08:10.988143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.013819 (+ 25676us) service_pool.cc:224] Handling call
0709 13:08:13.562765 (+2548946us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400138154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:13.562954 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4434753408}
W20260709 13:08:13.594297 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.594350 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:13.595081 26679 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:13.595860 26684 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:13.535247 29768 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:13.598662 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55356.3us
W20260709 13:08:13.604756 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 194896us
I20260709 13:08:13.604866 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:13.608465 27285 leader_election.cc:336] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.785s (SENT)
I20260709 13:08:13.606886 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.605197 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1135) took 2144 ms. Trace:
I20260709 13:08:13.609740 26752 rpcz_store.cc:276] 0709 13:08:11.453049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.456168 (+1003119us) service_pool.cc:224] Handling call
0709 13:08:12.499180 (+ 43012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.914439 (+415259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.914472 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.950110 (+ 35638us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.242761 (+292651us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:13.242814 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.242910 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.559124 (+316214us) raft_consensus.cc:1685] finished
0709 13:08:13.559151 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.596904 (+ 37753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185933,"raft.queue_time_us":241596,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":398394,"threads_started":2,"wal-append.queue_time_us":410657}
I20260709 13:08:13.614722 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 279) took 2624 ms. Trace:
I20260709 13:08:13.593779 29551 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.646435 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:13.597352 29523 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.636909 29690 ts_tablet_manager.cc:1929] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:08:13.649384 29403 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:13.649662 29523 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.597657 29254 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.651015 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:13.627230 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.628667 29767 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.630072 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:13.652263 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:13.652524 29767 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:13.646050 26759 rpcz_store.cc:276] 0709 13:08:10.989955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.318643 (+1328688us) service_pool.cc:224] Handling call
0709 13:08:12.319285 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.323218 (+  3933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.323260 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.332600 (+  9340us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.581765 (+249165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:12.581805 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.581888 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.388590 (+806702us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:13.594283 (+205693us) raft_consensus.cc:1685] finished
0709 13:08:13.594303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.614640 (+ 20337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29062400,"thread_start_us":111726,"threads_started":1,"wal-append.queue_time_us":205994}
I20260709 13:08:13.653821 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:13.654125 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.654893 29767 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:13.536300 29726 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.639829 29429 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.641355 29775 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:13.673349 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57152.4us
I20260709 13:08:13.642112 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.643214 29768 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.645087 29732 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.649966 29403 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.653067 26755 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:13.640700 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 181557us
W20260709 13:08:13.676162 27284 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.865s (SENT)
I20260709 13:08:13.676708 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.655025 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:13.663017 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54596.4us
I20260709 13:08:13.663391 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.662151 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:13.679780 26684 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:08:13.663187 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.627784 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.681263 26758 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:13.681406 26754 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:13.667236 26686 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:08:13.672108 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.673830 26687 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:13.656791 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:13.673354 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 530174us
I20260709 13:08:13.672932 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.649986 29690 log.cc:1199] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-3-root/wals/272d473e821e4c15a9f3fa0471adfdc6
I20260709 13:08:13.689968 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.691023 26685 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:13.692909 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:13.700158 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:13.700819 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58894.7us
I20260709 13:08:13.655366 29767 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:13.706033 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1146) took 2232 ms. Trace:
I20260709 13:08:13.706405 26757 rpcz_store.cc:276] 0709 13:08:11.473701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.283052 (+1809351us) service_pool.cc:224] Handling call
0709 13:08:13.355270 (+ 72218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.386010 (+ 30740us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:13.415029 (+ 29019us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.705728 (+290699us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.705778 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:13.705829 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.705888 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.705984 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16362,"prepare.queue_time_us":64112,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":16480,"thread_start_us":174819,"threads_started":1}
I20260709 13:08:13.676437 26605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:13.707957 26605 raft_consensus.cc:606] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.708227 29734 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.709045 27317 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:13.710579 29734 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:13.712142 26686 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:13.703578 29725 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.716534 26755 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
W20260709 13:08:13.718374 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61639.1us
I20260709 13:08:13.719615 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.662215 29726 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:13.724915 26753 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:13.727443 26754 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:13.676704 29720 raft_consensus.cc:2764] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:13.729266 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1416) took 2273 ms. Trace:
I20260709 13:08:13.729753 26753 rpcz_store.cc:276] 0709 13:08:11.456318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.220486 (+1764168us) service_pool.cc:224] Handling call
0709 13:08:13.220774 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.728805 (+508031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.729199 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.685990 29523 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:13.733229 27318 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:13.736020 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.740460 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:13.751807 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75694.8us
I20260709 13:08:13.744132 29726 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.758635 29534 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:08:13.752460 29740 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.750407 29775 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:13.782925 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51507.7us
I20260709 13:08:13.762472 29721 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.752713 29627 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.752414 29767 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:13.787832 29769 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:13.793114 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.794644 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.793170 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1151) took 2204 ms. Trace:
I20260709 13:08:13.797065 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.796362 26756 rpcz_store.cc:276] 0709 13:08:11.593866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.289750 (+1695884us) service_pool.cc:224] Handling call
0709 13:08:13.290128 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.375948 (+ 85820us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:13.402598 (+ 26650us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.645169 (+242571us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b1800355300. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:08:13.645369 (+   200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.645898 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.646050 (+   152us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:13.646259 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.646408 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.646470 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.792935 (+146465us) raft_consensus.cc:1685] finished
0709 13:08:13.792958 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.793114 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36798,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":8969,"raft.queue_time_us":4143,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":15519,"spinlock_wait_cycles":38188416,"thread_start_us":48015,"threads_started":1,"wal-append.queue_time_us":286407}
I20260709 13:08:13.752257 29720 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:13.801189 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.802508 29769 raft_consensus.cc:2764] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:13.756547 29744 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.800617 29679 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.810434 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.812000 29563 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.812150 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.813642 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.814402 29734 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:13.815126 29734 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.815778 29734 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.819126 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:13.796679 29534 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:13.819919 29679 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:13.820044 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.820549 29679 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:13.820791 26686 raft_consensus.cc:2376] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8. Re-sending same reply.
I20260709 13:08:13.821617 29768 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:13.821736 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:13.821511 29679 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.822340 26687 raft_consensus.cc:2376] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7. Re-sending same reply.
I20260709 13:08:13.823017 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:13.823282 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.824059 26760 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:13.825232 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.825944 26752 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:13.826045 29734 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:13.827232 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.800792 29740 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:13.827852 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:13.804352 29345 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.828728 29788 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:13.820219 29148 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:13.829406 29788 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:13.829563 29148 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.830462 29788 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.830569 29148 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.830476 29786 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:13.787621 29254 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:13.827113 29775 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:13.837608 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:13.827945 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.840958 29730 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.841148 29775 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:13.841426 29730 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.841367 29254 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:13.842036 29148 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:13.842120 29254 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.842537 26758 raft_consensus.cc:1217] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-7.5]   Dedup: 7.5->[]
I20260709 13:08:13.842460 29730 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:13.841355 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.843152 26758 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:08:13.843107 29254 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.844842 29254 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.845472 29744 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:13.845562 29690 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54848 (request call id 0) took 4469 ms. Trace:
I20260709 13:08:13.846077 29690 rpcz_store.cc:276] 0709 13:08:09.425005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.425244 (+   239us) service_pool.cc:224] Handling call
0709 13:08:10.581964 (+1156720us) ts_tablet_manager.cc:1151] Deleting tablet 272d473e821e4c15a9f3fa0471adfdc6
0709 13:08:10.616676 (+ 34712us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:13.076460 (+2459784us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:13.636712 (+560252us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:13.845447 (+208735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1168763,"tablet-delete.queue_time_us":1006815,"thread_start_us":1280783,"threads_started":1}
I20260709 13:08:13.845573 27313 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:13.851643 26605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:13.852238 26605 raft_consensus.cc:606] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.852556 26605 raft_consensus.cc:614] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:13.846199 29728 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:13.855345 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.856348 26605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:13.856317 29775 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.857138 26605 raft_consensus.cc:606] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:13.857497 26605 raft_consensus.cc:614] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:13.858825 29730 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.838225 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.771777 29403 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.859994 29769 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.860360 29403 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:13.864830 29769 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:13.866008 29769 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.866365 29769 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:13.799278 29721 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:13.867132 29769 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.868398 29769 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.840667 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1385) took 2502 ms. Trace:
I20260709 13:08:13.869786 26606 rpcz_store.cc:276] 0709 13:08:11.338277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.765190 (+426913us) service_pool.cc:224] Handling call
0709 13:08:12.234435 (+469245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.274843 (+ 40408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.840451 (+1565608us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000203d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:13.840586 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054078208}
I20260709 13:08:13.896153 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:13.896620 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:13.896900 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59464.3us
W20260709 13:08:13.891299 27284 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.151s (SENT)
I20260709 13:08:13.898339 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.898861 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:13.872064 29721 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:13.896886 29783 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:13.902869 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.901211 29741 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.903071 29535 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.898267 29523 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.896153 29563 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:13.930528 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:13.920055 29345 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.911432 29535 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:13.911401 29534 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:13.920050 29658 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.915895 29734 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:08:13.921734 29741 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:13.921694 29689 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:13.961349 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:13.962459 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.962092 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.944924 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:13.952097 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.961678 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:13.957185 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.962881 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:13.964193 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:13.958617 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:14.118455 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:13.945438 29563 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.080961 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:14.118861 29254 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.076900 26759 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:14.153374 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:14.032508 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87646.3us
I20260709 13:08:13.954639 29613 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:14.153668 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 213621us
I20260709 13:08:14.121124 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:14.127909 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.119300 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.099040 26681 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [7.4-9.5]
W20260709 13:08:13.956038 29781 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 13:08:13.935701 29721 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.970923 29345 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.143770 26758 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:14.209676 26758 pending_rounds.cc:85] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:08:14.210022 26758 pending_rounds.cc:107] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:14.210300 26758 raft_consensus.cc:2889] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.156749 26607 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:14.153961 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 107061us
I20260709 13:08:14.117751 29730 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.160880 26753 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:14.243032 29659 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.244175 29659 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.956171 29535 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.953850 29776 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:14.169349 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.252125 29627 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:14.174495 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44278us
I20260709 13:08:14.277020 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:14.175957 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 278539us
I20260709 13:08:14.177366 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.178246 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:14.179582 26606 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:13.945230 29492 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.222s
I20260709 13:08:14.096560 29759 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.183126 26759 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:14.168536 29613 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:14.192497 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.193018 29768 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:14.228350 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 269837us
I20260709 13:08:14.211205 29551 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:14.159574 29563 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:14.172318 29254 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:14.238458 27285 leader_election.cc:336] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.632s (SENT)
I20260709 13:08:13.849886 26494 catalog_manager.cc:5028] TS 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): tablet 272d473e821e4c15a9f3fa0471adfdc6 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:08:14.239650 26680 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.237967 26678 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:14.240500 26757 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:14.304032 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:14.246294 26683 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:14.304687 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:14.305030 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.686s (SENT) [suppressed 41 similar messages]
I20260709 13:08:14.305271 26678 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.306519 26683 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.172580 29679 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.309119 29679 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:14.310019 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68671us
I20260709 13:08:14.255856 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:14.311389 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:14.312740 26682 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:14.313179 26678 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:14.313710 26761 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:14.258325 27313 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:14.245239 29788 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.249061 26608 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:14.097985 29727 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.315022 29727 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:14.304687 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:14.316176 29727 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.316803 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.318465 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:14.293807 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.296736 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.265383 29734 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:14.323649 26683 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:14.324013 29734 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:14.311545 29679 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:14.325335 29734 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.326244 29679 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:14.327301 29679 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:14.327433 29734 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.329860 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.332845 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.335197 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:08:14.329262 29679 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.316195 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:14.269711 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.343999 29794 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:08:14.344195 26494 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 494433us
I20260709 13:08:14.345688 29254 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:14.346727 29765 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.811s	user 0.006s	sys 0.006s
I20260709 13:08:14.280043 29148 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.348636 29148 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.276594 29627 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:14.350734 29148 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:14.351222 29627 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:14.352160 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75220.9us
W20260709 13:08:14.352627 29799 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:14.252405 29730 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.353365 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:14.354777 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:14.355124 29730 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:14.355397 29732 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:14.355942 29732 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:14.356812 29732 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.352703 29741 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:14.360109 29741 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:14.361297 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.299043 29563 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.354791 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 116348us
I20260709 13:08:14.297075 29759 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.491693 26753 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.365890 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:14.366740 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 330557us
I20260709 13:08:14.492503 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:14.348219 29792 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:08:14.391628 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.495420 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.363819 29675 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.359694 29534 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:14.450476 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 139143us
I20260709 13:08:14.342737 26757 raft_consensus.cc:606] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:08:14.473222 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97821.6us
I20260709 13:08:14.362999 29776 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:14.480201 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 287729us
W20260709 13:08:14.483841 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 167706us
I20260709 13:08:14.487982 29804 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:14.478905 29121 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:14.502627 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:14.499368 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:14.524506 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.499687 26757 raft_consensus.cc:614] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:14.490551 29741 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:14.563452 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.496619 29680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.012s	sys 0.013s
W20260709 13:08:14.575178 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70750.3us
I20260709 13:08:14.522429 29776 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:14.543103 29689 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:14.571790 29680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.013s
I20260709 13:08:14.633543 29737 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.560189 29741 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.530902 29121 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:14.530316 29775 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.635602 29121 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.636128 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.637456 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.637820 29345 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:14.638561 29345 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.638808 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:14.628134 29410 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:14.628409 26687 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.639504 29410 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.640044 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.640636 26756 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:14.641435 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.641641 29410 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:14.629269 29618 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:14.642285 29618 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:14.642794 26756 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:14.564481 29403 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.530849 29534 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.525668 29658 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:08:14.613664 29776 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:14.624545 29800 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:14.642252 29741 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.659878 26684 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:14.680881 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 148870us
W20260709 13:08:14.687846 26724 connection.cc:256] RPC call timeout handler was delayed by -1.4840826329999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:08:14.507542 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.694090 27313 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:14.660300 29777 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.507288 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.666792 26756 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:08:14.702119 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 192123us
I20260709 13:08:14.703585 26685 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:14.509110 29759 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:14.526662 29492 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:08:14.718307 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79558.7us
I20260709 13:08:14.719626 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.672346 29618 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.722645 29534 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:14.722775 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.724928 26761 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:14.725277 29810 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:14.726116 26761 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:14.726215 29810 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.726786 29810 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:14.696897 26724 connection.cc:256] RPC call timeout handler was delayed by -1.083578952000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3183s for a response
I20260709 13:08:14.728258 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:14.728576 29627 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.730852 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:14.681195 29659 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.732005 29659 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.732348 29659 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.733127 29803 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:14.733559 29803 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:14.734360 29803 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.735834 29803 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.673729 29680 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:08:14.737138 26680 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:14.737390 29680 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.739091 29680 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:14.739820 27314 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
W20260709 13:08:14.741668 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 176129us
I20260709 13:08:14.742946 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.743847 29767 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:14.744100 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.745270 29767 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:14.746790 29819 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:08:14.747133 29618 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:14.748317 29775 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:14.748689 29775 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:14.749456 29775 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.750586 29775 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.756914 29680 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.668030 29345 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.668673 29523 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.573799 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.707221 29741 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:14.713951 29777 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.617408 29613 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.724656 29732 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.758045 29743 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:14.759943 29689 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:14.761523 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:14.767407 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44682.7us
W20260709 13:08:14.767809 27285 leader_election.cc:336] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 2.573s (SENT)
I20260709 13:08:14.811419 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.811875 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:14.812273 26608 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:14.551579 29728 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:14.696784 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68829.1us
I20260709 13:08:14.795590 26757 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:14.790318 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:14.807606 26755 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:14.814199 26759 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:08:14.814762 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.819235 26759 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 4
I20260709 13:08:14.819531 26759 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:08:14.781540 29345 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:14.820997 29345 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.821610 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:14.824226 29535 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 13:08:14.824617 29535 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.825659 26753 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.826678 29535 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:14.828220 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 60440.5us
I20260709 13:08:14.810349 29805 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:08:14.829833 26760 raft_consensus.cc:2410] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:14.830245 29658 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.802866 29534 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:14.831808 29551 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.831965 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.832216 29726 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.832993 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.834285 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.834652 29818 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:14.834290 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 72848.9us
I20260709 13:08:14.813084 29492 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:14.840785 29769 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:14.853979 29805 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:14.882025 29769 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.882217 29805 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:14.882526 29769 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.883087 29805 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.884325 29805 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.841241 29810 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:14.816785 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:08:14.888190 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 71477us
I20260709 13:08:14.846181 26603 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:08:14.847177 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 322552us
W20260709 13:08:14.848246 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.802958 29640 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.849900 26759 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:08:14.846210 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.895216 26759 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.895785 26687 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:14.831450 29793 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 13:08:14.852313 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.854045 26607 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:14.854710 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:14.857892 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.858109 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:14.857914 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.858862 26686 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:08:14.858701 29121 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.859304 29746 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.858109 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.859912 29345 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.856452 29410 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:14.804013 29776 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:14.857968 27313 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 7 LEARNER]: Advancing to term 8
I20260709 13:08:14.863936 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:14.865121 26606 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:14.946204 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.866436 26679 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.867007 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.812853 29689 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.805063 29743 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:14.873732 27320 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:14.877388 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.880900 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:14.956600 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.961440 26686 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:08:14.908663 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.924975 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.855929 29534 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.930418 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.963748 26761 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:14.879705 29726 consensus_queue.cc:1243] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:14.815461 29523 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.872131 29728 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:14.949157 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.948436 26682 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:14.894110 29659 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.802616 29403 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:14.960067 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:14.944240 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.975894 26758 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:14.968089 26685 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:14.970027 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 89244.5us
I20260709 13:08:14.981916 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:14.971185 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:14.972682 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:14.985833 26752 raft_consensus.cc:2376] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7. Re-sending same reply.
I20260709 13:08:14.973629 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.938575 29640 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:14.967013 29534 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.943117 29746 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:14.999982 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:14.998363 26687 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:15.005131 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:14.995985 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.970829 29721 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.990445 26686 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:14.975270 29827 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.000214 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:15.035634 26612 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.967519 29805 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:14.995273 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:15.026144 26609 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.043972 26607 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.999981 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.001180 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:15.045394 26684 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:15.001266 26678 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:14.991591 26610 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.004412 26679 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:15.006019 26603 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:14.997792 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.049844 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.982901 29551 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.030725 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:14.996392 26682 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:08:15.001099 29777 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.037364 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:15.053608 26682 pending_rounds.cc:85] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:15.054035 26759 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:15.058426 26682 pending_rounds.cc:107] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:08:15.054474 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 185807us
I20260709 13:08:15.054975 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:15.058849 26682 raft_consensus.cc:2889] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.994874 29345 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:15.059017 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:15.004105 29659 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.060813 26610 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:14.995796 29523 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.067034 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:15.067643 26609 raft_consensus.cc:2376] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6. Re-sending same reply.
I20260709 13:08:15.067945 26761 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:15.022384 29740 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:08:15.037848 29805 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.073304 26686 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:08:15.076016 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:15.073572 27320 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.076632 26603 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:14.995234 29563 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.033128 29768 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:08:15.057958 29811 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:15.100685 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 299874us
I20260709 13:08:15.100755 26607 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:15.028941 29825 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:08:15.000814 29640 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:15.110114 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 217738us
W20260709 13:08:15.110829 26650 connection.cc:256] RPC call timeout handler was delayed by -2.62399652299996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.275s for a response
W20260709 13:08:15.111246 26650 connection.cc:256] RPC call timeout handler was delayed by -1.8755422589999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
W20260709 13:08:15.111632 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5386513070000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25120000000000003s for a response
I20260709 13:08:15.051590 29551 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:15.112056 26650 connection.cc:256] RPC call timeout handler was delayed by -1.527173337000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2851s for a response
I20260709 13:08:15.077359 29254 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:15.112912 29830 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.002281 29743 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.000291 29728 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.081900 29805 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.115312 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.096969 29804 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:15.075732 29403 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:08:15.069792 29777 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:08:15.169978 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 135707us
I20260709 13:08:15.100562 29769 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.107918 29811 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:15.077211 29727 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:08:15.184355 26757 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:15.195010 26757 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:15.186880 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.190101 26612 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:15.192235 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 346406us
I20260709 13:08:15.175896 29121 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.141597 29726 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:15.210736 26757 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:15.206638 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 121395us
I20260709 13:08:15.179548 29627 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:15.208384 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 93141us
I20260709 13:08:15.220897 29769 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:15.200070 29523 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:15.223505 27320 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:15.179949 29659 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:15.230248 29523 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:15.202512 29776 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:15.180830 29838 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:08:15.215878 29345 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:08:15.260183 29659 consensus_queue.cc:1243] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:15.268837 29768 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:15.281344 29768 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:15.277477 26760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1160) took 1318 ms (client timeout 1670 ms). Trace:
I20260709 13:08:15.282105 29768 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:15.282464 26760 rpcz_store.cc:269] 0709 13:08:13.959321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.961852 (+  2531us) service_pool.cc:224] Handling call
0709 13:08:15.277227 (+1315375us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54002e90d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:15.277409 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844616960}
I20260709 13:08:15.212918 29403 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:15.280767 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 64123.7us
I20260709 13:08:15.264921 29811 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:15.266382 29833 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:08:15.286600 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1439) took 1009 ms. Trace:
W20260709 13:08:15.288933 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 94703.6us
I20260709 13:08:15.287178 26753 rpcz_store.cc:276] 0709 13:08:14.276895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.492408 (+215513us) service_pool.cc:224] Handling call
0709 13:08:14.492646 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.826009 (+333363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.268482 (+442473us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540011cbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:15.286529 (+ 18047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765498112}
I20260709 13:08:15.289762 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:15.307281 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:15.294201 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64884.3us
I20260709 13:08:15.283495 29121 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:08:15.274444 29551 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.287845 29725 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.287879 29403 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.222735 29627 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.329195 26755 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:15.294529 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 191073us
I20260709 13:08:15.325990 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:15.329339 26684 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:15.331645 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:15.336850 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.332046 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:15.339210 26753 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:15.308995 29811 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.303501 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:15.335222 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:15.334657 27316 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:15.306571 29618 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:15.288043 29769 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:15.346378 26757 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:15.347025 29659 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:15.345456 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:15.348261 29851 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:15.348387 29659 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.348826 29851 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.349256 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:15.334919 29768 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.350562 29810 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:15.351343 29737 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.351627 29810 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:15.352033 29810 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:15.352767 29810 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.312403 29727 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.353962 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1229) took 1113 ms. Trace:
I20260709 13:08:15.357030 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:15.349717 29851 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.320240 27313 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:15.354418 26681 rpcz_store.cc:276] 0709 13:08:14.240665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.240858 (+   193us) service_pool.cc:224] Handling call
0709 13:08:14.241225 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:14.242029 (+   804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.242060 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:14.739790 (+497730us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:14.740346 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:08:14.928957 (+188611us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:14.967314 (+ 38357us) log.cc:844] Serialized 14 byte log entry
0709 13:08:14.967585 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.968896 (+  1311us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.265825 (+296929us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:15.353771 (+ 87946us) raft_consensus.cc:1685] finished
0709 13:08:15.353792 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.353910 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37453,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4840,"raft.queue_time_us":194,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4733,"spinlock_wait_cycles":127203456,"thread_start_us":187742,"threads_started":1,"wal-append.queue_time_us":319643}
I20260709 13:08:15.331462 29627 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.354001 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:15.364696 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:15.383586 27285 leader_election.cc:336] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.812s (SENT)
I20260709 13:08:15.392225 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:15.399734 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.354761 29737 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.401880 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.342406 29852 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:15.404068 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.321837 29254 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:08:15.359580 29727 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.314715 29849 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:08:15.367048 29810 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.412796 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.389416 29345 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:15.343461 29725 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.348278 29769 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:15.400018 29627 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:15.416489 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.464114 29627 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:15.464285 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 47889.9us
W20260709 13:08:15.465699 26650 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.465384 29627 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.466502 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:15.276892 29804 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.469727 29725 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.470214 29726 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:15.470912 29726 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.437265 29534 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.473822 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:15.388641 29843 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.413141 29727 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.398404 29842 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:08:15.451794 29827 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:08:15.454298 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.408524 29523 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:15.406863 29737 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.481170 29523 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.483942 29523 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.434841 29551 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:15.486433 29843 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.461024 29689 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.435773 29777 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.476173 29534 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.477923 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:15.404798 29659 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:15.495198 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 172306us
I20260709 13:08:15.388831 29805 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:15.510316 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 172437us
I20260709 13:08:15.532444 26681 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:15.405030 29403 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.535193 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:15.536240 26681 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:15.522583 29659 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:15.542167 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:15.543998 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:15.544916 29862 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:15.546141 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:15.547310 29563 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.548171 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:15.548714 26686 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.552873 27316 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:15.558745 26686 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:15.559633 29613 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:15.571273 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.573845 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.576234 26753 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.572037 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:15.581120 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:15.583237 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.584048 26761 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:15.587095 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.589053 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:15.591264 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:15.592061 26684 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:15.595494 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.578890 29862 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.599908 29862 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.600309 29862 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.601270 29805 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:15.597844 29847 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.604242 29847 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:15.604558 26605 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:15.604730 29847 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.595902 29831 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.608366 29831 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:15.608863 29831 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:15.619848 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.620042 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:15.621923 26612 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.625923 26761 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:15.603575 29843 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:15.628216 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.628811 26757 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.629964 29852 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.630440 29852 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:15.632927 29859 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:15.638739 26753 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:15.644121 26757 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:15.652856 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:15.543088 29806 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:15.595697 29410 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:15.660975 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:15.665485 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70676us
I20260709 13:08:15.674029 29806 consensus_queue.cc:1243] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:15.674134 29689 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:15.675868 29811 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.676431 29811 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.677228 29534 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:15.677733 29534 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.678516 29534 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:15.679299 29835 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:15.682413 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:15.685107 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:15.685913 26753 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.660245 29851 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:15.712730 26753 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:15.678537 29811 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.682773 29835 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.690158 29410 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:15.697353 29689 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:15.646406 29659 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.704454 29563 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.722890 29851 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.691008 29727 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.735436 29825 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.785250 26611 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:08:15.789222 29835 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.790256 29835 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:15.793689 29840 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.593s	user 0.003s	sys 0.000s
I20260709 13:08:15.752094 29563 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.798125 29563 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:15.798614 29737 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.788697 26611 pending_rounds.cc:85] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 2
I20260709 13:08:15.800671 26611 pending_rounds.cc:107] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:08:15.800952 26611 raft_consensus.cc:2889] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.740814 29843 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:15.799794 29689 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:15.804685 29825 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:15.812382 29689 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:15.814049 29825 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:15.815088 29861 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:15.788350 29852 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:15.828883 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.740463 29869 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:08:15.847602 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.036849 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.066840 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.107784 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.111564 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.230118 26755 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.825106 29627 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:16.183068 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 364775us
W20260709 13:08:16.176303 29862 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
W20260709 13:08:16.250735 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.266371 26606 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:16.266207 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:16.267802 29741 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.268191 29727 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.268545 29563 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:16.268219 29720 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:16.269203 29563 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.272498 26755 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:16.271867 29862 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.267556 29825 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.280193 29737 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:16.280692 29825 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.281926 29862 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:16.251916 29822 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:16.284623 29535 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.286644 29563 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:16.232420 29869 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.128172 29805 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.268340 29741 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.283325 29825 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.128523 29551 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.262181 29865 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:08:16.229940 29410 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.234710 29851 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.341325 29613 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:16.351804 29689 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.299190 29627 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.328961 29869 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:16.380823 26650 leader_election.cc:336] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.563s (SENT)
I20260709 13:08:16.381340 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:16.383553 29767 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:16.383730 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 424) took 1023 ms. Trace:
I20260709 13:08:16.384019 29767 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:16.384953 29767 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.384177 27312 rpcz_store.cc:276] 0709 13:08:15.360093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.362215 (+  2122us) service_pool.cc:224] Handling call
0709 13:08:15.483918 (+121703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.484397 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.484444 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.485078 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.596482 (+111404us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:15.597794 (+  1312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.649140 (+ 51346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.382506 (+733366us) raft_consensus.cc:1685] finished
0709 13:08:16.383478 (+   972us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.383648 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8102,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4260,"thread_start_us":94016,"threads_started":1,"wal-append.queue_time_us":215567}
I20260709 13:08:16.403041 29741 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.345651 29805 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:16.406107 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 140036us
I20260709 13:08:16.409286 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:16.404120 29523 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.920s	user 0.007s	sys 0.004s
I20260709 13:08:16.348227 29551 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.411060 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:16.416514 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.416225 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:16.370191 29613 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.419615 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:16.373768 29689 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.415452 29563 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.415350 29737 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.469014 29737 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:16.472826 29869 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:16.467943 29563 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:16.411928 29741 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:08:16.424085 29659 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:16.416118 29523 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.493508 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2464) took 1616 ms. Trace:
I20260709 13:08:16.494108 26687 rpcz_store.cc:276] 0709 13:08:14.877372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.920067 (+ 42695us) service_pool.cc:224] Handling call
0709 13:08:14.920642 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.006091 (+ 85449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.493174 (+1487083us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400160dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:16.493425 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177892608}
W20260709 13:08:16.487401 29876 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:16.499895 29805 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:16.501011 29875 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:16.501940 29627 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:16.509536 29879 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:08:16.478874 29563 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:16.523120 26681 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:08:16.511190 29847 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.005s
W20260709 13:08:16.547147 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123601us
W20260709 13:08:16.551895 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 149968us
W20260709 13:08:16.553035 26650 leader_election.cc:336] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.577s (SENT)
W20260709 13:08:16.558322 26650 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.586s (SENT)
I20260709 13:08:16.540989 29563 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:16.564970 26650 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.604s (SENT)
I20260709 13:08:16.565471 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:16.566375 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.555785 29862 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.546561 29842 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.546240 29805 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.569056 26650 leader_election.cc:336] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.664s (SENT)
I20260709 13:08:16.543887 29534 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.571214 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:16.562697 29810 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.147s	user 0.007s	sys 0.005s
I20260709 13:08:16.636802 29881 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:08:16.639772 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 366) took 1151 ms. Trace:
I20260709 13:08:16.640497 27314 rpcz_store.cc:276] 0709 13:08:15.488823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.492281 (+  3458us) service_pool.cc:224] Handling call
0709 13:08:15.528209 (+ 35928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.596154 (+ 67945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.634557 (+ 38403us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.700883 (+ 66326us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.239626 (+538743us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.239712 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.239816 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.639491 (+399675us) raft_consensus.cc:1685] finished
0709 13:08:16.639511 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.639711 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13119,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10588,"thread_start_us":451610,"threads_started":1,"wal-append.queue_time_us":669339}
I20260709 13:08:16.642242 29850 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:16.562175 29811 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:08:16.643256 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:16.644078 27320 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:16.644311 29882 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:16.561590 29732 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:16.656036 29732 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.659097 29732 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.662704 29535 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.644248 29727 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.656451 29551 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.674105 29850 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.675273 29864 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.945s	user 0.006s	sys 0.011s
W20260709 13:08:16.677322 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.569242 29721 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.681816 27320 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:16.572678 29869 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.543423 29847 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.560952 29627 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:08:16.637169 29862 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.694211 29403 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.713263 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:16.699756 27320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 420) took 1460 ms (client timeout 1830 ms). Trace:
W20260709 13:08:16.714151 27320 rpcz_store.cc:269] 0709 13:08:15.236326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.250571 (+ 14245us) service_pool.cc:224] Handling call
0709 13:08:16.643115 (+1392544us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:16.689489 (+ 46374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5146368}
I20260709 13:08:16.699903 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:16.720147 27314 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:16.701671 29880 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:16.724537 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:16.725257 27320 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:16.703068 29831 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.094s	user 0.011s	sys 0.000s
I20260709 13:08:16.703409 29869 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.703982 29759 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.664201 29842 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:16.706421 29121 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.664512 29805 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.716199 29523 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.717877 29847 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.717933 29720 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:16.718935 29613 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.744258 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:16.675724 29534 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:16.686767 29850 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.738711 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.721990 29551 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:16.738063 29563 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.732434 29732 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:16.768604 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.785074 26604 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:16.786365 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.754652 26606 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:16.684216 29727 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.776918 26610 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:16.764860 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.779558 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.726476 29689 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:16.779814 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66093.8us
W20260709 13:08:16.767735 29835 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.977s	user 0.009s	sys 0.003s
W20260709 13:08:16.783455 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 61267.4us
I20260709 13:08:16.783861 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:16.794739 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.795507 26610 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:16.758191 29523 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.797433 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.798130 26607 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:16.772279 29818 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.766534 29805 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:16.756801 29862 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.799916 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.801970 26753 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:16.802582 26612 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.802925 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.803982 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.780490 29659 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:16.783022 29721 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.808044 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.811432 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.738679 29121 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.814839 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:16.815598 26760 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.804936 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.790831 29613 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.789965 29720 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:16.806223 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:16.813714 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:16.814189 26757 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:16.738909 29759 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.788367 29811 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:16.733613 29831 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.818593 26610 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:16.805841 29887 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.812325 26607 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:16.828006 26612 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:16.828804 29759 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.813565 29888 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.829882 29534 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.832705 29850 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:16.816423 29884 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.810599 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:16.820032 29613 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.809549 29818 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.866433 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.823374 29721 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.837911 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.867233 26607 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:16.840826 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:16.853399 26604 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:16.868398 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.868999 26604 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:16.869777 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.855216 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:16.861857 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.808323 29523 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.836580 29410 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:16.840652 29881 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:16.868587 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:16.878558 26760 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:16.814743 29659 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.890682 26604 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:16.889688 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.891985 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:16.892657 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:16.897017 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.868285 27314 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:16.899755 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.900348 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.900801 26604 raft_consensus.cc:2376] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9. Re-sending same reply.
I20260709 13:08:16.902144 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.903633 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.904098 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:16.905133 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:16.904989 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.905900 26604 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:16.906940 29768 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:16.907021 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:16.907637 29768 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.825538 29720 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.877254 29721 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.857882 29888 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.858558 29887 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.867841 29884 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:16.883790 29535 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:08:16.966214 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 174820us
I20260709 13:08:16.913729 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:16.953044 26609 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:16.953706 29732 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.908496 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:16.887890 29881 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:17.031112 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 162572us
I20260709 13:08:16.912731 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:17.065534 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:16.966938 29875 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:17.096071 26686 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.059834 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:17.105293 29889 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:08:17.072190 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.076340 26604 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:08:17.052067 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.135303 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.103181 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:17.059777 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.099337 29902 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:17.109848 26680 raft_consensus.cc:2410] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:16.882512 29627 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:17.135953 26685 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:16.891906 27315 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:17.025857 29842 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.147648 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:16.889547 29410 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:16.980991 29895 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:17.100737 29881 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.009649 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:17.129063 29767 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:17.132157 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.147469 29897 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:17.137354 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:17.198302 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.199321 26604 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:17.144665 26686 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:17.147763 29627 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.148352 26684 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:17.155507 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.191169 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.191242 26606 raft_consensus.cc:2376] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8. Re-sending same reply.
I20260709 13:08:17.100551 29732 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:16.953788 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59933.3us
W20260709 13:08:17.206748 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.070384 29899 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:17.191362 29894 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:08:17.202469 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:17.204075 26680 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:17.211202 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.209945 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:17.156548 29902 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:17.217476 29902 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:17.218010 29902 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:17.191732 29121 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.218298 29725 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:17.159210 29831 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:17.219142 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 116041us
I20260709 13:08:17.218351 29902 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.252919 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:17.219587 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.255631 26604 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:17.256652 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:17.195808 29768 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.201864 29535 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:17.218706 29725 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:17.298463 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.297089 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.212091 29627 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.213287 29899 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:17.256057 29523 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.257305 29902 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:17.303872 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.310393 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.310560 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.194170 29895 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:17.261128 29818 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:17.321909 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.304733 29659 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:17.306851 29899 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.330644 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:17.331768 26606 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 6: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:17.302764 29535 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:17.358793 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:17.361724 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 204349us
I20260709 13:08:17.327241 29523 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:17.317230 29892 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.224s
I20260709 13:08:17.362500 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:17.372172 29906 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.182s	user 0.000s	sys 0.006s
I20260709 13:08:17.372926 29904 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:17.373802 29746 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:17.375566 29535 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:17.375761 29907 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:08:17.331470 29725 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:18.008013 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 645531us
I20260709 13:08:17.767196 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1192) took 2192 ms. Trace:
I20260709 13:08:17.626459 26604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
W20260709 13:08:17.728034 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 518120us
I20260709 13:08:17.333674 29818 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:17.884694 27285 connection.cc:256] RPC call timeout handler was delayed by -2.0312741870001219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:08:18.011443 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:17.795226 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:17.883965 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.647841 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:17.924695 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2463) took 1188 ms. Trace:
I20260709 13:08:17.655159 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:17.886507 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94012.2us
W20260709 13:08:17.777136 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.789505 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1242) took 2245 ms. Trace:
I20260709 13:08:17.516659 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:18.016476 26604 raft_consensus.cc:606] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:08:18.018343 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.788216 29843 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:17.872030 29618 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.021834 26685 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:18.009053 26754 rpcz_store.cc:276] 0709 13:08:15.575192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.734699 (+159507us) service_pool.cc:224] Handling call
0709 13:08:15.784951 (+ 50252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.785328 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.785356 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.786332 (+   976us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.261065 (+474733us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:16.344363 (+ 83298us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.344648 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.344725 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.765622 (+1420897us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2400199028. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:08:17.766741 (+  1119us) raft_consensus.cc:1685] finished
0709 13:08:17.766898 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.767109 (+   211us) inbound_call.cc:177] Queueing success response
0709 13:08:17.785873 (+ 18764us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180038f980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
Metrics: {"prepare.queue_time_us":84951,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5784,"raft.queue_time_us":409,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":15157,"spinlock_wait_cycles":6252800,"thread_start_us":363604,"threads_started":1,"wal-append.queue_time_us":544010}
I20260709 13:08:18.140607 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1471) took 1271 ms. Trace:
I20260709 13:08:18.141096 26681 rpcz_store.cc:276] 0709 13:08:15.543662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.547151 (+  3489us) service_pool.cc:224] Handling call
0709 13:08:15.547433 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.527741 (+980308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.789183 (+1261442us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54001db354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:17.789428 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2243031296}
I20260709 13:08:18.202003 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:18.062225 27285 connection.cc:256] RPC call timeout handler was delayed by -1.4513605230000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:08:18.204205 27285 connection.cc:256] RPC call timeout handler was delayed by -1.2348361520000708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 13:08:18.204492 26758 raft_consensus.cc:2410] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:08:18.205502 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.206264 26685 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:18.150208 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.203560 26606 rpcz_store.cc:276] 0709 13:08:16.869055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.357890 (+488835us) service_pool.cc:224] Handling call
0709 13:08:18.140530 (+782640us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:17.782155 29829 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 2.600s	user 0.009s	sys 0.005s
I20260709 13:08:18.212922 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:18.213986 26681 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.213811 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:17.408367 29732 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:18.221745 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:17.584038 29887 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.975943 29743 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.626047 29850 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:17.803784 29613 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.403852 29888 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.394906 29884 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:17.568564 29910 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.752211 29730 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:18.235502 26756 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:17.368181 29720 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.780900 29721 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:17.393261 29895 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:18.009644 29880 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.234109 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:17.394488 29913 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.233724 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.020907 29818 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:18.247363 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.206313 29535 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.221534 29618 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.233927 29732 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.152771 29725 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.140165 29788 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.255327 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36480 (request call id 6) took 1169 ms. Trace:
I20260709 13:08:18.278441 26604 rpcz_store.cc:276] 0709 13:08:17.072979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.416567 (+343588us) service_pool.cc:224] Handling call
0709 13:08:18.242735 (+826168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.148398 29746 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:18.206883 29843 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:18.206089 29825 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:17.754935 29869 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.219588 26608 rpcz_store.cc:276] 0709 13:08:16.735793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.736094 (+   301us) service_pool.cc:224] Handling call
0709 13:08:16.764066 (+ 27972us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:16.811105 (+ 47039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.811132 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:16.819028 (+  7896us) log.cc:844] Serialized 78 byte log entry
0709 13:08:16.888948 (+ 69920us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:16.888986 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.405066 (+516080us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54003796d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:17.405111 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.405159 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:17.405171 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.924591 (+519420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8985,"raft.queue_time_us":12324,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4376,"spinlock_wait_cycles":67095296,"thread_start_us":21191,"threads_started":1,"wal-append.queue_time_us":44779,"wal-append.run_cpu_time_us":13363,"wal-append.run_wall_time_us":1062542}
I20260709 13:08:18.062983 29523 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.285023 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.254420 29878 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.259799 29884 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.260985 29730 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:18.302398 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.304311 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 528708us
W20260709 13:08:18.333630 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.333875 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:18.334502 29884 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.336292 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.336995 26604 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:18.276497 29818 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.021695 29904 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.271926 29410 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:18.279543 29740 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.374001 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.374886 26679 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:18.388922 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.389870 26606 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:18.343634 29919 ts_tablet_manager.cc:933] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.397042 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:18.399217 26687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.010s
I20260709 13:08:18.399749 26604 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:18.415763 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1442) took 1614 ms. Trace:
I20260709 13:08:18.416225 26604 rpcz_store.cc:276] 0709 13:08:16.801590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.345549 (+1543959us) service_pool.cc:224] Handling call
0709 13:08:18.399423 (+ 53874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.415377 (+ 15954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.415688 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.339150 29721 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:18.266724 29880 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.283982 29535 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.291343 29825 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.413468 29618 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:18.276751 29913 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.264278 29910 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.287403 29732 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.291702 29746 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.426838 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.412096 29917 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.419528 29881 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.222s	user 0.005s	sys 0.007s
I20260709 13:08:18.292862 29788 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:18.439654 29918 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:08:18.440452 26684 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:18.458039 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 244276us
I20260709 13:08:18.393883 29740 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.430215 29922 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.449007 26604 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:18.439654 29924 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:18.470939 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1452) took 1666 ms. Trace:
I20260709 13:08:18.471829 26604 rpcz_store.cc:276] 0709 13:08:16.804316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.417182 (+1612866us) service_pool.cc:224] Handling call
0709 13:08:18.438479 (+ 21297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.470653 (+ 32174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.470880 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.441499 29913 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:18.464015 27314 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.511s	user 0.006s	sys 0.005s
W20260709 13:08:18.486469 29767 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.276s	user 0.010s	sys 0.000s
I20260709 13:08:18.486986 29767 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.458045 29721 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:18.487962 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 478723us
I20260709 13:08:18.490430 26685 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:18.491952 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:18.494102 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:18.418100 26687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.010s
I20260709 13:08:18.447639 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:18.420989 29730 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:18.497752 26651 connection.cc:256] RPC call timeout handler was delayed by -1.6398980740000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 13:08:18.499605 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:18.500226 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:18.503427 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:18.504010 27321 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:08:18.504849 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 493452us
I20260709 13:08:18.505545 26604 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:08:18.506031 26604 pending_rounds.cc:85] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 3
I20260709 13:08:18.505790 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:18.506356 26604 pending_rounds.cc:107] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:18.506705 26604 raft_consensus.cc:2889] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.429673 29843 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.496791 29915 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.514139 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1453) took 1709 ms. Trace:
I20260709 13:08:18.514487 26604 rpcz_store.cc:276] 0709 13:08:16.804558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.473263 (+1668705us) service_pool.cc:224] Handling call
0709 13:08:18.505114 (+ 31851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.513878 (+  8764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.514077 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.515377 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:18.464987 29881 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.516672 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:18.521337 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2727629049999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:08:18.521800 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2403629049999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:08:18.524103 26681 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:18.524858 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1258) took 1185 ms. Trace:
I20260709 13:08:18.525234 26681 rpcz_store.cc:276] 0709 13:08:17.339016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.212644 (+873628us) service_pool.cc:224] Handling call
0709 13:08:18.524787 (+312143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.527155 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 294) took 1429 ms. Trace:
I20260709 13:08:18.489179 27314 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:18.470970 29410 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:18.540508 27316 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:18.464514 29917 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.527540 26681 rpcz_store.cc:276] 0709 13:08:17.098221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.526171 (+1427950us) service_pool.cc:224] Handling call
0709 13:08:18.526524 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.526743 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.526780 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.526835 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:18.526885 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.526961 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.527092 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.499446 29720 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:18.537474 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:18.538192 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:18.533741 29730 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.529203 29891 raft_consensus.cc:2764] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:18.474962 29922 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.569648 27317 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 5.
I20260709 13:08:18.539311 29767 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:18.609264 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.284s	user 0.013s	sys 0.021s
I20260709 13:08:18.544044 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 370) took 1797 ms. Trace:
I20260709 13:08:18.576301 26612 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.575712 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2468) took 1836 ms. Trace:
I20260709 13:08:18.535117 29907 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.569375 27318 raft_consensus.cc:2376] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9. Re-sending same reply.
I20260709 13:08:18.592381 29767 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:18.574142 26681 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.582402 26604 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.633580 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1454) took 1828 ms. Trace:
I20260709 13:08:18.583139 29884 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:18.634102 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 135608us
W20260709 13:08:18.631465 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 183920us
W20260709 13:08:18.610749 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.014s	sys 0.021s
I20260709 13:08:18.572258 29720 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.636196 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 295) took 1537 ms. Trace:
I20260709 13:08:18.579124 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:18.641925 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.559116 27321 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:18.530967 29915 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:18.619637 29899 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.260s	user 0.010s	sys 0.002s
I20260709 13:08:18.610460 29523 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:18.610159 29938 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.531620 29931 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.636783 29767 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.634503 29884 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.640657 29720 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.640666 29732 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:18.676407 29928 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:18.583523 29721 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.677639 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2493) took 1765 ms. Trace:
I20260709 13:08:18.672928 29947 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.678941 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1253) took 1352 ms. Trace:
I20260709 13:08:18.678525 29947 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.678061 26680 rpcz_store.cc:276] 0709 13:08:16.912143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.213853 (+301710us) service_pool.cc:224] Handling call
0709 13:08:17.214140 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.313474 (+ 99334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.313517 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.320078 (+  6561us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.262848 (+942770us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:18.262893 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.262966 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.677420 (+414454us) raft_consensus.cc:1685] finished
0709 13:08:18.677439 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.677574 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40836,"raft.queue_time_us":146923,"spinlock_wait_cycles":141414144,"thread_start_us":528621,"threads_started":2,"wal-append.queue_time_us":1112228}
I20260709 13:08:18.633929 26604 rpcz_store.cc:276] 0709 13:08:16.804787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.539624 (+1734837us) service_pool.cc:224] Handling call
0709 13:08:18.582234 (+ 42610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.633285 (+ 51051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.633523 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.679340 26684 rpcz_store.cc:276] 0709 13:08:17.326430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.148082 (+821652us) service_pool.cc:224] Handling call
0709 13:08:18.678781 (+530699us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003133d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:18.678885 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535352192}
I20260709 13:08:18.629398 26603 rpcz_store.cc:276] 0709 13:08:16.739388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.739726 (+   338us) service_pool.cc:224] Handling call
0709 13:08:16.788392 (+ 48666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.101161 (+312769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.101187 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.125869 (+ 24682us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.583124 (+457255us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.583186 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.583295 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.575471 (+992176us) raft_consensus.cc:1685] finished
0709 13:08:18.575491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.575634 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16801,"raft.queue_time_us":19439,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7846,"thread_start_us":667536,"threads_started":2,"wal-append.queue_time_us":1098466}
I20260709 13:08:18.680743 26604 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:08:18.681083 26604 pending_rounds.cc:85] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:08:18.681281 26604 pending_rounds.cc:107] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:08:18.681493 26604 raft_consensus.cc:2889] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.681548 26603 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:18.681708 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.682129 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2474) took 1876 ms. Trace:
I20260709 13:08:18.682904 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.636807 26761 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:08:18.528861 29878 consensus_queue.cc:1175] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e09ea9b455894a0189912a7b9b6b2f84" responder_term: 9 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: [8.8-8.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:18.684688 29940 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:18.659241 29904 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.685547 29904 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.686064 29904 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.668689 29938 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.694062 29938 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:18.691437 26752 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:18.637219 26681 rpcz_store.cc:276] 0709 13:08:17.098483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.573670 (+1475187us) service_pool.cc:224] Handling call
0709 13:08:18.573975 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.635936 (+ 61961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.636130 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:18.638830 29916 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:08:18.694962 29936 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.639778 29927 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:08:18.587257 29880 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:18.588174 29910 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.651939 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:18.696128 26681 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:18.696738 26759 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:18.696770 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1247) took 1371 ms. Trace:
I20260709 13:08:18.697315 26681 rpcz_store.cc:276] 0709 13:08:17.324950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.695484 (+1370534us) service_pool.cc:224] Handling call
0709 13:08:18.695824 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.696539 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.696719 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.698457 26681 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.698956 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1248) took 1373 ms. Trace:
W20260709 13:08:18.701486 29932 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:18.702695 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2490) took 1799 ms. Trace:
I20260709 13:08:18.703584 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.704247 26755 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.704365 26753 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:18.703034 26687 rpcz_store.cc:276] 0709 13:08:16.903490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.179190 (+275700us) service_pool.cc:224] Handling call
0709 13:08:17.179657 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.584726 (+405069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.584770 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.644891 (+ 60121us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.495533 (+850642us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:18.495572 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.495642 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.700920 (+205278us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:18.702451 (+  1531us) raft_consensus.cc:1685] finished
0709 13:08:18.702470 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.702644 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73985,"raft.queue_time_us":134414,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4719,"spinlock_wait_cycles":19919616,"thread_start_us":1102577,"threads_started":2,"wal-append.queue_time_us":887762}
I20260709 13:08:18.706915 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1250) took 1381 ms. Trace:
I20260709 13:08:18.707221 26687 rpcz_store.cc:276] 0709 13:08:17.325675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.706164 (+1380489us) service_pool.cc:224] Handling call
0709 13:08:18.706442 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.706607 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.706636 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.706677 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:18.706712 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.706766 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.706863 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.709311 26687 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.710819 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.682578 26603 rpcz_store.cc:276] 0709 13:08:16.805303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.680979 (+1875676us) service_pool.cc:224] Handling call
0709 13:08:18.681269 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.681897 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.682075 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.682129 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1455) took 1877 ms. Trace:
I20260709 13:08:18.712716 26604 rpcz_store.cc:276] 0709 13:08:16.805059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.680111 (+1875052us) service_pool.cc:224] Handling call
0709 13:08:18.680414 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.681948 (+  1534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.682075 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.699242 26681 rpcz_store.cc:276] 0709 13:08:17.325192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.698003 (+1372811us) service_pool.cc:224] Handling call
0709 13:08:18.698304 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.698759 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.698910 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.736027 26684 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:08:18.653083 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 153556us
I20260709 13:08:18.627193 29535 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.615995 27314 rpcz_store.cc:276] 0709 13:08:16.742992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.772681 (+ 29689us) service_pool.cc:224] Handling call
0709 13:08:18.540459 (+1767778us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:18.631935 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 135884us
I20260709 13:08:18.632115 29933 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.775882 29904 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.780809 29933 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:18.782473 29937 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:08:18.782548 29818 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.672869 29946 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:18.783656 29946 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:18.650291 29825 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:18.750064 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.722968 29740 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.739032 29943 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.808445 29943 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.815909 26759 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.774643 29915 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:18.743791 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1251) took 1417 ms. Trace:
I20260709 13:08:18.770244 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.783106 29933 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
W20260709 13:08:18.634644 26651 connection.cc:256] RPC call timeout handler was delayed by -1.358198074000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:08:18.816847 26687 rpcz_store.cc:276] 0709 13:08:17.325939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.708307 (+1382368us) service_pool.cc:224] Handling call
0709 13:08:18.709145 (+   838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.743488 (+ 34343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.743729 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.817296 26761 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:18.818203 26687 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.818360 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.818809 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1254) took 1492 ms. Trace:
I20260709 13:08:18.819165 26687 rpcz_store.cc:276] 0709 13:08:17.326662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.817728 (+1491066us) service_pool.cc:224] Handling call
0709 13:08:18.818041 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.818575 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.818758 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.639544 26756 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:18.768822 26681 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:08:18.798000 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.826665 26603 raft_consensus.cc:2410] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:18.799767 26604 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:18.802111 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:18.828482 26755 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:18.805871 29818 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:18.783797 29535 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.784302 29946 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.724797 29746 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:18.776221 29884 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.840252 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1252) took 1514 ms. Trace:
I20260709 13:08:18.845099 26681 rpcz_store.cc:276] 0709 13:08:17.326195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.714565 (+1388370us) service_pool.cc:224] Handling call
0709 13:08:18.768598 (+ 54033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.825348 (+ 56750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.840188 (+ 14840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.827618 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1456) took 2016 ms. Trace:
I20260709 13:08:18.846275 26604 rpcz_store.cc:276] 0709 13:08:16.810792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.713428 (+1902636us) service_pool.cc:224] Handling call
0709 13:08:18.799341 (+ 85913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.827286 (+ 27945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.827536 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.841305 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.658572 29899 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.853967 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:18.854792 26681 raft_consensus.cc:2376] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8. Re-sending same reply.
W20260709 13:08:18.842119 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 73086.9us
I20260709 13:08:18.724462 29910 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:18.847568 26687 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:18.857192 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.858672 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.695502 29936 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:18.835990 29627 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.520s	user 0.008s	sys 0.004s
I20260709 13:08:18.865756 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:18.866232 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.869715 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2454) took 3885 ms. Trace:
I20260709 13:08:18.875684 26611 rpcz_store.cc:276] 0709 13:08:14.984422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.985329 (+   907us) service_pool.cc:224] Handling call
0709 13:08:15.026130 (+ 40801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.801698 (+775568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.869386 (+3067688us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540017b454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:18.869619 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669392640}
I20260709 13:08:18.868402 26687 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:18.876641 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2491) took 1973 ms. Trace:
I20260709 13:08:18.878371 26755 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.874657 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.877525 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.879488 26604 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:18.879549 26687 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:18.880615 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:18.881269 26681 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.877027 26686 rpcz_store.cc:276] 0709 13:08:16.903629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.212227 (+308598us) service_pool.cc:224] Handling call
0709 13:08:17.212538 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.730544 (+518006us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:18.140666 (+410122us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.438163 (+297497us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.438629 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.438761 (+   132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:18.438797 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.447080 (+  8283us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.781933 (+334853us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:18.869241 (+ 87308us) raft_consensus.cc:1685] finished
0709 13:08:18.876461 (+  7220us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.876591 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84486,"prepare.queue_time_us":417285,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":37,"raft.queue_time_us":153202,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":33723,"spinlock_wait_cycles":26837248,"thread_start_us":632909,"threads_started":2,"wal-append.queue_time_us":268629}
I20260709 13:08:18.884991 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.896055 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:18.897229 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:18.899102 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.890369 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1245) took 1566 ms. Trace:
I20260709 13:08:18.901779 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:18.901489 26680 rpcz_store.cc:276] 0709 13:08:17.324423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.679721 (+1355298us) service_pool.cc:224] Handling call
0709 13:08:18.680026 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.680229 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:18.723990 (+ 43761us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.889883 (+165893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.889959 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:18.890034 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.890121 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.890304 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43479,"prepare.queue_time_us":104147,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":110,"thread_start_us":165446,"threads_started":1}
I20260709 13:08:18.904062 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:18.907014 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:18.882167 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.912240 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:18.910920 26681 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:18.911018 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:18.912667 26687 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:18.890072 29943 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:18.844250 29535 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:18.913144 26680 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:18.901868 29915 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:18.934911 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.864939 29884 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.937822 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:18.941593 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 225697us
I20260709 13:08:18.870229 29910 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:18.909559 29904 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.890774 29746 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.912176 29825 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:18.945813 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:18.969266 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:19.010629 29949 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:08:18.909044 29940 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:18.883287 29627 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.012041 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2464) took 2276 ms. Trace:
I20260709 13:08:19.012147 26606 raft_consensus.cc:1217] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-7.5]   Dedup: 5.4->[7.5-7.5]
I20260709 13:08:19.010841 26680 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:18.968246 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:19.015022 26606 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:08:19.012549 26605 rpcz_store.cc:276] 0709 13:08:16.736065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.736175 (+   110us) service_pool.cc:224] Handling call
0709 13:08:16.741256 (+  5081us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.764041 (+ 22785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.764071 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.764663 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:08:18.677346 (+1912683us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b180047bba0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1
0709 13:08:18.677507 (+   161us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:18.839278 (+161771us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.940489 (+101211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.940747 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.940786 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:18.946281 (+  5495us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.011981 (+ 65700us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":234038,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":1800,"raft.queue_time_us":18770,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":18502,"spinlock_wait_cycles":18441472,"thread_start_us":290176,"threads_started":3,"wal-append.queue_time_us":28020,"wal-append.run_cpu_time_us":3608,"wal-append.run_wall_time_us":1575835}
I20260709 13:08:18.944834 29740 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:19.019169 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51007.1us
I20260709 13:08:19.019266 26687 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:18.939554 29909 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:08:19.020370 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:19.021024 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:19.024955 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1256) took 1691 ms. Trace:
I20260709 13:08:19.024868 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:19.032055 26687 rpcz_store.cc:276] 0709 13:08:17.333917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.017218 (+1683301us) service_pool.cc:224] Handling call
0709 13:08:19.017513 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.024673 (+  7160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.024893 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.019737 26680 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:19.033866 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1257) took 1695 ms. Trace:
I20260709 13:08:19.034389 26680 rpcz_store.cc:276] 0709 13:08:17.338615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.017777 (+1679162us) service_pool.cc:224] Handling call
0709 13:08:19.018048 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.033400 (+ 15352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.033786 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.024118 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:19.036652 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1255) took 1708 ms. Trace:
I20260709 13:08:18.937009 29919 tablet_copy_client.cc:323] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:08:19.008599 29938 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:19.037187 26686 rpcz_store.cc:276] 0709 13:08:17.328482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.017145 (+1688663us) service_pool.cc:224] Handling call
0709 13:08:19.036064 (+ 18919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.036254 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.036291 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.036344 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:19.036389 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.036461 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.036587 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.032791 26605 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:18.974119 29917 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:19.038786 26754 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:19.044839 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:19.047291 26603 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:19.023756 29740 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.019968 29922 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:19.036336 26680 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:19.079185 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55146.2us
W20260709 13:08:19.074060 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 167106us
I20260709 13:08:19.083768 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:19.016570 29904 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.012667 29746 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:19.073377 29725 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.003s
I20260709 13:08:19.041817 29938 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:19.008189 29915 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:19.096684 26603 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:08:19.078409 29740 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.073872 29917 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:19.119313 26603 pending_rounds.cc:85] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:08:19.126510 26603 pending_rounds.cc:107] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:19.126919 26603 raft_consensus.cc:2889] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.127811 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2475) took 2302 ms. Trace:
I20260709 13:08:19.106515 29922 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.108404 29938 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:19.137539 29955 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:19.138230 29955 consensus_queue.cc:1243] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:19.139209 29727 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:19.140578 29627 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:19.106880 29825 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:19.121306 29967 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:19.122437 29885 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 2.418s	user 0.004s	sys 0.018s
I20260709 13:08:19.123230 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 293) took 2025 ms. Trace:
I20260709 13:08:19.136296 29922 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.080591 29721 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:19.120349 27320 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:19.246462 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.140959 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:19.213897 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:19.530843 26761 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:19.528039 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 444519us
I20260709 13:08:19.128194 26603 rpcz_store.cc:276] 0709 13:08:16.825569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.050862 (+2225293us) service_pool.cc:224] Handling call
0709 13:08:19.076898 (+ 26036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.127460 (+ 50562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.127738 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.293804 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.533913 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.531177 26679 rpcz_store.cc:276] 0709 13:08:17.097956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.465642 (+1367686us) service_pool.cc:224] Handling call
0709 13:08:18.473765 (+  8123us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:18.484390 (+ 10625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.484442 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:18.491627 (+  7185us) log.cc:844] Serialized 52 byte log entry
0709 13:08:18.842858 (+351231us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:18.842914 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.843007 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.122921 (+279914us) raft_consensus.cc:1685] finished
0709 13:08:19.122950 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.123155 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1927,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12595,"thread_start_us":314348,"threads_started":1,"wal-append.queue_time_us":504371}
I20260709 13:08:19.537070 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:19.128487 29902 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.810s	user 0.014s	sys 0.003s
I20260709 13:08:19.542337 26603 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:19.545137 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1458) took 2708 ms. Trace:
I20260709 13:08:19.545621 26603 rpcz_store.cc:276] 0709 13:08:16.837133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.532580 (+2695447us) service_pool.cc:224] Handling call
0709 13:08:19.532860 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.544876 (+ 12016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.545084 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.534407 29909 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:19.129040 29908 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.547242 29909 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:19.547808 29908 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.548911 29942 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.129931 29917 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.549713 29908 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:19.549461 29942 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:19.549732 29917 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.549475 29909 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:19.292143 29727 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:19.551263 29767 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.826s	user 0.006s	sys 0.000s
I20260709 13:08:19.552541 29727 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.124619 29535 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:19.508625 29963 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:08:19.419713 29961 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:08:19.398344 29956 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:08:19.558636 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 477253us
I20260709 13:08:19.562366 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:19.530979 29922 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.564273 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:19.355121 29954 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:19.140877 29904 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:19.618350 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:19.681955 26756 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:19.141220 29899 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:19.535537 29895 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:19.356005 29746 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:19.528734 29967 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:19.665714 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.679188 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:19.683060 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 120782us
I20260709 13:08:19.696264 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:19.573180 29767 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.559746 29902 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:08:19.688784 29818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.023s	sys 0.047s
W20260709 13:08:19.719950 26680 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.002s
W20260709 13:08:19.698300 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.131261 29940 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:19.697482 26679 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:19.700739 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:19.706691 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:19.732445 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:19.733914 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:19.682438 29908 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:19.747567 26686 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:19.748942 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48292.9us
I20260709 13:08:19.752941 26758 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:08:19.691892 29895 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:19.757220 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:19.700271 29967 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:19.738615 29818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.023s	sys 0.047s
I20260709 13:08:19.688560 29627 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:08:19.715185 29899 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:19.738240 29860 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.752394 29915 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:19.811465 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1443) took 3009 ms. Trace:
I20260709 13:08:19.956043 26606 rpcz_store.cc:276] 0709 13:08:16.801824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.398559 (+1596735us) service_pool.cc:224] Handling call
0709 13:08:19.011958 (+613399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:19.015429 (+  3471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.811200 (+795771us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540003f2d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:19.811390 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352536320}
I20260709 13:08:19.809562 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:19.740000 29962 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:19.762830 29966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.015s	sys 0.022s
I20260709 13:08:19.754705 29968 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:19.982040 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.812705 29933 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.997761 26610 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:19.766947 29965 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:19.999651 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:19.699249 29825 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:20.003036 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.012493 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1460) took 3164 ms. Trace:
I20260709 13:08:20.009044 26681 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:20.012913 26610 rpcz_store.cc:276] 0709 13:08:16.837758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.946980 (+3109222us) service_pool.cc:224] Handling call
0709 13:08:19.997545 (+ 50565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.001757 (+  4212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.001965 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.962822 29962 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:20.016606 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.000243 29852 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.954126 29899 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:20.068094 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.088624 26603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.004s	sys 0.006s
W20260709 13:08:20.089293 26603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.006s
W20260709 13:08:20.104820 26605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.022s
W20260709 13:08:20.105288 26605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.022s
I20260709 13:08:20.105844 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:19.998490 29966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.015s	sys 0.023s
I20260709 13:08:20.113174 26681 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:20.113729 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2512) took 1037 ms. Trace:
I20260709 13:08:20.114066 26681 rpcz_store.cc:276] 0709 13:08:19.075810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.029911 (+954101us) service_pool.cc:224] Handling call
0709 13:08:20.113663 (+ 83752us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.029884 29943 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.038s	sys 0.086s
I20260709 13:08:19.962067 29860 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.028330 29965 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.028764 29962 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.012633 29933 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.142674 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:20.107990 29551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.002s	sys 0.007s
I20260709 13:08:20.060070 29727 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.104077 29767 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:20.118583 29943 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.043s	sys 0.093s
I20260709 13:08:20.007385 29895 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.031910 29852 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.174790 29852 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.175729 26610 raft_consensus.cc:1217] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-8.5]   Dedup: 4.3->[6.4-8.5]
W20260709 13:08:20.176306 29970 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:08:20.176479 26610 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [4.3-8.5]
W20260709 13:08:20.178190 29964 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:08:20.192283 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1260) took 2852 ms. Trace:
I20260709 13:08:20.192902 26687 rpcz_store.cc:276] 0709 13:08:17.339729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.033106 (+1693377us) service_pool.cc:224] Handling call
0709 13:08:19.033502 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.048235 (+ 14733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.048277 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.072328 (+ 24051us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.561158 (+488830us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:19.561198 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.561273 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.191934 (+630661us) raft_consensus.cc:1685] finished
0709 13:08:20.191969 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.192195 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14252,"raft.queue_time_us":23448,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5570,"thread_start_us":449444,"threads_started":1,"wal-append.queue_time_us":722480}
I20260709 13:08:20.197813 29902 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.195269 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:20.164058 29551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.002s	sys 0.007s
I20260709 13:08:20.205921 26687 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:20.214563 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2513) took 1138 ms. Trace:
I20260709 13:08:20.215046 26687 rpcz_store.cc:276] 0709 13:08:19.076086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.194940 (+1118854us) service_pool.cc:224] Handling call
0709 13:08:20.214487 (+ 19547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.216333 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.037s	sys 0.085s
W20260709 13:08:20.216711 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.037s	sys 0.085s
W20260709 13:08:20.220005 26576 connection.cc:256] RPC call timeout handler was delayed by -2.5918528079999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:08:20.220821 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.222375 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2509) took 1147 ms. Trace:
I20260709 13:08:20.222688 26681 rpcz_store.cc:276] 0709 13:08:19.075010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.172297 (+1097287us) service_pool.cc:224] Handling call
0709 13:08:20.222317 (+ 50020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.222970 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:20.223879 26576 connection.cc:256] RPC call timeout handler was delayed by -2.0818165829999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:08:20.224362 26576 connection.cc:256] RPC call timeout handler was delayed by -1.4986621780000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:08:20.204407 29963 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:20.225792 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:20.246779 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.007s
W20260709 13:08:20.248600 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.008s
I20260709 13:08:20.247012 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.254957 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:20.249401 26687 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:20.223739 29721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.006s	sys 0.038s
W20260709 13:08:20.275563 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.267308 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2520) took 1072 ms. Trace:
I20260709 13:08:20.280380 26687 rpcz_store.cc:276] 0709 13:08:19.195252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.221530 (+1026278us) service_pool.cc:224] Handling call
0709 13:08:20.267248 (+ 45718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.269541 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2516) took 1192 ms. Trace:
I20260709 13:08:20.281447 26681 rpcz_store.cc:276] 0709 13:08:19.076837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.223327 (+1146490us) service_pool.cc:224] Handling call
0709 13:08:20.269456 (+ 46129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.282886 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59965us
I20260709 13:08:20.224452 29895 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.221774 29852 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:20.160115 29965 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.288146 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:20.283706 29917 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
W20260709 13:08:20.291695 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65988.5us
I20260709 13:08:20.284253 26687 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:20.269186 29720 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.596s	user 0.010s	sys 0.003s
W20260709 13:08:20.283800 29721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.006s	sys 0.038s
I20260709 13:08:20.313624 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2505) took 1493 ms. Trace:
I20260709 13:08:20.319341 26687 rpcz_store.cc:276] 0709 13:08:18.820514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.281075 (+1460561us) service_pool.cc:224] Handling call
0709 13:08:20.281371 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.313270 (+ 31899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.313547 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.314204 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:20.354907 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.365936 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51813.2us
W20260709 13:08:20.366279 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.383993 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 299) took 2182 ms. Trace:
I20260709 13:08:20.390491 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2477) took 3133 ms. Trace:
I20260709 13:08:20.377198 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1470) took 1677 ms. Trace:
I20260709 13:08:20.423935 26759 rpcz_store.cc:276] 0709 13:08:18.700061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.701398 (+  1337us) service_pool.cc:224] Handling call
0709 13:08:18.701665 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.816378 (+114713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.376887 (+1560509us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400225e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.377112 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262279552}
W20260709 13:08:20.348472 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2470) took 3572 ms (client timeout 4675 ms). Trace:
I20260709 13:08:20.426429 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.381146 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1441) took 3579 ms. Trace:
I20260709 13:08:20.400516 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.429199 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:20.430389 26753 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
W20260709 13:08:20.431080 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1475) took 1728 ms (client timeout 2154 ms). Trace:
W20260709 13:08:20.431898 26753 rpcz_store.cc:269] 0709 13:08:18.703140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.400183 (+1697043us) service_pool.cc:224] Handling call
0709 13:08:20.431023 (+ 30840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.403409 26611 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:20.383348 26607 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:20.391602 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1476) took 1676 ms. Trace:
I20260709 13:08:20.388361 26683 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:20.351804 29977 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.308815 29852 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.308931 29979 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.429188 26612 rpcz_store.cc:276] 0709 13:08:16.801365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.759350 (+957985us) service_pool.cc:224] Handling call
0709 13:08:18.576135 (+816785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.629079 (+ 52944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.380957 (+1751878us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001f5c50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:20.381089 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877437696}
I20260709 13:08:20.318717 29720 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.367727 29965 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.423192 26760 rpcz_store.cc:276] 0709 13:08:18.201392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.201526 (+   134us) service_pool.cc:224] Handling call
0709 13:08:18.201853 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.472646 (+270793us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:18.633648 (+161002us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.942046 (+308398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.942105 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:18.942150 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.383775 (+1441625us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540014ebd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.383819 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.383939 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3726,"prepare.queue_time_us":219053,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":80761,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":19307,"spinlock_wait_cycles":633119360,"thread_start_us":463087,"threads_started":2,"wal-append.queue_time_us":410616}
I20260709 13:08:20.433935 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2484) took 2292 ms. Trace:
I20260709 13:08:20.444998 26611 rpcz_store.cc:276] 0709 13:08:18.141690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.402768 (+2261078us) service_pool.cc:224] Handling call
0709 13:08:20.403056 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.433602 (+ 30546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.433868 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.423357 26608 rpcz_store.cc:276] 0709 13:08:17.256797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.389708 (+3132911us) service_pool.cc:224] Handling call
0709 13:08:20.390005 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.390166 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.390190 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.390247 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.390283 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.390331 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.390434 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.435145 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1468) took 3595 ms. Trace:
W20260709 13:08:20.446394 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.436863 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2480) took 3535 ms. Trace:
I20260709 13:08:20.441992 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2485) took 1731 ms. Trace:
I20260709 13:08:20.447793 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1459) took 3610 ms. Trace:
I20260709 13:08:20.448186 26612 rpcz_store.cc:276] 0709 13:08:18.710359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.441218 (+1730859us) service_pool.cc:224] Handling call
0709 13:08:20.441536 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.441693 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.441721 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.441761 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.441790 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.441841 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.441942 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.436105 26755 rpcz_store.cc:276] 0709 13:08:18.715618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.867630 (+152012us) service_pool.cc:224] Handling call
0709 13:08:18.868011 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.878772 (+ 10761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.391365 (+1512593us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540023afd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.391540 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23385984}
I20260709 13:08:20.448298 26603 rpcz_store.cc:276] 0709 13:08:16.837469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.546453 (+2708984us) service_pool.cc:224] Handling call
0709 13:08:19.546769 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.550347 (+  3578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.550377 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.550830 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.089744 (+538914us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:20.295897 (+206153us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.447432 (+151535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.447513 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.447558 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:20.447570 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.447737 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12004,"prepare.queue_time_us":272470,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":92,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":821705,"threads_started":3,"wal-append.queue_time_us":727969}
W20260709 13:08:20.426208 26609 rpcz_store.cc:269] 0709 13:08:16.776204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.779309 (+  3105us) service_pool.cc:224] Handling call
0709 13:08:20.342835 (+3563526us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540003e8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:20.348379 (+  5544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375211904}
I20260709 13:08:20.447561 26683 rpcz_store.cc:276] 0709 13:08:16.901414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.905819 (+  4405us) service_pool.cc:224] Handling call
0709 13:08:20.387978 (+3482159us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:08:20.388174 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.436524 (+ 48350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.436793 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3370752}
I20260709 13:08:20.446231 26607 rpcz_store.cc:276] 0709 13:08:16.840058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.382879 (+3542821us) service_pool.cc:224] Handling call
0709 13:08:20.383179 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.434860 (+ 51681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.435084 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.381522 29946 consensus_meta.cc:287] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.514s	user 0.006s	sys 0.006s
W20260709 13:08:20.385463 29938 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.249s	user 0.009s	sys 0.000s
I20260709 13:08:20.315850 29737 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.348431 29727 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.386284 29860 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:20.440811 29908 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 13:08:20.318946 29917 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.388033 29899 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.376637 29933 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.366777 26509 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:20.403442 29922 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.715s	user 0.003s	sys 0.005s
I20260709 13:08:20.382355 29788 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.437042 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:20.483850 26759 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.367075 29986 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:20.324158 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.678s (SENT) [suppressed 27 similar messages]
W20260709 13:08:20.485550 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 161401us
I20260709 13:08:20.486244 26681 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:20.473529 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:20.459918 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1457) took 3637 ms. Trace:
I20260709 13:08:20.424407 29891 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.380511 29942 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.474047 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:20.441780 29852 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.442768 29984 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.477941 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.375905 29981 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:20.397284 29936 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.503909 29981 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:20.367802 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55210.3us
I20260709 13:08:20.504556 29981 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:20.476917 29727 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.508100 29917 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.440232 29977 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.479882 29908 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:20.433243 29968 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:20.473964 29740 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.332s	user 0.010s	sys 0.002s
I20260709 13:08:20.442553 29720 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.343544 26606 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:20.471753 29737 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.486896 26605 rpcz_store.cc:276] 0709 13:08:16.822991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.049907 (+2226916us) service_pool.cc:224] Handling call
0709 13:08:19.082471 (+ 32564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.217439 (+134968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.217485 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.292174 (+ 74689us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.105696 (+813522us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.310622 (+204926us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.459573 (+148951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.459645 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.459717 (+    72us) raft_consensus.cc:1685] finished
0709 13:08:20.459728 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.459859 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45671,"prepare.queue_time_us":285474,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":199698,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":899061,"threads_started":3,"wal-append.queue_time_us":664201}
I20260709 13:08:20.321514 29563 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.492282 26679 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:20.473224 29946 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.495123 26760 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:20.496006 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.497252 29721 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.495075 29891 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.440039 29976 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:20.480418 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.490321 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.471585 29938 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:20.520185 27320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 426) took 2021 ms (client timeout 1747 ms). Trace:
W20260709 13:08:20.723956 27320 rpcz_store.cc:269] 0709 13:08:18.498409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.498533 (+   124us) service_pool.cc:224] Handling call
0709 13:08:20.519880 (+2021347us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:20.520045 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398480128}
I20260709 13:08:20.715608 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1263) took 3067 ms. Trace:
W20260709 13:08:20.636435 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.661984 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 133659us
W20260709 13:08:20.683771 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 194649us
I20260709 13:08:20.692667 26683 raft_consensus.cc:2410] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:08:20.724933 26680 rpcz_store.cc:276] 0709 13:08:17.648249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.035443 (+1387194us) service_pool.cc:224] Handling call
0709 13:08:19.035881 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.036169 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:19.720553 (+684384us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.513541 (+792988us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b180042f940. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf 00007f40f32aa038
0709 13:08:20.714768 (+201227us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.715128 (+   360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.715208 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.715276 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.715366 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.715527 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95287,"raft.queue_time_us":59460,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7514,"spinlock_wait_cycles":2104576,"thread_start_us":729184,"threads_started":2,"wal-append.queue_time_us":641805}
I20260709 13:08:20.727084 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:20.604499 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.524343 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.509502 29986 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:20.526105 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 292) took 5627 ms. Trace:
I20260709 13:08:20.723268 26759 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:20.729121 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1205) took 1061 ms. Trace:
I20260709 13:08:20.729648 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1206) took 1046 ms. Trace:
I20260709 13:08:20.729872 26753 rpcz_store.cc:276] 0709 13:08:19.667915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.462098 (+794183us) service_pool.cc:224] Handling call
0709 13:08:20.729063 (+266965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.729980 26759 rpcz_store.cc:276] 0709 13:08:19.683037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.490088 (+807051us) service_pool.cc:224] Handling call
0709 13:08:20.729595 (+239507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.731176 26752 rpcz_store.cc:276] 0709 13:08:14.898512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.012367 (+113855us) service_pool.cc:224] Handling call
0709 13:08:15.034404 (+ 22037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.694770 (+3660366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.525805 (+1831035us) spinlock_profiling.cc:243] Waited 3.66 s on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.526011 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8409547008}
I20260709 13:08:20.731753 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:20.732848 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:20.729136 26678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2484) took 3826 ms (client timeout 2249 ms). Trace:
W20260709 13:08:20.734242 26678 rpcz_store.cc:269] 0709 13:08:16.902487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.902596 (+   109us) service_pool.cc:224] Handling call
0709 13:08:20.524153 (+3621557us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:20.729046 (+204893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20890880}
I20260709 13:08:20.729493 29852 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.713181 29737 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.736843 29852 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.739028 29852 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:20.531250 29967 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 13:08:20.740717 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.741044 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.741946 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:20.743597 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.744275 26678 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:20.508854 29860 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.482882 29922 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.747025 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.747095 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.746018 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1209) took 1042 ms. Trace:
I20260709 13:08:20.747848 26760 rpcz_store.cc:276] 0709 13:08:19.704104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.721878 (+1017774us) service_pool.cc:224] Handling call
0709 13:08:20.745960 (+ 24082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.748375 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:20.722592 29721 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.750155 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.752100 26678 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:20.494890 29984 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:20.742067 29917 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:20.744187 29967 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.752975 29852 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:20.765133 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:20.739850 29988 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.755916 29886 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:20.756624 29908 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:20.757629 29914 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 2.779s	user 0.018s	sys 0.020s
I20260709 13:08:20.787590 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.757629 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:20.759809 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.753535 29993 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:20.766116 26678 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:20.524550 29551 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.225s
I20260709 13:08:20.772400 26756 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.764355 29917 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:20.791316 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.772068 29727 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.800441 26761 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.800879 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1203) took 1139 ms. Trace:
I20260709 13:08:20.801285 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.802148 26761 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:20.717177 29740 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.778193 29967 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.779040 26753 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.782060 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1246) took 3457 ms. Trace:
I20260709 13:08:20.751417 29936 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:20.762553 29721 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:20.802784 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45261us
I20260709 13:08:20.760970 29860 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.801326 26760 rpcz_store.cc:276] 0709 13:08:19.661137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.764870 (+1103733us) service_pool.cc:224] Handling call
0709 13:08:20.800823 (+ 35953us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.806821 26684 rpcz_store.cc:276] 0709 13:08:17.324700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.680186 (+1355486us) service_pool.cc:224] Handling call
0709 13:08:18.713512 (+ 33326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.772310 (+ 58798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.781833 (+2009523us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54000c49d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:20.781992 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76045568}
W20260709 13:08:20.806938 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48709.6us
W20260709 13:08:20.809808 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.764600 29984 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.773698 29852 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.835160 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 297) took 1961 ms. Trace:
I20260709 13:08:20.837654 26752 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.838438 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:20.836881 26684 rpcz_store.cc:276] 0709 13:08:18.874033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.833801 (+1959768us) service_pool.cc:224] Handling call
0709 13:08:20.834081 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.834271 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.834295 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.834340 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:20.834389 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.834482 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.835105 (+   623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.840144 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:20.841668 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:20.825861 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.805800 29992 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:20.784662 29988 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.839020 26682 raft_consensus.cc:2376] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8. Re-sending same reply.
I20260709 13:08:20.808495 29908 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:20.846231 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 98893.5us
W20260709 13:08:20.846660 26682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2481) took 3945 ms (client timeout 1948 ms). Trace:
I20260709 13:08:20.847523 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.850841 26760 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:20.819403 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:20.850008 26682 rpcz_store.cc:269] 0709 13:08:16.901691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.905752 (+  4061us) service_pool.cc:224] Handling call
0709 13:08:20.838295 (+3932543us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:20.846592 (+  8297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21442944}
I20260709 13:08:20.851573 26607 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:20.853010 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:20.853566 26761 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:20.853621 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:20.855978 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:20.858484 26607 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:20.849593 29962 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.004s
I20260709 13:08:20.860419 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:20.861581 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:20.863415 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:20.864148 26605 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:20.835246 29828 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:20.848502 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 406) took 4138 ms. Trace:
I20260709 13:08:20.848948 29908 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:20.838101 29563 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:08:20.873380 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.874646 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.875882 26760 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:20.877624 26761 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:20.878535 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 368) took 4625 ms. Trace:
I20260709 13:08:20.814481 29968 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.871346 27313 rpcz_store.cc:276] 0709 13:08:16.710073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.710683 (+   610us) service_pool.cc:224] Handling call
0709 13:08:16.736275 (+ 25592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.858214 (+121939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.859469 (+  1255us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.912946 (+ 53477us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.338381 (+425435us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:17.338436 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.338512 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.757104 (+3418592us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:20.811286 (+ 54182us) raft_consensus.cc:1685] finished
0709 13:08:20.832399 (+ 21113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.848422 (+ 16023us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2427,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":22154624,"thread_start_us":461781,"threads_started":2,"wal-append.queue_time_us":740055}
I20260709 13:08:20.881418 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.881942 29909 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:20.882417 29909 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:20.883245 29909 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:20.884284 29909 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.883214 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:20.888447 29996 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:20.888577 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2506) took 2067 ms. Trace:
I20260709 13:08:20.878901 27315 rpcz_store.cc:276] 0709 13:08:16.248414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.248630 (+   216us) service_pool.cc:224] Handling call
0709 13:08:16.252153 (+  3523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.158565 (+906412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.873820 (+3715255us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54004268d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.873988 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422755200}
I20260709 13:08:20.891079 26681 rpcz_store.cc:276] 0709 13:08:18.820786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.282173 (+1461387us) service_pool.cc:224] Handling call
0709 13:08:20.307648 (+ 25475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.486608 (+178960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.888338 (+401730us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001e96d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:20.888519 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410881152}
I20260709 13:08:20.889725 26760 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:20.890216 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:20.793394 29986 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:20.898406 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.872159 29989 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:20.922534 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.954567 26761 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:20.950461 29891 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.876317 29908 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:20.958184 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2507) took 2116 ms. Trace:
I20260709 13:08:20.898759 29997 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:20.959447 29988 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.898300 29946 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.904464 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1482) took 2010 ms. Trace:
I20260709 13:08:20.867498 29962 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.967782 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.809672 29917 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:20.972113 26760 rpcz_store.cc:276] 0709 13:08:18.894371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.882954 (+1988583us) service_pool.cc:224] Handling call
0709 13:08:20.904364 (+ 21410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.973928 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.955268 29977 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:20.966460 29922 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.981561 26761 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:20.953800 29989 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:20.982726 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:21.041729 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2519) took 1936 ms. Trace:
I20260709 13:08:21.042862 26760 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:20.952000 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 110429us
I20260709 13:08:20.967419 26678 rpcz_store.cc:276] 0709 13:08:18.842079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.800290 (+1958211us) service_pool.cc:224] Handling call
0709 13:08:20.804343 (+  4053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.804670 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.804698 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.809309 (+  4611us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.901389 (+ 92080us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.901448 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.901545 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.957939 (+ 56394us) raft_consensus.cc:1685] finished
0709 13:08:20.957963 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.958119 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1920,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":2142,"thread_start_us":51374,"threads_started":1,"wal-append.queue_time_us":119610}
I20260709 13:08:20.992026 29740 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:21.042511 26684 rpcz_store.cc:276] 0709 13:08:19.131470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.849903 (+1718433us) service_pool.cc:224] Handling call
0709 13:08:20.850215 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.854334 (+  4119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.854364 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.860990 (+  6626us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.941386 (+ 80396us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:20.969688 (+ 28302us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.969958 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.970039 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.040777 (+ 70738us) raft_consensus.cc:1685] finished
0709 13:08:21.040832 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.041356 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28798,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":8382,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":5248,"thread_start_us":83504,"threads_started":2,"wal-append.queue_time_us":113100}
I20260709 13:08:20.984498 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:20.986027 29917 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:20.969780 29984 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.068277 26759 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:21.068883 29984 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:21.002547 29962 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:20.990221 29981 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.072924 29981 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:20.984998 29989 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.074826 26761 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:21.080775 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1486) took 1619 ms. Trace:
I20260709 13:08:21.062472 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:20.991626 29737 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.082504 29986 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:21.087788 26761 rpcz_store.cc:276] 0709 13:08:19.461097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.984242 (+1523145us) service_pool.cc:224] Handling call
0709 13:08:21.080597 (+ 96355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.090363 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.094450 29986 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:21.096361 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:21.109972 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1207) took 1418 ms. Trace:
I20260709 13:08:21.110405 26761 rpcz_store.cc:276] 0709 13:08:19.691166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.089586 (+1398420us) service_pool.cc:224] Handling call
0709 13:08:21.109874 (+ 20288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.111899 29737 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:21.114866 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:21.130396 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1464) took 4291 ms. Trace:
I20260709 13:08:21.137451 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1465) took 4298 ms. Trace:
I20260709 13:08:21.138120 26610 rpcz_store.cc:276] 0709 13:08:16.839061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.026767 (+3187706us) service_pool.cc:224] Handling call
0709 13:08:20.057720 (+ 30953us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:20.177035 (+119315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.136719 (+959684us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000203d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:21.137245 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270622976}
W20260709 13:08:21.140385 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44244.4us
I20260709 13:08:21.141481 30001 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:21.142078 30001 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:21.142140 26679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2510) took 2066 ms (client timeout 2042 ms). Trace:
I20260709 13:08:21.142628 30001 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.140520 29986 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:21.144228 29986 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:21.150192 29986 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.150868 29989 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.152397 29986 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.131011 26606 rpcz_store.cc:276] 0709 13:08:16.838827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.957269 (+3118442us) service_pool.cc:224] Handling call
0709 13:08:20.342987 (+385718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.692557 (+349570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.129863 (+437306us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540003e8d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.130129 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783446784}
I20260709 13:08:21.157117 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1216) took 1141 ms. Trace:
I20260709 13:08:21.159809 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1464) took 2518 ms. Trace:
I20260709 13:08:21.160451 26760 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:21.162815 26755 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:21.164650 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2494) took 2346 ms. Trace:
W20260709 13:08:21.173094 26756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1204) took 1508 ms (client timeout 1777 ms). Trace:
I20260709 13:08:21.176717 29908 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.181763 29843 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.186729 29881 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.189073 29884 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.190593 29850 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:21.192876 29852 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.194547 29860 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.367919 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2479) took 4108 ms. Trace:
W20260709 13:08:21.290640 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.195626 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.204457 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.428435 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.317150 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.142717 26679 rpcz_store.cc:269] 0709 13:08:19.075300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.733633 (+658333us) service_pool.cc:224] Handling call
0709 13:08:21.141647 (+1408014us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54000b5254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.141947 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732317440}
W20260709 13:08:21.385401 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1480) took 2491 ms (client timeout 2895 ms). Trace:
W20260709 13:08:21.444521 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.413498 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.345255 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1463) took 2704 ms. Trace:
I20260709 13:08:21.442420 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:21.199075 26650 connection.cc:256] RPC call timeout handler was delayed by -2.4548001619999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:08:21.462181 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.403683 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1264) took 3670 ms (client timeout 1880 ms). Trace:
W20260709 13:08:21.418740 30012 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
W20260709 13:08:21.372805 29925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.744s	user 0.000s	sys 0.035s
I20260709 13:08:21.434248 29976 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:21.645851 26577 connection.cc:256] RPC call timeout handler was delayed by -2.4688657100000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:08:21.438699 30011 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:08:21.325371 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 360393us
W20260709 13:08:21.641173 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.652352 26577 connection.cc:256] RPC call timeout handler was delayed by -2.3761657100000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:08:21.654383 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 212329us
I20260709 13:08:21.618407 26686 rpcz_store.cc:276] 0709 13:08:18.817687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.050570 (+232883us) service_pool.cc:224] Handling call
0709 13:08:19.102459 (+ 51889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.748137 (+645678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.164138 (+1416001us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54000c4ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:21.164435 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483062144}
I20260709 13:08:21.620460 26753 rpcz_store.cc:276] 0709 13:08:20.016038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.730845 (+714807us) service_pool.cc:224] Handling call
0709 13:08:21.156639 (+425794us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54000da7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.156893 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71110528}
W20260709 13:08:21.402783 26752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1490) took 1884 ms (client timeout 2294 ms). Trace:
W20260709 13:08:21.301697 29958 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:08:21.619282 26754 rpcz_store.cc:276] 0709 13:08:18.640758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.640899 (+   141us) service_pool.cc:224] Handling call
0709 13:08:18.658741 (+ 17842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.045766 (+387025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.159193 (+2113427us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540023b4d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:21.159548 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873349504}
I20260709 13:08:21.626900 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1479) took 2724 ms. Trace:
I20260709 13:08:21.344614 29993 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:21.411486 27284 connection.cc:256] RPC call timeout handler was delayed by -3.2571737800000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:08:21.630875 26685 rpcz_store.cc:269] 0709 13:08:17.732963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.232782 (+499819us) service_pool.cc:224] Handling call
0709 13:08:21.403122 (+3170340us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001225d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.403421 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515104512}
I20260709 13:08:21.331447 29910 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:21.655831 26577 connection.cc:256] RPC call timeout handler was delayed by -2.3707657100000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:08:21.664004 26577 connection.cc:256] RPC call timeout handler was delayed by -2.3203657100000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:08:21.664412 26577 connection.cc:256] RPC call timeout handler was delayed by -2.2780657099999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:08:21.664752 26577 connection.cc:256] RPC call timeout handler was delayed by -2.1898657100000491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:08:21.665076 26577 connection.cc:256] RPC call timeout handler was delayed by -2.107065710000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:08:21.618923 26756 rpcz_store.cc:269] 0709 13:08:19.664071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.996722 (+332651us) service_pool.cc:224] Handling call
0709 13:08:21.172503 (+1175781us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000b9ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.172827 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715600128}
W20260709 13:08:21.656687 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.532382 29981 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.632721 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1497) took 1098 ms. Trace:
W20260709 13:08:21.627107 26759 rpcz_store.cc:269] 0709 13:08:18.893654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.740464 (+1846810us) service_pool.cc:224] Handling call
0709 13:08:21.385037 (+644573us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400081954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.385300 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750753536}
I20260709 13:08:21.629842 26758 rpcz_store.cc:276] 0709 13:08:18.640365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.640811 (+   446us) service_pool.cc:224] Handling call
0709 13:08:18.641094 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.754094 (+1113000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.344631 (+1590537us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400082d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:21.345059 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556299520}
W20260709 13:08:21.660491 27284 connection.cc:256] RPC call timeout handler was delayed by -3.2270094630000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:08:21.662508 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.656644 26752 rpcz_store.cc:269] 0709 13:08:19.518396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.732133 (+1213737us) service_pool.cc:224] Handling call
0709 13:08:21.402267 (+670134us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400083254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.402567 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206277504}
W20260709 13:08:21.653571 29925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.031s	user 0.000s	sys 0.043s
I20260709 13:08:21.426822 29938 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:21.672464 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.195220 30001 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:21.666339 30013 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:08:21.669137 29917 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:21.669603 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:21.670543 30015 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:21.660882 29979 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.655229 29980 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:21.624068 26604 rpcz_store.cc:276] 0709 13:08:17.259702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.398087 (+3138385us) service_pool.cc:224] Handling call
0709 13:08:20.435305 (+ 37218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.475862 (+ 40557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.475890 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.484532 (+  8642us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.729468 (+244936us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.729508 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.729568 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.038171 (+308603us) raft_consensus.cc:1685] finished
0709 13:08:21.038246 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.346427 (+308181us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b540017be50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:21.367659 (+ 21232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18565,"raft.queue_time_us":73602,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":18604,"spinlock_wait_cycles":84664064,"thread_start_us":93357,"threads_started":2,"wal-append.queue_time_us":289415}
I20260709 13:08:21.428479 29912 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:21.198871 29721 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.667193 26760 rpcz_store.cc:276] 0709 13:08:20.534246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.982031 (+447785us) service_pool.cc:224] Handling call
0709 13:08:21.625215 (+643184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.200651 29921 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:21.637679 29850 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:21.652200 29976 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:21.659369 26755 rpcz_store.cc:276] 0709 13:08:18.893236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.161790 (+2268554us) service_pool.cc:224] Handling call
0709 13:08:21.162363 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.617289 (+454926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.617533 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.676369 29909 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:21.430100 29659 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.252s
I20260709 13:08:21.421937 29947 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.657332 29886 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:21.672968 27284 connection.cc:256] RPC call timeout handler was delayed by -2.7199005880000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:08:21.703687 27284 connection.cc:256] RPC call timeout handler was delayed by -2.4260044830000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:08:21.703563 29912 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:21.704355 27284 connection.cc:256] RPC call timeout handler was delayed by -1.884724537000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3058s for a response
I20260709 13:08:21.703774 29886 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.432523 29743 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.231s
I20260709 13:08:21.660288 29993 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:21.706008 29912 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.706434 29886 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.706074 29993 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.706897 29990 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.707499 29990 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.708179 29940 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:21.708624 29940 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:21.709887 29990 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.709641 29940 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.710697 29940 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.712239 29886 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:21.712885 29886 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.715215 29886 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.719903 29976 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.721263 29976 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.699697 29909 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.726712 29909 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.730207 29987 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.686730 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.731698 26759 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:21.731318 29987 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.733503 26759 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.734289 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1210) took 1994 ms. Trace:
I20260709 13:08:21.686318 29979 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.735083 29987 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.736971 29987 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:21.694269 29980 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.740091 29980 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.695981 29917 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.742671 29917 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.702546 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.677306 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:21.697417 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.655498 29884 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:21.697866 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:21.730391 29852 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.734665 26759 rpcz_store.cc:276] 0709 13:08:19.740352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.732624 (+1992272us) service_pool.cc:224] Handling call
0709 13:08:21.733146 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.733998 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.734199 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:21.736186 26575 connection.cc:256] RPC call timeout handler was delayed by -2.5230551209999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:08:21.736336 26760 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.737039 29979 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:21.675012 26650 leader_election.cc:336] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.845s (SENT)
W20260709 13:08:21.675546 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.457479 26509 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.698625 29921 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:21.747939 26753 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:21.749014 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:21.755097 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77932.3us
I20260709 13:08:21.753130 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.758023 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1488) took 2236 ms. Trace:
W20260709 13:08:21.758314 26575 connection.cc:256] RPC call timeout handler was delayed by -2.1309748309998895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 13:08:21.758852 26760 rpcz_store.cc:276] 0709 13:08:19.517811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.701486 (+2183675us) service_pool.cc:224] Handling call
0709 13:08:21.736037 (+ 34551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.753977 (+ 17940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.754235 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.760200 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:21.761317 26760 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:21.761600 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 94680.1us
I20260709 13:08:21.762045 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1214) took 1814 ms. Trace:
W20260709 13:08:21.762352 26650 leader_election.cc:336] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.855s (SENT)
I20260709 13:08:21.762431 26760 rpcz_store.cc:276] 0709 13:08:19.947186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.760430 (+1813244us) service_pool.cc:224] Handling call
0709 13:08:21.760862 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.761747 (+   885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.761966 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.762897 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:21.763104 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 426904us
I20260709 13:08:21.725308 29908 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:21.749145 29884 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:21.770069 26575 connection.cc:256] RPC call timeout handler was delayed by -2.0406551209999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 13:08:21.743759 29987 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:21.774868 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.782428 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 114412us
W20260709 13:08:21.786033 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81138.3us
I20260709 13:08:21.790176 26756 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:21.792971 26753 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:21.793718 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1212) took 2038 ms. Trace:
I20260709 13:08:21.794080 26753 rpcz_store.cc:276] 0709 13:08:19.755022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.768326 (+2013304us) service_pool.cc:224] Handling call
0709 13:08:21.792748 (+ 24422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.793461 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.793648 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.772333 29884 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.787706 30020 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:21.801542 26760 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:21.809067 26755 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:21.810176 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:21.796377 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.804476 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1495) took 1343 ms. Trace:
I20260709 13:08:21.813735 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1208) took 2111 ms. Trace:
I20260709 13:08:21.813917 26760 rpcz_store.cc:276] 0709 13:08:20.460802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.763581 (+1302779us) service_pool.cc:224] Handling call
0709 13:08:21.773288 (+  9707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.804206 (+ 30918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.804418 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.800562 29938 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:21.814121 26755 rpcz_store.cc:276] 0709 13:08:19.697936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.747392 (+2049456us) service_pool.cc:224] Handling call
0709 13:08:21.783831 (+ 36439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.809471 (+ 25640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.809603 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.811177 26759 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:21.814931 29909 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.802716 29917 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.788290 29979 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:21.795315 29925 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.820399 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1477) took 3041 ms. Trace:
I20260709 13:08:21.821792 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1211) took 2075 ms. Trace:
I20260709 13:08:21.823851 26759 rpcz_store.cc:276] 0709 13:08:19.746735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.754759 (+2008024us) service_pool.cc:224] Handling call
0709 13:08:21.800806 (+ 46047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.819330 (+ 18524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.821720 (+  2390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.824433 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:21.824971 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:21.824743 29909 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.825388 29912 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:21.828265 29721 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.828356 26756 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:21.829164 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1499) took 1044 ms. Trace:
I20260709 13:08:21.780989 29852 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.829881 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.829603 29917 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.830560 26608 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:21.827338 29909 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.829493 26756 rpcz_store.cc:276] 0709 13:08:20.785179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.811614 (+1026435us) service_pool.cc:224] Handling call
0709 13:08:21.828072 (+ 16458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.828891 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.829092 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.825202 26759 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.817431 29947 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:21.836587 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:21.813270 26509 catalog_manager.cc:5697] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 1 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 5 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.820736 29938 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:21.823479 26761 rpcz_store.cc:276] 0709 13:08:18.779034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.111165 (+2332131us) service_pool.cc:224] Handling call
0709 13:08:21.111718 (+   553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.113187 (+  1469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.113223 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:21.119268 (+  6045us) log.cc:844] Serialized 52 byte log entry
0709 13:08:21.305337 (+186069us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.417724 (+112387us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:21.522709 (+104985us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.531552 (+  8843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.538186 (+  6634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.816636 (+278450us) raft_consensus.cc:1685] finished
0709 13:08:21.820202 (+  3566us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.820336 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":361328,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":9032,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":6595,"spinlock_wait_cycles":40824192,"thread_start_us":402194,"threads_started":2,"wal-append.queue_time_us":185932}
I20260709 13:08:21.791630 29886 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:08:21.848245 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.834903 29989 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.835808 29852 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.851189 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1485) took 2877 ms. Trace:
I20260709 13:08:21.858637 29940 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:21.852710 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.840883 29912 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:21.840930 29947 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.876024 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:21.877748 26686 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:21.843724 29938 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.878108 26509 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.878556 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.879822 29912 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.865453 26757 rpcz_store.cc:276] 0709 13:08:18.895573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.167947 (+2272374us) service_pool.cc:224] Handling call
0709 13:08:21.168587 (+   640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.169118 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:21.633788 (+464670us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.760150 (+126362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.760202 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:21.767858 (+  7656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.767943 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.772824 (+  4881us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":468844,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":25692,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2366,"thread_start_us":552053,"threads_started":2,"wal-append.queue_time_us":132938}
I20260709 13:08:21.884582 26681 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:08:21.884472 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.885366 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.885905 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:21.886399 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.906894 26650 connection.cc:256] RPC call timeout handler was delayed by -2.1632001619999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:08:21.907451 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2537573880000537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:08:21.886260 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.909121 26683 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.887135 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.887809 29987 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:21.887946 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.888616 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:21.888749 29921 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.889616 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.889796 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.896469 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.896957 29979 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.915304 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.878530 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:21.874380 26726 connection.cc:256] RPC call timeout handler was delayed by -1.1624979939999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:08:21.899863 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1496) took 1427 ms. Trace:
I20260709 13:08:21.916460 26754 rpcz_store.cc:276] 0709 13:08:20.472276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.801574 (+1329298us) service_pool.cc:224] Handling call
0709 13:08:21.841501 (+ 39927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.899533 (+ 58032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.899562 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.899605 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:21.899644 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.899716 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.899809 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.905826 26681 pending_rounds.cc:85] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:21.870973 29917 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:21.915336 27285 connection.cc:256] RPC call timeout handler was delayed by -2.4090828549999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:08:21.913262 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:21.903167 29947 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.894897 29884 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.923487 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:21.924803 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1222) took 1028 ms. Trace:
W20260709 13:08:21.996044 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 186267us
I20260709 13:08:21.925673 26684 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.912479 29860 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:21.990831 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:21.925428 26678 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:21.985109 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 120432us
I20260709 13:08:22.209867 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.098582 29940 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:22.119602 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.990686 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.131925 29909 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:21.985821 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.211246 29909 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:22.211593 26685 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:22.212275 29940 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:22.212507 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.212757 29940 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:22.213204 26685 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:22.213372 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.213757 29940 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:21.916652 29850 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.006244 26509 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 3 to 5, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:22.215340 26752 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:22.215885 26509 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:22.216739 26752 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:22.216940 29850 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:22.018263 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.217921 26752 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:22.218535 27321 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:22.110728 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.219806 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.999804 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.220934 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:22.221218 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.221535 26682 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.000213 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.223081 26611 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:08:22.224216 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.224931 26611 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:22.225325 30026 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:22.225862 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:22.089916 27286 connection.cc:256] RPC call timeout handler was delayed by -2.9825923410000996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:08:22.227335 27286 connection.cc:256] RPC call timeout handler was delayed by -2.7009068340000795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:08:22.143491 26760 rpcz_store.cc:276] 0709 13:08:20.896264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.819633 (+923369us) service_pool.cc:224] Handling call
0709 13:08:21.844466 (+ 24833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.879276 (+ 34810us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:21.879643 (+   367us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.924336 (+ 44693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.924413 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:21.924472 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.924562 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.924729 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4386,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":5804,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":43896,"thread_start_us":38332,"threads_started":1,"wal-append.queue_time_us":219270}
I20260709 13:08:22.227252 29909 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:22.229004 29909 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:21.970170 26759 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:22.231312 26759 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:21.988930 27285 connection.cc:256] RPC call timeout handler was delayed by -1.4718719400000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 13:08:22.233335 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:22.233603 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.233964 27321 raft_consensus.cc:2376] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7. Re-sending same reply.
I20260709 13:08:22.234136 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:22.234493 27318 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:21.974956 26608 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:08:21.973800 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51279.6us
I20260709 13:08:22.017580 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:21.849285 30020 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:21.998245 30024 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:21.995026 29976 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:21.991259 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.920320 29925 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:08:21.999178 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.008618 29921 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.928869 26755 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:21.994256 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 88756.7us
I20260709 13:08:22.242726 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:21.993088 29993 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.917714 26681 pending_rounds.cc:107] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:08:21.946787 26756 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:22.257025 26681 raft_consensus.cc:2889] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.997467 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.258076 26603 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:08:21.991515 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 168978us
I20260709 13:08:21.990983 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:21.929322 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:22.258821 26604 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.996178 30021 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:08:22.151876 30029 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.134554 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.173161 29884 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:22.192687 26683 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:22.201534 29886 consensus_queue.cc:1243] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:22.203354 29938 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.287171 29938 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:21.926327 26761 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:22.097762 26506 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 212) took 31432 ms (client timeout 15000 ms). Trace:
I20260709 13:08:21.961912 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.992262 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:21.961249 26680 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.972916 26687 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.949232 26754 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.990846 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:21.912554 30001 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:22.214190 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.017153 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.091068 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:22.214217 26609 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:22.236099 26684 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:22.217315 26509 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 4 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 6 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:22.243279 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.252034 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:21.948359 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.254323 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1223) took 1356 ms. Trace:
I20260709 13:08:22.309801 26755 rpcz_store.cc:276] 0709 13:08:20.898148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.821548 (+923400us) service_pool.cc:224] Handling call
0709 13:08:21.870545 (+ 48997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.254000 (+383455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.254265 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:22.254236 26610 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:22.255448 29925 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:22.139243 29843 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 13:08:22.263031 26682 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.279891 27317 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:22.288137 29940 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.288585 29976 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:21.988273 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.292294 29981 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.292150 30029 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.294265 27314 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:22.295092 29886 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.296240 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:22.296705 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.256076 30024 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.297199 29850 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:22.299918 29979 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:22.339947 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:22.301891 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:22.296741 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49700.9us
I20260709 13:08:22.272060 27313 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.297209 29947 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:22.321765 27286 connection.cc:256] RPC call timeout handler was delayed by -1.8572356020000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:08:22.344221 27286 connection.cc:256] RPC call timeout handler was delayed by -1.4913068340000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3058s for a response
I20260709 13:08:22.322376 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.307272 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:22.326627 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.326736 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88350.2us
I20260709 13:08:22.327214 26758 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
I20260709 13:08:22.308916 26509 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:22.326808 26612 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:22.326823 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:22.345459 26686 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:22.329766 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.330358 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.332054 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.332724 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.334573 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.335335 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.336086 26757 raft_consensus.cc:2368] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:22.319878 29925 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:22.339504 26608 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.301079 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:22.342104 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46001.9us
I20260709 13:08:22.343143 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.329147 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.347159 29843 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.347735 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.346349 26682 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:22.349851 26685 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:22.349154 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64922.9us
I20260709 13:08:22.350382 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.351518 26683 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.351771 26509 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index -1 to 2, term changed from 2 to 4, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to <none>, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added, no longer has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:08:22.354744 26509 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 3 to 5, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:22.355832 29860 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.356277 29860 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.356639 29860 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.357412 26509 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 3 to 6, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 6 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.359812 29886 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.359781 26509 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 reported cstate change: leader changed from <none> to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 3 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:22.361878 30024 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.362273 29886 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.361814 26509 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:22.363936 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.364710 26606 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.364960 30023 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:22.366484 30023 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:22.367141 29947 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:22.365226 30020 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.367794 26609 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:22.368599 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.368794 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.369266 26612 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:22.369472 26609 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.370134 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.371156 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:22.371814 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.371950 30020 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:22.372133 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 87052.5us
I20260709 13:08:22.373035 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:22.373826 30020 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:22.374320 30020 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:22.375205 30020 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.375481 29917 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:22.376217 29955 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.376644 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.377779 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.355890 29938 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.379891 26681 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:22.363996 30029 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.392253 26608 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.388598 26683 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:22.355779 30034 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.389345 30028 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:22.349915 29843 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:22.390242 29881 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.390242 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.396723 26607 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.393936 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.398564 26683 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:22.398115 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:22.304816 26506 rpcz_store.cc:269] 0709 13:07:50.665100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.665375 (+   275us) service_pool.cc:224] Handling call
0709 13:08:22.095796 (+31430421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:11.002614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:11.003609 (+   995us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:11.003688 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:08:11.003729 (+    41us) tablet.cc:662] Decoding operations
0709 13:08:11.005545 (+  1816us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:11.005625 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:11.005652 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:11.007388 (+  1736us) tablet.cc:701] Row locks acquired
0709 13:08:11.007451 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:08:11.020504 (+ 13053us) write_op.cc:270] Start()
0709 13:08:11.020699 (+   195us) write_op.cc:276] Timestamp: P: 1783602491007619 usec, L: 0
0709 13:08:11.020742 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:08:11.022022 (+  1280us) log.cc:844] Serialized 6034 byte log entry
0709 13:08:11.640508 (+618486us) op_driver.cc:464] REPLICATION: finished
0709 13:08:11.719310 (+ 78802us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f6cc6ef0
0709 13:08:12.179584 (+460274us) write_op.cc:301] APPLY: starting
0709 13:08:12.179729 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.180118 (+   389us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.180159 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.182376 (+  2217us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.182809 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:08:12.182861 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:12.183355 (+   494us) log.cc:844] Serialized 107 byte log entry
0709 13:08:12.183561 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.210131 (+ 26570us) write_op.cc:454] Released schema lock
0709 13:08:12.224826 (+ 14695us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.233756 (+  8930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.233789 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1279020,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":514884,"apply.run_cpu_time_us":4996,"apply.run_wall_time_us":54150,"num_ops":15,"prepare.queue_time_us":790608,"prepare.run_cpu_time_us":77254,"prepare.run_wall_time_us":230626,"raft.queue_time_us":151088,"raft.run_cpu_time_us":18603,"raft.run_wall_time_us":550131,"replication_time_us":595632,"spinlock_wait_cycles":4148096,"thread_start_us":1477836,"threads_started":4,"wal-append.queue_time_us":422566,"wal-append.run_cpu_time_us":37421,"wal-append.run_wall_time_us":1755493}]]}
I20260709 13:08:22.404731 26605 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.404887 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.376674 29955 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.406700 26686 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.412434 29955 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.406601 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:22.414625 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69912.4us
I20260709 13:08:22.414908 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.334602 29981 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.399437 29843 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.421778 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.351117 29850 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:22.434023 30036 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:22.431582 26683 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:22.435231 29850 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:22.435366 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.434149 26679 raft_consensus.cc:2410] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:22.436595 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.437156 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:22.438195 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.438318 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.439584 30032 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:22.439988 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.440886 26683 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:22.441491 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.442107 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.442612 26684 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:22.443395 26683 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:22.444851 26683 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:22.425948 30001 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:22.452795 30001 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.453162 30001 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.455850 26603 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.459638 26606 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:22.463845 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 46084us
I20260709 13:08:22.456789 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:22.467146 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44451us
I20260709 13:08:22.469415 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.470963 26680 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:22.421521 29990 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:22.406430 29979 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:22.399353 30034 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.484212 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.490448 26612 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:22.484859 26684 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:08:22.491372 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.491823 26575 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.575s (SENT)
I20260709 13:08:22.480113 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.508917 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:22.509178 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.480084 29990 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:22.513147 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 93130.3us
I20260709 13:08:22.525125 29881 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:22.526142 29881 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.528887 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:22.422894 29976 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.529632 26684 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:22.474892 29850 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:22.530395 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.530747 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.531944 26606 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.532804 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:22.527999 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 256656us
I20260709 13:08:22.454255 29925 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:22.537431 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 51673.3us
W20260709 13:08:22.540230 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86903.3us
I20260709 13:08:22.541030 26678 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:22.542048 26680 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:22.544318 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.545758 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:22.549355 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 80076.1us
I20260709 13:08:22.549958 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:22.550841 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66367.7us
I20260709 13:08:22.543622 30029 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.555581 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.557477 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:22.555455 29925 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.559971 30020 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:22.562248 30023 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:22.562650 30023 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:22.567377 29843 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.567955 30025 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:22.569301 29981 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:22.570026 29843 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.570434 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:22.571460 30030 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:08:22.576756 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:22.577276 26609 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.539954 30044 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.581904 26604 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.598335 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:22.599613 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.597994 29917 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.601773 29917 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:22.602013 30038 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:22.598075 30029 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.601011 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:22.604033 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51195.7us
I20260709 13:08:22.602499 26606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:22.605082 26606 raft_consensus.cc:606] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.605572 26606 raft_consensus.cc:614] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:22.605611 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.604918 29979 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:22.614774 26606 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:22.614642 29979 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.616710 29979 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.563490 30023 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:22.618923 30035 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:22.596410 29659 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.602159 29917 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.620462 26685 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:22.623960 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1230) took 1184 ms. Trace:
I20260709 13:08:22.608664 29981 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:22.625747 29981 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:22.624447 26752 rpcz_store.cc:276] 0709 13:08:21.439201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.218675 (+779474us) service_pool.cc:224] Handling call
0709 13:08:22.218994 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.219394 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.219424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.235126 (+ 15702us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.343656 (+108530us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.509095 (+165439us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.522640 (+ 13545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.522699 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.623733 (+101034us) raft_consensus.cc:1685] finished
0709 13:08:22.623755 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.623897 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13225,"prepare.queue_time_us":193172,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":13837,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":10565,"thread_start_us":207167,"threads_started":2,"wal-append.queue_time_us":192386}
I20260709 13:08:22.626144 29981 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.626609 29850 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:22.627419 29881 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:22.628003 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49448.8us
W20260709 13:08:22.628468 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74833.7us
I20260709 13:08:22.628755 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.629334 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.631059 29843 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:22.631476 29843 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:22.631909 29843 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.634723 29940 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.642304 29940 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.642779 29940 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.642947 26686 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:22.637710 30029 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.639143 30034 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.647485 26603 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:22.657066 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:22.648753 26611 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.648818 26605 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:22.663297 29881 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:22.663905 29881 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:22.663806 26605 raft_consensus.cc:1217] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-9.6]   Dedup: 4.3->[6.4-9.6]
I20260709 13:08:22.664943 26605 pending_rounds.cc:85] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 3
I20260709 13:08:22.665311 26605 pending_rounds.cc:107] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:22.665562 26605 raft_consensus.cc:2889] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:22.666381 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.656438 26604 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:22.659772 26609 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:22.664975 29881 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.675262 27313 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:22.660130 26754 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:22.682083 29843 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.684468 29843 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:22.696483 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 78274.9us
I20260709 13:08:22.699128 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
W20260709 13:08:22.700650 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87239.7us
I20260709 13:08:22.702270 26610 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
W20260709 13:08:22.705375 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 137282us
W20260709 13:08:22.705600 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 144130us
I20260709 13:08:22.713171 26687 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.659942 30028 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.720023 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:22.723923 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153564us
I20260709 13:08:22.726138 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.599211 29860 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.701458 30020 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:22.784835 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77965.6us
I20260709 13:08:22.786693 26651 leader_election.cc:400] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:22.790233 26651 leader_election.cc:403] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.790431 27317 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:22.795318 27315 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:22.795528 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.796303 27318 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:22.598310 29990 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.804108 27285 leader_election.cc:400] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
I20260709 13:08:22.805691 27285 leader_election.cc:403] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:22.809149 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 101041us
I20260709 13:08:22.810859 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:22.811895 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 102152us
W20260709 13:08:22.812420 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 143535us
I20260709 13:08:22.786144 30028 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.812718 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:22.702822 29921 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:08:22.703950 30001 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:22.823396 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.795547 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:22.827521 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.726229 30029 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:08:22.816871 29976 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:22.832702 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:22.817225 30028 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:22.831908 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.840636 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:22.841328 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:22.814307 29852 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:22.851104 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:22.851423 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.853781 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:22.854785 26612 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:22.851655 26757 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:22.861598 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:22.862483 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:22.864696 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 77088.1us
I20260709 13:08:22.865832 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:22.866372 26678 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.866961 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.867934 26687 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:22.863161 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:22.870597 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:22.919484 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.922490 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.924240 26683 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:22.873504 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:22.931901 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.932667 27315 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:22.935163 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:22.935958 26679 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.860033 30056 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:08:22.844187 30032 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7.
I20260709 13:08:22.938830 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.944794 26683 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:22.939966 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:22.941879 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 70472us
I20260709 13:08:22.942622 26684 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:22.826081 29955 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:22.946132 26684 pending_rounds.cc:85] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:22.946493 26684 pending_rounds.cc:107] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:22.946828 26684 raft_consensus.cc:2889] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.947255 26755 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:22.950686 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.951450 27321 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:22.861429 30046 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:22.955015 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:22.956044 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:22.941634 27312 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:22.960669 26761 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
W20260709 13:08:22.967852 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 96023.4us
I20260709 13:08:22.970882 26687 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:22.975225 26685 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:22.995435 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:22.860733 30049 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:08:22.997129 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:22.998553 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50925.2us
I20260709 13:08:23.004308 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:23.006340 26678 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:23.012252 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 272d473e821e4c15a9f3fa0471adfdc6 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:08:23.012995 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 272d473e821e4c15a9f3fa0471adfdc6 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6
I20260709 13:08:23.016726 29912 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.017174 29912 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:23.018504 29884 raft_consensus.cc:1064] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:08:23.019060 30063 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.020053 29886 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:23.020478 29886 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.021458 29886 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.022805 29886 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.024853 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.026003 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.026401 29917 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.027062 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.028321 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 412) took 1268 ms. Trace:
I20260709 13:08:23.028785 27313 rpcz_store.cc:276] 0709 13:08:21.759913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.764034 (+  4121us) service_pool.cc:224] Handling call
0709 13:08:23.028034 (+1264000us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54005a3554. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.028228 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994066304}
I20260709 13:08:23.031415 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1490) took 1010 ms. Trace:
I20260709 13:08:23.031852 26610 rpcz_store.cc:276] 0709 13:08:22.021012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.321386 (+300374us) service_pool.cc:224] Handling call
0709 13:08:23.031239 (+709853us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003791d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.031354 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819150592}
I20260709 13:08:23.018030 29912 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.048028 29917 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:22.984738 30046 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:23.056389 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:23.056922 26685 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.034109 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:23.012557 30039 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:08:23.031944 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:23.044098 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:23.001931 30043 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.045039 29860 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:23.060981 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.046667 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:23.047964 27320 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:23.033138 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:23.061666 26678 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:23.027598 26611 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.045567 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.061662 26684 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:23.061910 26687 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:23.062242 26683 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:08:23.063884 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 115695us
W20260709 13:08:23.064095 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 54049us
I20260709 13:08:23.064718 29955 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:23.065264 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.065659 30046 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.061070 29938 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.068109 29938 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.062752 26681 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:23.073328 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69256.5us
I20260709 13:08:23.051934 26679 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:23.058974 29912 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.081957 26685 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:23.082734 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.082840 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:23.072661 29925 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:08:23.085522 30001 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:23.088260 26682 raft_consensus.cc:2410] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:23.088999 30066 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:23.089464 30066 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.089775 30066 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.089973 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1277) took 1097 ms. Trace:
I20260709 13:08:23.090391 26682 rpcz_store.cc:276] 0709 13:08:21.992504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.422475 (+429971us) service_pool.cc:224] Handling call
0709 13:08:23.089762 (+667287us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54001db854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.089913 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420938496}
I20260709 13:08:23.092682 30065 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:23.080909 29955 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:23.094924 26650 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.529s (SENT)
I20260709 13:08:23.098412 26681 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:23.108687 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.109405 27321 raft_consensus.cc:2376] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8. Re-sending same reply.
I20260709 13:08:23.110425 29981 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.111840 29955 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.113072 29955 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.115154 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:23.121079 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.110546 27313 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:23.127153 27317 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:23.154105 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.108717 29659 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.160349 26611 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:23.166366 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.160599 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:23.168244 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 85548.4us
W20260709 13:08:23.167963 29940 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.003s
I20260709 13:08:23.179177 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:23.180109 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 360466us
W20260709 13:08:23.177698 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 382972us
I20260709 13:08:23.178961 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:23.170336 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:23.181689 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.183940 27321 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:23.163782 30020 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:23.184471 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.184346 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.186053 26697 tablet_copy_source_session.cc:215] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:23.186131 29981 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:23.127995 29884 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.192844 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:23.195851 27318 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:23.196983 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 375) took 1342 ms. Trace:
I20260709 13:08:23.199100 27320 rpcz_store.cc:276] 0709 13:08:21.864296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.869450 (+  5154us) service_pool.cc:224] Handling call
0709 13:08:23.047769 (+1178319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.061836 (+ 14067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.192572 (+130736us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005a3550. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.192729 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674621824}
I20260709 13:08:23.184165 29947 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:23.236537 26610 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:23.238443 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 153509us
I20260709 13:08:23.195284 30020 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:23.236788 29947 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.200091 30063 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:23.248135 27318 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:23.241287 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:23.182548 29940 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.252835 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:23.201028 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:23.214227 30046 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.234287 29881 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.248535 29981 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.250952 30063 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.268814 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2505) took 1100 ms. Trace:
I20260709 13:08:23.272462 26752 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:23.274824 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.266245 29881 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.276650 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:23.256752 30065 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:23.277933 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94280.4us
I20260709 13:08:23.271906 26606 rpcz_store.cc:276] 0709 13:08:22.168552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.615810 (+447258us) service_pool.cc:224] Handling call
0709 13:08:22.616173 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.616528 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.616558 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.653347 (+ 36789us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.858709 (+205362us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:22.954992 (+ 96283us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.268475 (+313483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.268561 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.268605 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:23.268622 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.268755 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307446,"prepare.queue_time_us":119534,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":376302,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"thread_start_us":136823,"threads_started":2,"wal-append.queue_time_us":213438}
W20260709 13:08:23.281654 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 100025us
I20260709 13:08:23.281802 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2514) took 1109 ms. Trace:
I20260709 13:08:23.276773 29881 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.282233 26604 rpcz_store.cc:276] 0709 13:08:22.171921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.667571 (+495650us) service_pool.cc:224] Handling call
0709 13:08:22.667902 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.668160 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:22.825607 (+157447us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.281543 (+455936us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.281590 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:23.281636 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.281679 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.281760 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234050,"prepare.queue_time_us":42634,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":287938,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":313953,"threads_started":3,"wal-append.queue_time_us":170688}
I20260709 13:08:23.273864 30063 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:23.254868 30028 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.260996 30046 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.279743 29659 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.284106 30058 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.302201 26603 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:23.293114 30026 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:23.298184 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.282315 30066 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.298883 30073 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.297796 30020 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.300269 30058 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.306953 26606 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.329600 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:23.311986 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.329949 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 88764us
I20260709 13:08:23.294816 29955 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:23.340651 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 180384us
W20260709 13:08:23.319640 30070 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:08:23.367698 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2517) took 1114 ms. Trace:
W20260709 13:08:23.308110 30072 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:08:23.374126 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.390713 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 151513us
I20260709 13:08:23.323040 30066 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:23.388540 26607 rpcz_store.cc:276] 0709 13:08:22.253095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.699882 (+446787us) service_pool.cc:224] Handling call
0709 13:08:22.700201 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.823100 (+122899us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:22.861872 (+ 38772us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.291407 (+429535us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:23.296908 (+  5501us) log.cc:844] Serialized 52 byte log entry
0709 13:08:23.297070 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:23.305605 (+  8535us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.367223 (+ 61618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.367334 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.367386 (+    52us) raft_consensus.cc:1685] finished
0709 13:08:23.367405 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.367591 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":675378,"prepare.queue_time_us":14533,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":51513,"raft.queue_time_us":324818,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":15031,"thread_start_us":199248,"threads_started":3,"wal-append.queue_time_us":144180}
I20260709 13:08:23.340174 30058 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:23.395496 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 216594us
I20260709 13:08:23.304523 29938 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.297708 29947 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.324410 30048 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:08:23.399540 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 70032.5us
I20260709 13:08:23.366432 29860 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:23.368834 29993 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:23.324105 30056 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:08:23.339560 30049 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:08:23.406061 30028 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:23.406215 30083 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:23.404187 30062 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:23.433913 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2508) took 1264 ms. Trace:
I20260709 13:08:23.406735 30085 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:23.434288 26605 rpcz_store.cc:276] 0709 13:08:22.169779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.663128 (+493349us) service_pool.cc:224] Handling call
0709 13:08:22.663495 (+   367us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:08:22.666236 (+  2741us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:22.723596 (+ 57360us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.245727 (+522131us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:23.246448 (+   721us) log.cc:844] Serialized 78 byte log entry
0709 13:08:23.246641 (+   193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:23.246900 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.247262 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.247430 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.247523 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.433702 (+186179us) raft_consensus.cc:1685] finished
0709 13:08:23.433721 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.433862 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":572407,"prepare.queue_time_us":62947,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":1582,"raft.queue_time_us":236656,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":26623,"spinlock_wait_cycles":17290368,"thread_start_us":288218,"threads_started":2,"wal-append.queue_time_us":379774}
I20260709 13:08:23.406875 30057 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:23.407699 30046 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:23.441193 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2516) took 1268 ms. Trace:
I20260709 13:08:23.395254 30026 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.409289 29938 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:23.410264 26607 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:08:23.417320 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.452373 26606 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:23.421824 29981 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.425532 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.427559 30020 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.404338 29659 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.404175 30047 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:23.398175 30023 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:23.425606 30052 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.471s	user 0.004s	sys 0.000s
W20260709 13:08:23.406065 30077 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.147s	user 0.005s	sys 0.000s
W20260709 13:08:23.437847 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 99619.1us
I20260709 13:08:23.411875 29940 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:23.440083 29993 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.441630 26609 rpcz_store.cc:276] 0709 13:08:22.172603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.670145 (+497542us) service_pool.cc:224] Handling call
0709 13:08:22.670580 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.710087 (+ 39507us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:22.814269 (+104182us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.291560 (+477291us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.294045 (+  2485us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.294267 (+   222us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:23.294370 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.294438 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.440962 (+146524us) raft_consensus.cc:1685] finished
0709 13:08:23.440982 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.441133 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252601,"prepare.queue_time_us":900,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3313,"raft.queue_time_us":293540,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":331930,"threads_started":4,"wal-append.queue_time_us":239163}
W20260709 13:08:23.450883 26650 leader_election.cc:336] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.109s (SENT)
W20260709 13:08:23.455122 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56403.6us
W20260709 13:08:23.459224 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182661us
I20260709 13:08:23.466396 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:23.459839 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 121233us
I20260709 13:08:23.467073 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:23.457242 30056 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:23.465413 29993 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.470597 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:23.475996 30026 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.469683 30088 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:23.463975 30049 consensus_queue.cc:1243] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:23.497182 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1499) took 1401 ms. Trace:
I20260709 13:08:23.497591 26612 rpcz_store.cc:276] 0709 13:08:22.096277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.510268 (+413991us) service_pool.cc:224] Handling call
0709 13:08:23.496989 (+986721us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400031e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.497125 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738909056}
I20260709 13:08:23.470685 29938 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.509724 26755 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:23.510114 26754 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:23.510257 30073 raft_consensus.cc:2764] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:23.492419 29981 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:23.510881 29912 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:23.511683 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:23.524518 26761 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.512347 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:23.525252 26760 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.512739 30083 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.513533 26758 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:23.515841 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90404.3us
W20260709 13:08:23.528327 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 51355us
I20260709 13:08:23.528955 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.496616 29940 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:23.510335 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:23.530009 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79514.6us
I20260709 13:08:23.518219 29881 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:23.518487 30073 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:23.518894 30092 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.519136 29955 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:23.519529 30081 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.257s	user 0.002s	sys 0.000s
I20260709 13:08:23.518885 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:23.481781 29993 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.523438 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:08:23.531461 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 50620.8us
I20260709 13:08:23.522912 26752 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:23.542835 26755 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:23.550199 30045 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:08:23.552312 30058 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.554342 30058 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:23.534557 29912 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.556182 29912 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:23.557395 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48235.4us
I20260709 13:08:23.557349 29912 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.558246 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:23.541276 29938 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:23.560683 29938 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.562666 30046 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:23.563045 30046 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:23.563588 30056 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.563906 30046 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.564937 30056 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:23.565295 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.565740 30056 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:23.566115 30056 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.566565 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.566793 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.567149 26605 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.566922 30056 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.567924 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.568029 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.568125 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.568559 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.569042 26612 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:23.569612 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.570245 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.571173 30082 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:23.543782 29940 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.611019 30047 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.611202 30082 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.571233 29955 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.560989 29993 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:23.663612 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.574172 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.532222 29881 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.575678 30058 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:23.577103 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58346.1us
I20260709 13:08:23.547194 30088 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:23.579903 26605 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:23.528322 30083 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.675678 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.676066 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:23.611653 29940 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.531780 30073 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:23.614578 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.679195 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.616940 26761 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:23.626466 26680 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:23.627177 26687 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:23.637305 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.565122 30046 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:23.666788 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 98739.7us
I20260709 13:08:23.672008 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.673063 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.674310 26760 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:23.682690 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:23.607378 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63408.7us
I20260709 13:08:23.606958 29912 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.689774 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:23.690619 26650 leader_election.cc:336] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.210s (SENT)
I20260709 13:08:23.691056 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.691838 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.691919 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.691186 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.692787 27315 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:23.693480 27317 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:23.690457 27320 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:23.697646 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.698966 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:23.698407 26612 raft_consensus.cc:2376] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11. Re-sending same reply.
I20260709 13:08:23.699887 30026 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.612334 30082 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.706918 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.710686 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:23.687971 29955 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:23.716296 26650 leader_election.cc:336] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.214s (SENT)
I20260709 13:08:23.713132 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.699566 30049 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:23.696452 30020 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:23.702316 30056 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.719043 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:23.699963 30088 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.704514 29938 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.675629 30058 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:23.720813 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.725519 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:23.723856 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.723089 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:23.721362 30049 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:23.741459 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.706089 29843 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:08:23.742622 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.742609 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.743604 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.750895 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:23.721807 29981 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.722340 30069 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.751641 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:23.753540 29860 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.753935 29860 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.751984 30089 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.754959 30089 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.754763 29860 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.755314 30089 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.770730 30065 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:23.773969 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.774848 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.775316 30028 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.776067 29886 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.752583 29981 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.776436 29886 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.777297 29886 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.778501 29886 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.752758 30069 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.779543 30069 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.775738 30028 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:23.782358 30028 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.783511 30028 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:23.794225 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.775714 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.799228 29938 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:23.800338 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:23.803926 29981 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.804374 29981 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.805092 29981 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.806238 29981 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.752303 26609 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:23.809724 29860 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.811362 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:23.822028 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2532) took 1099 ms. Trace:
I20260709 13:08:23.822678 26610 rpcz_store.cc:276] 0709 13:08:22.722794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.048729 (+325935us) service_pool.cc:224] Handling call
0709 13:08:23.821813 (+773084us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400065754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:23.821954 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397316480}
I20260709 13:08:23.824842 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:23.828783 30093 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:08:23.831090 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 114831us
I20260709 13:08:23.844208 26687 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:23.741714 30049 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:23.847157 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:23.852831 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 294629us
I20260709 13:08:23.851024 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:23.742843 30021 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:23.742213 29659 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:23.742969 29947 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:23.877050 26683 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:23.872189 30094 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:23.873153 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:23.874498 30045 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.875174 26606 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:23.828821 30063 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
W20260709 13:08:23.879551 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.748838 30020 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:23.890439 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.891120 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:23.834244 29938 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:23.906994 26755 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:23.909418 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.910398 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.910903 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.910928 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.837652 30023 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.917270 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:23.852013 29990 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:23.911468 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.920814 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:23.921751 26761 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:23.861436 30044 raft_consensus.cc:2764] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:23.740338 30083 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.948092 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:23.947613 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 234574us
I20260709 13:08:23.950801 26753 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:23.952478 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:23.954283 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:23.964007 29843 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:23.964648 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 100165us
I20260709 13:08:23.969940 29659 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:23.972682 26576 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:23.918471 30063 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:24.028152 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.028373 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:24.051108 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.923228 30045 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:23.744251 29881 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:23.936594 30021 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.896389 29947 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:24.039350 30077 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:23.984691 29976 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.096179 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.937029 29884 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:08:23.832476 30088 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.133306 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:23.860692 30073 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:24.136114 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.933182 30023 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:24.078514 30101 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:24.096750 30083 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.938457 29955 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:23.916152 30020 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.419780 26681 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
W20260709 13:08:24.335104 30056 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.003s
W20260709 13:08:24.542634 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 800036us
I20260709 13:08:24.543679 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:24.159201 30104 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:08:24.544638 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:24.545979 30023 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:24.546694 30132 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:24.546870 29919 ts_tablet_manager.cc:1916] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:08:24.550256 26605 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:08:24.153344 30097 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:08:24.551333 29659 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.259469 30089 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.553153 30045 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.554903 30089 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:24.561106 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.203181 26608 raft_consensus.cc:2410] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:08:24.563330 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.560460 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.542937 26576 leader_election.cc:403] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:08:24.542174 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.565145 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.564181 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.566694 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.373449 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.452118 27318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.005s
W20260709 13:08:24.569779 27318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.006s	sys 0.006s
W20260709 13:08:24.570143 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.019s
W20260709 13:08:24.570551 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.002s	sys 0.019s
W20260709 13:08:24.570859 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 612289us
W20260709 13:08:24.316087 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 440275us
W20260709 13:08:24.541313 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 678104us
W20260709 13:08:24.577111 26756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.006s
W20260709 13:08:24.577577 26756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.003s	sys 0.006s
W20260709 13:08:24.365945 30069 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
W20260709 13:08:24.435214 29912 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
W20260709 13:08:24.254535 29993 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.580s	user 0.004s	sys 0.004s
W20260709 13:08:24.363955 29860 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 13:08:24.583320 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:24.450835 30061 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:24.584112 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:24.541833 30020 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:24.589882 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:24.590049 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 561749us
I20260709 13:08:24.144608 30058 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:24.590633 26758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.008s	sys 0.017s
W20260709 13:08:24.590622 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 618137us
I20260709 13:08:24.532593 30115 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:24.609912 26758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.012s	sys 0.017s
I20260709 13:08:24.591657 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:24.528707 30122 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.571748 29843 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:24.571000 30044 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:24.574466 30026 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.632252 26682 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:24.543936 29976 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.575656 30021 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.635404 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44377.7us
I20260709 13:08:24.630426 29947 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:24.636831 30117 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.642334 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:24.863611 26761 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:24.574311 30119 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:24.655226 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.645671 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1501) took 2499 ms. Trace:
I20260709 13:08:24.644441 26683 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:24.864423 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.653817 29940 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.645560 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:24.640023 29843 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:24.864962 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.737825 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 96779.8us
I20260709 13:08:24.582520 30129 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.864256 26608 rpcz_store.cc:276] 0709 13:08:22.159876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.552025 (+392149us) service_pool.cc:224] Handling call
0709 13:08:24.631620 (+2079595us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400065254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:24.635135 (+  3515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3738273664}
I20260709 13:08:24.644450 30061 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:24.219560 30046 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.413s
I20260709 13:08:24.630447 30034 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.335343 30049 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.608687 30057 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.610814 30073 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.632412 30065 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:24.678879 30024 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:24.894883 30024 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:24.819792 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 175647us
I20260709 13:08:24.896162 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:24.896764 30024 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.897787 30024 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:24.900915 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2564) took 1057 ms. Trace:
I20260709 13:08:24.901304 26680 rpcz_store.cc:276] 0709 13:08:23.843042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.843161 (+   119us) service_pool.cc:224] Handling call
0709 13:08:23.843756 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.845285 (+  1529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.845314 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.860023 (+ 14709us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.167347 (+307324us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b18000f2ce0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:08:24.516961 (+349614us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:24.517390 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.517600 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.517698 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.900562 (+382864us) raft_consensus.cc:1685] finished
0709 13:08:24.900665 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.900833 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5820,"prepare.queue_time_us":253,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":29454,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":18189,"spinlock_wait_cycles":13960576,"thread_start_us":349366,"threads_started":1,"wal-append.queue_time_us":1005032}
I20260709 13:08:24.903945 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:24.904469 29976 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:24.904748 26756 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:24.872962 30021 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.905669 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:24.862607 30115 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:24.907061 30115 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.815217 30026 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.855304 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:24.630404 30063 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:24.812215 30103 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.589658 30069 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.740708 29860 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.867879 30119 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:24.868635 30001 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.869067 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 132296us
I20260709 13:08:24.929183 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:24.870368 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 224878us
I20260709 13:08:24.930092 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:24.870849 30058 raft_consensus.cc:2764] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:24.582616 30056 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.866361 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:24.814337 30100 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.659s	user 0.007s	sys 0.023s
I20260709 13:08:24.739562 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:24.878562 30129 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:24.879419 30130 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:24.879953 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:24.743705 30101 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:24.877813 26683 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:24.677204 30122 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:24.881774 30118 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.874490 30117 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:24.994899 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.986624 30103 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:24.885510 30061 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:24.889074 30034 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.037590 30122 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.073345 30073 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.120509 30073 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.120249 30103 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:25.121249 30034 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.078573 29947 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:25.122596 30073 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:25.093261 30083 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.005s
I20260709 13:08:24.891654 26603 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:24.892920 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.738437 30044 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.049165 30129 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.125171 30117 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:25.125627 30044 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:24.907364 30021 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:24.912674 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 427) took 1240 ms. Trace:
W20260709 13:08:24.994560 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 128308us
I20260709 13:08:24.913793 26753 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:25.126546 27318 rpcz_store.cc:276] 0709 13:08:23.672452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.672570 (+   118us) service_pool.cc:224] Handling call
0709 13:08:23.689733 (+ 17163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.701423 (+ 11690us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:23.701708 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.912330 (+1210622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:24.912383 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:24.912434 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.912496 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.912622 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1272,"prepare.queue_time_us":645,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4834,"raft.queue_time_us":59978,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1200089,"threads_started":2,"wal-append.queue_time_us":958600}
I20260709 13:08:25.128013 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1238) took 1173 ms. Trace:
I20260709 13:08:25.128484 26753 rpcz_store.cc:276] 0709 13:08:23.954292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.574183 (+619891us) service_pool.cc:224] Handling call
0709 13:08:25.127959 (+553776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.128598 30021 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:25.082605 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 186508us
I20260709 13:08:25.129880 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.130205 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:25.130637 26753 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:25.131019 30129 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:24.924450 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 349348us
I20260709 13:08:24.993822 26757 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:25.132876 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1241) took 1177 ms. Trace:
I20260709 13:08:25.133206 26757 rpcz_store.cc:276] 0709 13:08:23.955296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.739330 (+784034us) service_pool.cc:224] Handling call
0709 13:08:25.132819 (+393489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.134598 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1245) took 1164 ms. Trace:
W20260709 13:08:25.135334 26650 connection.cc:256] RPC call timeout handler was delayed by -1.9185194869999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22940000000000002s for a response
I20260709 13:08:24.954391 30120 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.954890 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:24.956063 30063 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:24.956264 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 101051us
I20260709 13:08:25.185205 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:24.876973 30132 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:24.957875 26611 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:24.993244 26761 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:25.186676 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1240) took 1231 ms. Trace:
I20260709 13:08:25.187105 26761 rpcz_store.cc:276] 0709 13:08:23.954903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.876827 (+921924us) service_pool.cc:224] Handling call
0709 13:08:25.186596 (+309769us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:25.119087 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.885162 29940 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.058132 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2567) took 1197 ms. Trace:
I20260709 13:08:25.130039 30044 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:25.189944 26685 rpcz_store.cc:276] 0709 13:08:23.860804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.875756 (+ 14952us) service_pool.cc:224] Handling call
0709 13:08:23.876106 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.876292 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:23.978208 (+101916us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.057502 (+1079294us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18001f6f60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:08:25.057636 (+   134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.057717 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:25.057791 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.057883 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.058056 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75602,"prepare.queue_time_us":278879,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":549046,"spinlock_wait_cycles":42323456,"thread_start_us":306153,"threads_started":3,"wal-append.queue_time_us":177465}
I20260709 13:08:24.953538 27316 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:24.953732 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:25.192615 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 238945us
I20260709 13:08:25.194393 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:25.043157 30101 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:24.947310 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.040217 30142 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:25.137981 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:25.139292 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:25.140154 26753 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:08:25.144423 30099 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.066s	user 0.005s	sys 0.015s
I20260709 13:08:25.144585 29919 ts_tablet_manager.cc:1929] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 4.4
I20260709 13:08:25.145357 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 315) took 1270 ms. Trace:
I20260709 13:08:25.209944 29919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d473e821e4c15a9f3fa0471adfdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.210035 26754 rpcz_store.cc:276] 0709 13:08:23.875112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.893548 (+ 18436us) service_pool.cc:224] Handling call
0709 13:08:23.893911 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.588843 (+694932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.588887 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:24.588941 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:24.588991 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.145080 (+556089us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54002dc3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:25.145130 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.145275 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597629696}
W20260709 13:08:25.211941 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 257115us
I20260709 13:08:25.212688 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:25.213939 30110 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.080s	user 0.000s	sys 0.022s
I20260709 13:08:25.145218 30061 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:25.091748 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.979960 30001 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:25.217295 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.217736 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.217764 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:25.047024 30020 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:24.957971 30028 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.134970 26757 rpcz_store.cc:276] 0709 13:08:23.969714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.133808 (+1164094us) service_pool.cc:224] Handling call
0709 13:08:25.134104 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.134284 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.134313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.134360 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:25.134397 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.134452 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.134543 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.082682 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:24.886142 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2569) took 1024 ms. Trace:
I20260709 13:08:24.958388 29860 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.071280 30109 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:08:24.993996 30024 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
W20260709 13:08:25.164686 26681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2565) took 1318 ms (client timeout 1745 ms). Trace:
W20260709 13:08:25.170203 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 321) took 1602 ms (client timeout 2128 ms). Trace:
I20260709 13:08:25.234035 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:24.979259 30069 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:24.958232 29976 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.047065 29993 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.188355 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.053543 30119 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.198210 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1242) took 1242 ms. Trace:
I20260709 13:08:25.200748 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:25.196650 30142 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:25.202368 27313 raft_consensus.cc:2376] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7. Re-sending same reply.
I20260709 13:08:25.189698 30131 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:25.208038 30117 raft_consensus.cc:2764] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:08:25.216231 26754 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:25.228998 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146380us
I20260709 13:08:25.229298 26683 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:08:25.291391 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1249) took 1320 ms. Trace:
I20260709 13:08:25.291728 26754 rpcz_store.cc:276] 0709 13:08:23.971360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.211322 (+1239962us) service_pool.cc:224] Handling call
0709 13:08:25.211602 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.291150 (+ 79548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.291341 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.171375 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2566) took 1311 ms. Trace:
I20260709 13:08:25.230741 26685 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:25.266165 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:25.293071 26687 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.292785 26682 rpcz_store.cc:276] 0709 13:08:23.860418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.880266 (+ 19848us) service_pool.cc:224] Handling call
0709 13:08:25.171143 (+1290877us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400305cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:25.171316 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642047232}
I20260709 13:08:25.227236 29947 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:25.265895 26605 rpcz_store.cc:269] 0709 13:08:23.567619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.726386 (+158767us) service_pool.cc:224] Handling call
0709 13:08:25.169979 (+1443593us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54001004d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:25.170126 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842597632}
I20260709 13:08:25.197247 30083 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.196754 30118 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.308490 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.309311 26682 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:25.267740 26755 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:25.289978 30024 consensus_queue.cc:1243] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:25.223927 26678 rpcz_store.cc:276] 0709 13:08:23.861468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.880528 (+ 19060us) service_pool.cc:224] Handling call
0709 13:08:23.924155 (+ 43627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:24.054653 (+130498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.054685 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:24.078307 (+ 23622us) log.cc:844] Serialized 52 byte log entry
0709 13:08:24.331328 (+253021us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:24.331388 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.331491 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.885906 (+554415us) raft_consensus.cc:1685] finished
0709 13:08:24.885926 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.886083 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89380,"raft.queue_time_us":240751,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":192646,"threads_started":1,"wal-append.queue_time_us":560080}
I20260709 13:08:25.270653 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.311394 26680 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:25.230849 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:25.190641 30044 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:25.037591 29843 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.314365 29843 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.216459 30058 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:25.315245 30058 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:25.315706 30058 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:25.316684 29860 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.316578 30058 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.316960 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.317788 26680 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:25.317849 30132 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.277144 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.285667 26753 rpcz_store.cc:276] 0709 13:08:23.968669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.131457 (+1162788us) service_pool.cc:224] Handling call
0709 13:08:25.139826 (+  8369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.197896 (+ 58070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.198147 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.320360 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.309486 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:25.320984 26753 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:25.227427 30047 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.216313 30073 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.230008 30111 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:08:25.323062 26685 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:25.324182 26686 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:25.324491 30061 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:25.324362 30044 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.325526 26682 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:25.287555 29993 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.326152 30140 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:25.326706 30140 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:25.327543 30140 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.326663 30115 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:25.331575 30115 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.337893 30057 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:25.338742 30057 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.339371 30115 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:25.341578 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2562) took 1499 ms. Trace:
I20260709 13:08:25.333470 26685 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:25.342056 26684 rpcz_store.cc:276] 0709 13:08:23.842504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.842622 (+   118us) service_pool.cc:224] Handling call
0709 13:08:23.876047 (+ 33425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:24.036616 (+160569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.036647 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:24.521412 (+484765us) log.cc:844] Serialized 52 byte log entry
0709 13:08:24.931966 (+410554us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:24.932010 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.932076 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.341320 (+409244us) raft_consensus.cc:1685] finished
0709 13:08:25.341347 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.341510 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41086,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10365,"thread_start_us":490457,"threads_started":2,"wal-append.queue_time_us":739617}
I20260709 13:08:25.344777 30001 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.347003 26687 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:25.222939 30129 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.230162 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.306808 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 322) took 1730 ms. Trace:
I20260709 13:08:25.307562 26683 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:25.265027 26681 rpcz_store.cc:269] 0709 13:08:23.846610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.846868 (+   258us) service_pool.cc:224] Handling call
0709 13:08:25.164486 (+1317618us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400180e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:25.164628 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756884224}
I20260709 13:08:25.325604 30044 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.348562 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:25.301402 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.351783 26603 rpcz_store.cc:276] 0709 13:08:23.576315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.756465 (+180150us) service_pool.cc:224] Handling call
0709 13:08:23.756752 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.123950 (+1367198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.306567 (+182617us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400249354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:25.306750 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609609984}
I20260709 13:08:25.356392 26754 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:25.306123 30120 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:25.363170 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:25.364482 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133735us
I20260709 13:08:25.364135 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:25.365670 30122 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:25.366140 30122 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.366478 30122 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.367122 30065 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:25.367614 30065 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:25.367645 29976 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.368220 29976 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.368306 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.368600 29976 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:25.368682 30065 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.371199 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.371316 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:25.373142 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.374419 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.561s (SENT) [suppressed 30 similar messages]
I20260709 13:08:25.374568 26605 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:25.376091 26608 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:25.376505 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:25.376456 29976 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.377048 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.377388 27316 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:25.377590 26612 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.380336 26606 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:25.380429 30083 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.380924 30023 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:25.381356 30023 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:25.381489 30083 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:25.381743 26610 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:25.381920 30083 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:25.382305 30023 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.383060 26604 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:25.386665 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.388553 26603 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:25.382773 30083 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.357524 30143 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:08:25.392228 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 227719us
I20260709 13:08:25.393606 27313 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:25.397045 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:25.397082 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.362947 30024 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:25.339285 30057 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.295895 30131 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.414163 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:25.428722 27318 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 5.
I20260709 13:08:25.415026 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:25.429853 26607 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:25.309172 29947 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.416401 30024 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.433470 30024 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.434140 29947 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:25.424269 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 292662us
I20260709 13:08:25.381383 29976 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.402401 30023 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.359465 30129 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.392197 30120 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:25.627254 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1250) took 1655 ms. Trace:
I20260709 13:08:25.650192 30073 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.652834 26612 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:25.555075 29938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.610s	user 0.012s	sys 0.017s
W20260709 13:08:25.653748 29938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.015s	sys 0.020s
I20260709 13:08:25.653232 30073 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.654079 29938 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:25.496423 30103 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:25.655207 30103 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:25.488050 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59799us
I20260709 13:08:25.656605 30073 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:25.501904 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.487376 30151 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:08:25.652156 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.524804 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.609817 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 235393us
W20260709 13:08:25.660488 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 442804us
I20260709 13:08:25.661427 26753 rpcz_store.cc:276] 0709 13:08:23.971757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.321671 (+1349914us) service_pool.cc:224] Handling call
0709 13:08:25.321967 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.322152 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:25.322393 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.626804 (+304411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.626863 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:25.626920 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.627011 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.627177 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1469,"prepare.queue_time_us":3621,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1349,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":19861,"thread_start_us":304027,"threads_started":1}
W20260709 13:08:25.577042 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 376359us
I20260709 13:08:25.711774 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:25.448318 26610 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:25.651611 30083 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.717128 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2570) took 1143 ms. Trace:
I20260709 13:08:25.717450 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:25.552409 30088 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:25.681185 30103 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:25.686174 30028 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.689649 30049 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:25.695029 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.697395 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:25.698360 27313 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.699894 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1232) took 1762 ms. Trace:
I20260709 13:08:25.700712 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2526) took 3399 ms. Trace:
W20260709 13:08:25.704052 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.576771 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:25.739243 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.739425 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.743304 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.564735 29940 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:25.716536 26724 connection.cc:256] RPC call timeout handler was delayed by -1.9663750369999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 13:08:25.717509 26679 rpcz_store.cc:276] 0709 13:08:24.573235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.573371 (+   136us) service_pool.cc:224] Handling call
0709 13:08:24.573778 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.582866 (+  9088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.582898 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.583388 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.145995 (+562607us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b1800464080. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:08:25.395070 (+249075us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:25.395112 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.395174 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.703867 (+308693us) raft_consensus.cc:1685] finished
0709 13:08:25.703886 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.717068 (+ 13182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":897,"raft.queue_time_us":9033,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":44883,"spinlock_wait_cycles":63854336,"thread_start_us":248515,"threads_started":1,"wal-append.queue_time_us":980830}
W20260709 13:08:25.714094 26650 connection.cc:256] RPC call timeout handler was delayed by -1.8060194869999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2419s for a response
I20260709 13:08:25.719331 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:25.748647 26753 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:25.716602 29919 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.008s
I20260709 13:08:25.744050 26755 rpcz_store.cc:276] 0709 13:08:23.937239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.937380 (+   141us) service_pool.cc:224] Handling call
0709 13:08:23.945548 (+  8168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.350148 (+1404600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.699607 (+349459us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54001103d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:25.699811 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965340032}
I20260709 13:08:25.743538 26611 rpcz_store.cc:276] 0709 13:08:22.301216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.239579 (+938363us) service_pool.cc:224] Handling call
0709 13:08:24.632506 (+1392927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.186200 (+553694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.692945 (+506745us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400065254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:25.700434 (+  7489us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400065250. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:25.700603 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3949905024}
W20260709 13:08:25.564288 30121 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.353s	user 0.005s	sys 0.007s
W20260709 13:08:25.754347 26650 connection.cc:256] RPC call timeout handler was delayed by -1.7862194869999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24409999999999998s for a response
W20260709 13:08:25.793884 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 217217us
I20260709 13:08:25.709821 30021 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:25.734942 30073 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.800099 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.655153 29938 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:25.804347 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1526) took 2223 ms. Trace:
W20260709 13:08:25.834345 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5567194870000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2696s for a response
I20260709 13:08:25.805029 26761 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:25.797008 30172 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.137s	user 0.000s	sys 0.004s
W20260709 13:08:25.801210 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81947.6us
W20260709 13:08:25.805256 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.806596 30082 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:25.807431 29940 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:25.829264 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.841054 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.843921 26755 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:25.752715 30057 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.834478 26752 rpcz_store.cc:276] 0709 13:08:23.581277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.581463 (+   186us) service_pool.cc:224] Handling call
0709 13:08:23.623044 (+ 41581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.670775 (+ 47731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.670807 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.688359 (+ 17552us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.946966 (+258607us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:23.947202 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.947399 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.563702 (+1616303us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:25.804003 (+240301us) raft_consensus.cc:1685] finished
0709 13:08:25.804023 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.804274 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2565,"raft.queue_time_us":46535,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5408,"spinlock_wait_cycles":42062080,"thread_start_us":229322,"threads_started":1,"wal-append.queue_time_us":506584}
I20260709 13:08:25.753916 30159 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:25.833678 30163 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:25.802879 30058 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.835299 30073 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.797566 30001 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:25.841202 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:25.752271 30024 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.749361 30088 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.856299 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.894407 26680 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:25.833374 29976 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.834586 30123 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.792187 30034 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:08:25.881366 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.870334 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.898303 26681 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:25.872378 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:25.859891 30119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.001s
W20260709 13:08:25.884086 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.856443 30049 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.907904 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:25.870324 30132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.010s
I20260709 13:08:25.890504 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:25.893229 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.894618 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:25.896431 26685 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:08:25.896840 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:25.859833 30134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.004s
I20260709 13:08:25.856338 29860 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:08:25.902513 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.879642 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76282.8us
I20260709 13:08:25.906445 26753 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:25.908994 26682 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:25.837832 30021 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:25.966688 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.958909 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:25.995769 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:26.361603 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.977393 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 130417us
W20260709 13:08:26.212159 26724 connection.cc:256] RPC call timeout handler was delayed by -1.2436750370000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
I20260709 13:08:25.957504 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:26.366060 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.369352 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1252) took 1244 ms. Trace:
I20260709 13:08:26.369809 26753 rpcz_store.cc:276] 0709 13:08:25.124853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.880807 (+755954us) service_pool.cc:224] Handling call
0709 13:08:25.906104 (+ 25297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.344142 (+438038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.369295 (+ 25153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.881805 30073 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.370581 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.372001 26755 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.870584 30159 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:26.477891 26684 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:08:26.253229 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.478461 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1253) took 1353 ms. Trace:
I20260709 13:08:26.478951 26755 rpcz_store.cc:276] 0709 13:08:25.125087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.905781 (+780694us) service_pool.cc:224] Handling call
0709 13:08:26.371824 (+466043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.477772 (+105948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.478338 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:25.989773 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.480358 26607 raft_consensus.cc:2376] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6. Re-sending same reply.
I20260709 13:08:25.897650 30123 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.481693 30123 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.694988 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 317) took 1624 ms. Trace:
I20260709 13:08:25.905273 29976 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:26.693982 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2547) took 1309 ms. Trace:
I20260709 13:08:26.706120 26610 rpcz_store.cc:276] 0709 13:08:25.384756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.392393 (+  7637us) service_pool.cc:224] Handling call
0709 13:08:25.424878 (+ 32485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.712474 (+287596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.693602 (+981128us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54002855d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:26.693896 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52779392}
I20260709 13:08:25.936734 30049 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:26.579169 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.020s	sys 0.048s
I20260709 13:08:26.483978 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:26.707650 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.709014 26610 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:26.659472 30116 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 2.405s	user 0.023s	sys 0.000s
I20260709 13:08:26.523936 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:26.698266 30171 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.617s	user 0.001s	sys 0.000s
W20260709 13:08:26.087061 30044 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.000s
W20260709 13:08:26.578789 30161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.034s	sys 0.024s
I20260709 13:08:26.365545 26604 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:26.488201 30183 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.481271 26605 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:26.711678 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2548) took 1326 ms. Trace:
I20260709 13:08:26.704636 26757 rpcz_store.cc:276] 0709 13:08:25.070157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.358819 (+288662us) service_pool.cc:224] Handling call
0709 13:08:25.361064 (+  2245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.522684 (+161620us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:25.563612 (+ 40928us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.738321 (+174709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.738403 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:25.738457 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.694684 (+956227us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:26.694751 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.694916 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87075,"prepare.queue_time_us":41223,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":79008,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":43238,"spinlock_wait_cycles":370974080,"thread_start_us":96526,"threads_started":1,"wal-append.queue_time_us":92729}
I20260709 13:08:26.701113 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:26.613319 30105 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 2.560s	user 0.009s	sys 0.011s
I20260709 13:08:25.896860 30001 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:26.721967 26612 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:26.722309 26757 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:26.722862 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 446) took 3143 ms. Trace:
W20260709 13:08:26.509703 30034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.014s
I20260709 13:08:26.056658 30129 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.954770 30080 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:26.081790 30180 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:08:26.716907 30143 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.725536 30080 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:26.612623 30107 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 2.358s	user 0.008s	sys 0.008s
I20260709 13:08:25.959865 30047 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.726020 30143 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:26.615118 30142 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:26.727034 30047 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.488796 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.723456 27314 rpcz_store.cc:276] 0709 13:08:23.579170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.579304 (+   134us) service_pool.cc:224] Handling call
0709 13:08:23.608029 (+ 28725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.611338 (+  3309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.611375 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.611970 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.837764 (+225794us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:23.845522 (+  7758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.877204 (+ 31682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.591386 (+2714182us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:26.722532 (+131146us) raft_consensus.cc:1685] finished
0709 13:08:26.722557 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.722774 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3978,"raft.queue_time_us":2094,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":47496,"spinlock_wait_cycles":41124224,"thread_start_us":127604,"threads_started":1,"wal-append.queue_time_us":268528}
I20260709 13:08:26.728879 26609 raft_consensus.cc:2368] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:26.723868 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1256) took 1597 ms. Trace:
I20260709 13:08:26.746589 26757 rpcz_store.cc:276] 0709 13:08:25.125984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.721736 (+1595752us) service_pool.cc:224] Handling call
0709 13:08:26.722092 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.723234 (+  1142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.723801 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:26.748572 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1532) took 1529 ms. Trace:
I20260709 13:08:26.749032 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.750777 26608 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
W20260709 13:08:26.753859 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.755916 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.757827 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:26.542578 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 62236.6us
I20260709 13:08:26.759155 26608 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:26.760059 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:26.721427 30128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.003s	sys 0.007s
W20260709 13:08:26.774593 30128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.003s	sys 0.007s
I20260709 13:08:26.776049 30026 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.778342 30020 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:26.785495 27284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.010s
W20260709 13:08:26.785929 27284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.004s	sys 0.010s
I20260709 13:08:26.788699 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1248) took 2817 ms. Trace:
I20260709 13:08:26.720148 30021 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.729889 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:26.711445 30161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.037s	sys 0.028s
I20260709 13:08:26.789167 26761 rpcz_store.cc:276] 0709 13:08:23.971026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.206925 (+1235899us) service_pool.cc:224] Handling call
0709 13:08:25.804801 (+597876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.836178 (+ 31377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.788490 (+952312us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54000dc5d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:26.788621 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374007168}
W20260709 13:08:25.991391 30114 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.847s	user 0.000s	sys 0.017s
W20260709 13:08:26.791132 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.474031 30134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.006s	sys 0.017s
W20260709 13:08:26.797492 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1236) took 2847 ms (client timeout 2089 ms). Trace:
W20260709 13:08:26.797925 26759 rpcz_store.cc:269] 0709 13:08:23.949621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.952153 (+  2532us) service_pool.cc:224] Handling call
0709 13:08:26.797247 (+2845094us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400200b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:26.797395 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949788416}
I20260709 13:08:26.798441 27314 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:26.723609 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.024s	sys 0.052s
W20260709 13:08:26.801988 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6468690220000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4449s for a response
I20260709 13:08:26.802816 29993 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.731585 26679 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:26.731894 29852 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.804487 29852 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.804932 30136 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.805565 30136 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.806833 29852 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.961689 30131 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:26.808096 30189 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.808413 27312 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:25.910202 30120 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:26.808923 27312 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:26.808755 30189 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.810215 27312 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:26.811620 30142 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.811944 30136 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.811944 30129 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.813053 30129 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.815824 30129 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.713254 30024 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.482935 30159 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.723336 30183 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.817499 29881 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.818763 30183 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.811622 27312 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.724268 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:26.082857 30179 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:26.481851 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.819451 26609 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:26.822707 26607 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:26.717587 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.823681 26609 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:26.824066 26611 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.070636 30023 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.721063 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.825834 30023 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.738662 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.740361 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1530) took 2061 ms. Trace:
I20260709 13:08:26.736727 30088 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:26.826946 26754 rpcz_store.cc:276] 0709 13:08:24.679282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.360534 (+681252us) service_pool.cc:224] Handling call
0709 13:08:25.394192 (+ 33658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.444019 (+ 49827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.444049 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.444092 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:25.444127 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.740043 (+1295916us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:26.740110 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.740287 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114077056}
I20260709 13:08:26.742254 30080 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.828615 30023 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:25.956434 30164 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.763260 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.865845 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:26.866505 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.866912 26681 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:08:26.765681 26756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1531) took 2028 ms (client timeout 1825 ms). Trace:
W20260709 13:08:26.867585 26756 rpcz_store.cc:269] 0709 13:08:24.737526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.905413 (+167887us) service_pool.cc:224] Handling call
0709 13:08:26.765409 (+1859996us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400082d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:26.765587 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215424256}
I20260709 13:08:26.087280 29919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39266 (request call id 373) took 8855 ms. Trace:
I20260709 13:08:26.768270 26684 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:26.762054 26752 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:26.871614 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1251) took 1747 ms. Trace:
I20260709 13:08:26.872120 26752 rpcz_store.cc:276] 0709 13:08:25.124563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.845973 (+721410us) service_pool.cc:224] Handling call
0709 13:08:25.846355 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.761839 (+915484us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400258120. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:08:26.871280 (+109441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.871543 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24614272}
I20260709 13:08:26.873860 26608 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:26.523746 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:26.483206 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.810708 30195 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:26.875427 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.821254 26604 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:26.825295 26609 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:26.720870 26606 rpcz_store.cc:276] 0709 13:08:25.385015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.392458 (+  7443us) service_pool.cc:224] Handling call
0709 13:08:25.424357 (+ 31899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.432728 (+  8371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.432764 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.433274 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.712291 (+279017us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:25.712347 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.712437 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.697509 (+985072us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:26.711392 (+ 13883us) raft_consensus.cc:1685] finished
0709 13:08:26.711416 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.711606 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8308,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"spinlock_wait_cycles":13799168,"thread_start_us":278629,"threads_started":1,"wal-append.queue_time_us":549112}
I20260709 13:08:26.815302 30189 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:26.546542 30092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.018s
I20260709 13:08:26.830482 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:26.732452 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.831684 26650 leader_election.cc:336] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.924s (SENT)
W20260709 13:08:26.735051 30083 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.000s
I20260709 13:08:26.744493 30143 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:26.192785 30122 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
W20260709 13:08:26.846184 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.909543 30119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.001s
I20260709 13:08:26.540190 26683 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:26.877599 30195 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:26.474696 30174 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:08:26.843894 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 294984us
I20260709 13:08:26.526891 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:26.852931 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.940486 26605 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:26.940383 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1300) took 1046 ms. Trace:
I20260709 13:08:26.941052 26678 rpcz_store.cc:276] 0709 13:08:25.894388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.290287 (+395899us) service_pool.cc:224] Handling call
0709 13:08:26.940298 (+650011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:26.941847 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.852258 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.853755 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.854718 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:26.611775 30108 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 2.512s	user 0.008s	sys 0.030s
W20260709 13:08:26.856240 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.027s
W20260709 13:08:26.856632 26576 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.016s	sys 0.024s
I20260709 13:08:26.749053 26757 rpcz_store.cc:276] 0709 13:08:25.219648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.747705 (+1528057us) service_pool.cc:224] Handling call
0709 13:08:26.748049 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.748238 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.748264 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:26.748307 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:26.748343 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.748402 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.748517 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:26.952720 26576 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.017s	sys 0.025s
W20260709 13:08:26.953183 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 971772us
I20260709 13:08:26.954609 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.856953 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.955541 26686 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:26.842667 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:26.956909 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 114378us
I20260709 13:08:26.958036 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:26.760154 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:26.729516 30047 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.722862 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.848789 26507 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 8, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:26.477164 30132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.011s	sys 0.025s
W20260709 13:08:26.866976 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.960071 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:26.710702 26685 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:26.876268 26681 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:26.921274 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.909655 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.972682 26603 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:26.914829 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.973351 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 213270us
I20260709 13:08:26.974285 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:26.889252 30092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.002s	sys 0.023s
I20260709 13:08:26.973064 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:26.976468 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1299) took 1083 ms. Trace:
I20260709 13:08:26.976995 26685 rpcz_store.cc:276] 0709 13:08:25.893507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.367344 (+473837us) service_pool.cc:224] Handling call
0709 13:08:26.976381 (+609037us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:26.919036 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.978035 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.922762 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.978756 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.980257 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:26.872716 30164 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.984934 26686 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:26.922156 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:26.925899 30049 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.928114 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:26.910522 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:26.952255 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.028s
I20260709 13:08:27.001967 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.002550 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:27.004000 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.004606 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.709949 26682 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:08:26.961725 26683 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:27.006492 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1302) took 1053 ms. Trace:
I20260709 13:08:27.007017 26682 rpcz_store.cc:276] 0709 13:08:25.953042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.380776 (+427734us) service_pool.cc:224] Handling call
0709 13:08:26.709695 (+328919us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.006079 (+296384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.006415 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:26.962694 26610 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:26.963213 26687 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.942935 26679 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:26.965528 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.012442 26752 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:08:26.969633 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.971442 26612 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:26.373973 30058 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.910831 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.019148 26760 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.019037 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:26.999217 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:27.024858 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.025978 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.027417 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:27.028872 26680 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:27.022238 26603 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:27.030889 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.031047 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:27.032232 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72660.2us
I20260709 13:08:26.976011 30119 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.034571 26608 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:26.981360 30126 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:27.038923 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.032696 26603 raft_consensus.cc:2376] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8. Re-sending same reply.
I20260709 13:08:27.046680 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.056564 26678 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:27.056723 26608 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:27.057574 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.036242 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:26.982841 29976 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.054270 26687 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:27.057658 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.049182 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:26.982117 30001 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:26.938082 30122 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.069973 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.071314 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.048192 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.072062 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:27.072820 26683 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.075764 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.019570 30115 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.068264 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.018765 30143 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.061528 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.061595 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.092314 26679 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:27.065907 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 43991us
I20260709 13:08:27.031976 30023 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.052584 30128 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.080053 30056 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.998951 30134 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:27.080329 30183 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:27.052958 30026 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.079545 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.083434 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.121783 26603 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:27.122680 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.123440 26679 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:27.083787 26682 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.084244 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.124807 26684 raft_consensus.cc:2410] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:08:27.087121 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 112955us
I20260709 13:08:27.079422 29993 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.031502 30189 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.031178 30132 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.032392 30080 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:27.046351 30131 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.130298 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.059736 30190 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:27.044587 30047 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:27.032840 30058 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.104969 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:27.071707 30184 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.135385 26611 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:27.055823 30119 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.131424 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.132177 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.132380 26687 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:27.091538 26752 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:27.165491 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.077769 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.166620 26678 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:27.128628 30194 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.129472 30126 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:27.152563 30083 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:27.082363 30122 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.192626 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 316) took 3317 ms. Trace:
I20260709 13:08:27.193005 26760 rpcz_store.cc:276] 0709 13:08:23.875402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.876641 (+  1239us) service_pool.cc:224] Handling call
0709 13:08:23.876901 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.019768 (+3142867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.192390 (+172622us) spinlock_profiling.cc:243] Waited 3.14 s on lock 0x7b5400201054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:27.192570 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7226016000}
I20260709 13:08:27.194106 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.194303 27312 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:27.194680 26760 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:27.194928 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 433) took 1802 ms. Trace:
I20260709 13:08:27.115181 30023 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.157235 30047 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.197376 30023 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.198403 30047 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:27.120992 30197 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:27.148926 26683 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
W20260709 13:08:27.199375 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.199972 30069 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:08:27.200052 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.200578 26685 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:27.152707 26680 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:27.201678 26683 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:08:27.202018 26683 pending_rounds.cc:85] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 3
W20260709 13:08:27.202087 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.202255 26683 pending_rounds.cc:107] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:08:27.155737 26606 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:27.145244 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.202541 26683 raft_consensus.cc:2889] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.161912 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.165570 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.195514 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.203524 26679 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:27.127708 30056 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:27.133100 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 301437us
I20260709 13:08:27.209875 26612 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:27.198401 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:27.174866 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:27.138577 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.175927 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:27.211148 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.211267 26684 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:27.176918 26604 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:27.132737 29993 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:26.870577 29919 rpcz_store.cc:276] 0709 13:08:17.256812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.257330 (+   518us) service_pool.cc:224] Handling call
0709 13:08:18.409492 (+1152162us) ts_tablet_manager.cc:934] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
0709 13:08:24.545848 (+6136356us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:24.884871 (+339023us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.063523 (+178652us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.209544 (+146021us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 13:08:25.801499 (+591955us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:25.901915 (+100416us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:25.995615 (+ 93700us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:26.070429 (+ 74814us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40995,"tablet-copy.queue_time_us":960812,"thread_start_us":522285,"threads_started":2}
I20260709 13:08:27.213936 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.142846 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.214442 26687 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:08:27.214918 26687 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:27.215216 26687 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:08:27.164985 30119 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.215538 26687 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:27.216200 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.180099 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.182255 26609 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:27.161331 30190 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:27.135890 30026 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.189509 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.190224 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1527) took 3581 ms. Trace:
I20260709 13:08:27.191134 30058 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.116976 30143 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.226136 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.141284 30128 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:27.168982 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.103560 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.204577 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:27.232584 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 129155us
I20260709 13:08:27.233613 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.174562 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.235433 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:27.210441 26650 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.971s (SENT)
I20260709 13:08:27.236665 26679 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:27.236811 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:27.217993 26603 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:27.219933 26606 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:27.221561 26610 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:27.140542 30132 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.140926 30080 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.085574 30195 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.225510 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.227571 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:27.217718 30082 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:27.188678 30083 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:27.218653 26758 rpcz_store.cc:276] 0709 13:08:23.609032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.609184 (+   152us) service_pool.cc:224] Handling call
0709 13:08:23.668945 (+ 59761us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:23.689724 (+ 20779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.689750 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:23.706342 (+ 16592us) log.cc:844] Serialized 52 byte log entry
0709 13:08:23.770564 (+ 64222us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:23.906126 (+135562us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.610386 (+704260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.610469 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.571758 (+1961289us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:27.189932 (+618174us) raft_consensus.cc:1685] finished
0709 13:08:27.190020 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.190165 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3848,"prepare.queue_time_us":105231,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":7151,"raft.queue_time_us":762240,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9730,"spinlock_wait_cycles":42951040,"thread_start_us":877600,"threads_started":3,"wal-append.queue_time_us":197373}
W20260709 13:08:27.248212 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 227952us
I20260709 13:08:27.283784 26684 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:27.287019 26754 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:27.235371 30200 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:27.168380 30184 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.195286 27312 rpcz_store.cc:276] 0709 13:08:25.392293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.395842 (+  3549us) service_pool.cc:224] Handling call
0709 13:08:25.433895 (+ 38053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.808262 (+1374367us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5400560520. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:08:27.194670 (+386408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.194861 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33797376}
W20260709 13:08:27.274330 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46824.4us
W20260709 13:08:27.211676 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 66509.2us
I20260709 13:08:27.300284 26679 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:27.261751 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.304049 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.304391 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.305604 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.276499 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.277817 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.252966 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.242200 30058 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.235594 30069 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:27.313218 30080 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.278616 30023 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:27.307209 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.315943 27318 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:27.313086 30069 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.307873 29919 tablet_copy_client.cc:806] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:27.317793 29919 tablet_copy_client.cc:670] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:27.162024 30161 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:08:27.307760 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.307875 26752 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:27.182454 30194 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.298190 30200 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.312242 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.312587 27314 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:27.313143 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.333449 26609 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:27.282984 30024 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:27.335106 26756 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.306571 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.278193 30136 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.326982 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:27.327924 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117504us
I20260709 13:08:27.328109 30056 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.290408 30001 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.327051 26603 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:27.286422 30082 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:27.306223 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.324697 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:27.335716 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59323.3us
I20260709 13:08:27.310873 30185 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.332535 30058 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.309238 30122 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:27.337934 26650 leader_election.cc:336] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.007s (SENT)
I20260709 13:08:27.366923 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:27.367839 26650 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.010s (SENT)
I20260709 13:08:27.340659 30184 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:27.348202 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.335770 26604 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:27.334065 30200 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.363746 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.239946 30126 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.368476 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.374742 30049 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:27.380980 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.381762 26609 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:27.374293 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:27.388378 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.390125 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.405157 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.367839 30047 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.362821 30082 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.350515 30136 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:27.374517 29881 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.005s
I20260709 13:08:27.415557 26604 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:27.412379 29860 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:27.372418 30122 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:27.420694 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.371867 30069 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:27.422152 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54339us
I20260709 13:08:27.427289 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.334647 30083 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.432384 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.410640 30187 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.411471 30092 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:27.411022 30047 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.371037 30185 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.445231 29947 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.445679 29947 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.446049 29947 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.446892 30185 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.416043 29976 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:27.423105 30089 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.448755 30089 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.452900 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.421084 30057 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:27.457324 26760 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:27.457664 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.457581 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.458709 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.458851 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:27.459093 30159 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.002s
I20260709 13:08:27.459507 30159 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.461534 26608 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:27.463454 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.464094 26682 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:27.458721 26756 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:27.440939 30143 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:27.441357 30132 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.456477 30194 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.464777 26753 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:08:27.438405 30206 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:08:27.439062 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.497234 30195 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:27.497388 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58405.9us
I20260709 13:08:27.497988 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1255) took 2372 ms. Trace:
I20260709 13:08:27.440539 26609 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:08:27.440091 30142 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.007s
I20260709 13:08:27.425936 30122 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.420495 29860 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:27.470129 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.459468 26758 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:27.451416 30123 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.003s
I20260709 13:08:27.473675 26607 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:27.440021 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:27.486529 29976 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:27.488796 26608 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:27.536731 26507 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 8, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:27.491771 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.530876 30119 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.371546 30190 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:27.491827 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.499274 26650 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.441s (SENT)
I20260709 13:08:27.498410 26755 rpcz_store.cc:276] 0709 13:08:25.125701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.479794 (+1354093us) service_pool.cc:224] Handling call
0709 13:08:26.480157 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.714687 (+234530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.714718 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:26.792743 (+ 78025us) log.cc:844] Serialized 52 byte log entry
0709 13:08:27.002219 (+209476us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:27.002289 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.002407 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.497758 (+495351us) raft_consensus.cc:1685] finished
0709 13:08:27.497777 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.497919 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122706,"raft.queue_time_us":233052,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":208970,"threads_started":1,"wal-append.queue_time_us":374229}
I20260709 13:08:27.504575 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:27.538033 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 98091.5us
I20260709 13:08:27.545893 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.538350 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.546814 30056 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.547057 30080 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.540016 26754 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:27.505762 27316 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:27.478302 30184 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.505084 30057 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:27.548473 30199 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.548619 30184 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.549021 30199 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.550794 30184 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.551606 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.552896 30199 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.553764 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:27.554391 26607 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:27.554656 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.557106 30122 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.508262 30136 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.508867 30026 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.502281 30143 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:08:27.562206 27316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 432) took 2178 ms (client timeout 1966 ms). Trace:
W20260709 13:08:27.562711 27316 rpcz_store.cc:269] 0709 13:08:25.383881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.384001 (+   120us) service_pool.cc:224] Handling call
0709 13:08:27.561979 (+2177978us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54004c7cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:27.562103 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4847633152}
I20260709 13:08:27.564417 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.566387 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.567119 30026 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.568883 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.568356 26507 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.569877 30026 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.512540 29993 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.512287 29860 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.571364 29860 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.570361 26507 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 1 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), now has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:27.573927 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.573391 26507 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: leader changed from <none> to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 4 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:08:27.469264 30128 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.575800 30199 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:27.577905 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:27.578594 26758 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:27.580152 30089 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.581111 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.581941 30001 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.582346 30001 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.582430 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.582847 30001 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.583303 30026 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:27.585004 30026 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.585418 30026 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.585807 30026 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:27.590906 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.591893 30128 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.575112 26507 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 7 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.596561 30082 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.521565 26609 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:27.522358 26686 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:27.498795 30083 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.526844 30058 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:27.528250 30073 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.990s	user 0.007s	sys 0.004s
I20260709 13:08:27.529207 30164 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.535944 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:27.640587 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104739us
I20260709 13:08:27.536475 29919 tablet_copy_client.cc:538] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:27.536530 30092 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.466408 30047 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.544858 30142 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.602137 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:27.605047 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.519136 26752 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:27.544081 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:27.673069 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 71045.1us
W20260709 13:08:27.674266 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.675016 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.677611 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:27.678457 26685 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:27.680567 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:27.644011 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.682955 26758 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.559480 30122 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.597352 26507 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 3 to 5, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 5 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:27.672907 30024 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:27.695559 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.695592 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90649.4us
I20260709 13:08:27.697007 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.697640 26507 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 4 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:08:27.704704 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1536) took 2340 ms. Trace:
I20260709 13:08:27.645649 30199 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:27.643162 30058 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:27.729707 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:27.705325 26761 rpcz_store.cc:276] 0709 13:08:25.364138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.790266 (+1426128us) service_pool.cc:224] Handling call
0709 13:08:26.790605 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.790841 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:27.083605 (+292764us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.558526 (+474921us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b1800337180. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:27.704233 (+145707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:27.704306 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:27.704387 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.704477 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.704634 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47623,"prepare.queue_time_us":420321,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":73795,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":7673088,"thread_start_us":901226,"threads_started":3,"wal-append.queue_time_us":341801}
W20260709 13:08:27.729684 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 423489us
I20260709 13:08:27.688627 30134 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.742188 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:27.693065 30136 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:27.692945 30143 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.746440 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:27.693539 30159 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.537762 30123 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:27.747776 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 114660us
W20260709 13:08:27.775997 26509 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 210) took 26694 ms (client timeout 15000 ms). Trace:
W20260709 13:08:27.777220 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.777977 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:08:27.749576 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 268354us
W20260709 13:08:27.779455 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3678690220000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.47590000000000005s for a response
W20260709 13:08:27.780243 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2671544690000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2742s for a response
W20260709 13:08:27.780776 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2185544690000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2796s for a response
I20260709 13:08:27.540117 30200 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.645967 30073 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:27.784475 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87588.7us
I20260709 13:08:27.710302 30210 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.788394 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:27.786234 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.728999 30199 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.775224 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:27.788875 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 464219us
I20260709 13:08:27.731125 30023 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:27.750054 30218 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:27.672482 30092 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:27.801581 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.741910 29881 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:27.828006 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:27.832335 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:27.848062 26609 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:27.832121 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57021.1us
I20260709 13:08:27.745318 29860 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:27.836623 26507 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.849457 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.849648 26507 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 7 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.748732 30136 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.750394 30143 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.842442 26759 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:27.843165 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.845486 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.852730 26605 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:08:27.776692 26509 rpcz_store.cc:269] 0709 13:08:01.081520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.081830 (+   310us) service_pool.cc:224] Handling call
0709 13:08:27.775889 (+26694059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:22.603205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:22.701587 (+ 98382us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:22.711526 (+  9939us) write_op.cc:435] Acquired schema lock
0709 13:08:22.715479 (+  3953us) tablet.cc:662] Decoding operations
0709 13:08:23.016314 (+300835us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:23.016411 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:23.016439 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:23.017702 (+  1263us) tablet.cc:701] Row locks acquired
0709 13:08:23.017752 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:08:23.017959 (+   207us) write_op.cc:270] Start()
0709 13:08:23.018115 (+   156us) write_op.cc:276] Timestamp: P: 1783602503017894 usec, L: 0
0709 13:08:23.018137 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:23.094371 (+ 76234us) log.cc:844] Serialized 5301 byte log entry
0709 13:08:23.327185 (+232814us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:23.560159 (+232974us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.830170 (+270011us) write_op.cc:301] APPLY: starting
0709 13:08:23.830270 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.830552 (+   282us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.830589 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.872395 (+ 41806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.872748 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:08:23.872799 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:23.873222 (+   423us) log.cc:844] Serialized 95 byte log entry
0709 13:08:23.873420 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.873555 (+   135us) write_op.cc:454] Released schema lock
0709 13:08:23.873619 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.874006 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.874034 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3040192,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":269724,"apply.run_cpu_time_us":4212,"apply.run_wall_time_us":43839,"num_ops":13,"prepare.queue_time_us":145131,"prepare.run_cpu_time_us":41597,"prepare.run_wall_time_us":652025,"raft.queue_time_us":79195,"raft.run_cpu_time_us":29062,"raft.run_wall_time_us":159400,"replication_time_us":541860,"spinlock_wait_cycles":4471552,"thread_start_us":443775,"threads_started":4,"wal-append.queue_time_us":164299,"wal-append.run_cpu_time_us":50019,"wal-append.run_wall_time_us":2290677}]]}
I20260709 13:08:27.745108 30115 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:08:27.749715 30131 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:08:27.834270 30132 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.865547 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.032s
I20260709 13:08:27.749871 30161 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:08:27.783634 30103 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:08:27.864200 26507 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 3 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 7 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.843006 30128 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:27.869869 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:27.824880 30044 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.833385 30199 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:27.749473 29659 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:08:27.836398 30159 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.863922 30143 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.865409 30119 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:27.750125 30134 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.876430 30057 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:27.869618 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1534) took 1004 ms. Trace:
I20260709 13:08:27.956657 26605 rpcz_store.cc:276] 0709 13:08:26.865296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.941526 (+ 76230us) service_pool.cc:224] Handling call
0709 13:08:27.869431 (+927905us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54001f6654. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:27.869564 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092644224}
I20260709 13:08:27.886356 26752 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:27.886439 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:27.958577 26682 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:27.889988 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44639.3us
I20260709 13:08:27.884650 30161 consensus_queue.cc:1243] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:27.891063 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:27.825253 30069 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:08:27.924372 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.851450 30191 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:27.863760 30136 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:27.877367 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.032s
I20260709 13:08:27.934367 30159 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:27.976027 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.890821 29881 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.891589 30129 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.894816 30103 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:27.894160 30044 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.980969 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.945104 29860 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:27.986723 26753 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8.
I20260709 13:08:27.891618 30226 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:27.975462 29947 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:08:27.964943 30057 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.999323 30057 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:27.873435 30024 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.843255 30058 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:27.968571 30128 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:28.007441 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.013813 30023 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.014415 30023 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.945456 30109 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:28.031913 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:27.968662 29884 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:08:27.932169 30132 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:27.991114 30044 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:28.034844 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.993393 30082 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:27.996483 29976 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.009557 30159 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.056074 30123 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:28.057693 29976 raft_consensus.cc:2764] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:08:28.060423 30216 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:08:28.061836 30200 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.067898 30073 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:27.986264 30191 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.074514 30026 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.006115 29860 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:28.076486 29860 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.028690 30164 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:28.080936 30217 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:28.028623 30109 consensus_queue.cc:1243] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:28.083554 30128 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.085803 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2583) took 1034 ms. Trace:
I20260709 13:08:28.086220 26678 rpcz_store.cc:276] 0709 13:08:27.051396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.167331 (+115935us) service_pool.cc:224] Handling call
0709 13:08:27.167872 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.207578 (+ 39706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.207608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.208184 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.685472 (+477288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:27.685528 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.685623 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.085561 (+399938us) raft_consensus.cc:1685] finished
0709 13:08:28.085582 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.085737 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28108,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8275,"thread_start_us":407215,"threads_started":1,"wal-append.queue_time_us":649392}
W20260709 13:08:28.088464 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 299044us
I20260709 13:08:28.089875 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:28.091897 26678 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.091786 26682 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
W20260709 13:08:28.096969 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 270873us
I20260709 13:08:28.090876 26609 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:28.108332 27316 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:28.112856 26758 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:28.121640 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.130290 26678 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:28.084935 30183 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.133131 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:28.141485 26683 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:28.010468 29947 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.152206 26678 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:28.158826 26682 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:28.170856 26680 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:28.171192 26683 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:28.173715 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:28.176931 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.177743 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.114886 30126 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.185796 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.186545 26758 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:28.109301 30123 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:08:28.116300 30044 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.214167 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:28.204792 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:28.210865 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.223779 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:08:28.227821 30195 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
I20260709 13:08:28.230473 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:28.224692 30230 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:28.233816 26759 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:28.144143 30088 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:08:28.132160 30226 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:08:28.239300 26682 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:28.257375 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:28.230055 26678 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:28.172631 30191 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:28.273047 26686 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:28.221822 30221 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.277935 26683 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:28.273191 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 403418us
I20260709 13:08:28.206656 30092 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:28.268637 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44990.8us
I20260709 13:08:28.279165 27320 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:28.280618 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:28.280670 26612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.038s	sys 0.053s
W20260709 13:08:28.284648 26612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.038s	sys 0.053s
W20260709 13:08:28.284298 26684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.001s	sys 0.013s
W20260709 13:08:28.293987 26684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.002s	sys 0.013s
I20260709 13:08:28.298256 26683 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:28.299477 26757 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:08:28.304044 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 251323us
I20260709 13:08:28.307229 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.308073 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:28.305373 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.309080 26757 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.311105 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:28.312103 26759 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:28.313019 30182 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.316998 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:28.317323 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2602) took 1014 ms. Trace:
I20260709 13:08:28.318496 26684 rpcz_store.cc:276] 0709 13:08:27.302851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.303004 (+   153us) service_pool.cc:224] Handling call
0709 13:08:27.324312 (+ 21308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.324558 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:27.640340 (+315782us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.316312 (+675972us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.316896 (+   584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.316964 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:28.317023 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.317109 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.317255 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120158,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":10964,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":957667,"threads_started":2}
I20260709 13:08:28.329236 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:28.349726 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 327308us
I20260709 13:08:28.350214 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:28.279932 30082 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:28.356990 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:28.306372 30200 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.358031 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.306298 30069 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:28.281447 30143 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.303042 30247 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.374866 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:28.330572 30026 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:28.387200 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 51974.5us
I20260709 13:08:28.329850 30182 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:28.330062 29993 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.351011 30119 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:28.388829 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:28.398223 26758 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.402377 26684 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:28.404166 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.404978 26759 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:28.314673 30092 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.419045 26758 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:28.420574 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:28.421478 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 46693.4us
W20260709 13:08:28.421824 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 93001.6us
I20260709 13:08:28.422480 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.422336 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:28.424985 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.389513 30247 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:28.473351 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 51101.3us
W20260709 13:08:28.421519 30083 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.001s
W20260709 13:08:28.482694 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 190342us
I20260709 13:08:28.476105 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:28.416831 30132 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.496825 26610 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:28.497303 26610 pending_rounds.cc:85] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 7
I20260709 13:08:28.396400 30195 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:28.445430 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:28.435827 30001 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.852s	user 0.012s	sys 0.004s
I20260709 13:08:28.497608 26610 pending_rounds.cc:107] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:28.508932 26610 raft_consensus.cc:2889] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.420931 30253 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.423797 30182 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:28.388515 30200 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.435693 30184 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.506559 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.475208 29993 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.432063 30073 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:28.507401 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.513422 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:28.510689 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65388.1us
I20260709 13:08:28.436467 30026 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:28.423950 30049 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:08:28.491910 30164 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:28.492215 29947 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:28.515177 26758 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:28.515408 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.491914 30247 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:28.517760 30233 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:08:28.494589 30228 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.394533 30069 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.508240 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:28.534276 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.510159 30195 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:28.424409 30119 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.513798 30092 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.513396 30184 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.514021 29993 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:28.514513 30073 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.547405 30044 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.549464 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:28.550542 30136 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.001s
I20260709 13:08:28.584683 26758 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:28.584559 30136 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.551915 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:28.504248 30159 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:28.537042 30236 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:08:28.508776 30245 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:28.514258 30001 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:28.551631 30237 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:08:28.540804 30164 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:28.593552 30073 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.538048 29860 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.628948 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:28.560900 30238 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:08:28.557994 30195 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:28.638461 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 120852us
I20260709 13:08:28.559903 27314 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:28.646627 27317 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:28.668743 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 134537us
I20260709 13:08:28.512967 30185 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:28.671403 26757 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:28.674474 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:28.733042 26609 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:28.734159 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:28.551916 30228 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.735359 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:28.735850 26606 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
W20260709 13:08:28.664165 30239 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:08:28.646303 30200 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.565019 30092 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.565383 29993 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:28.690896 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6998657280000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:08:28.744719 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6287657280000758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:08:28.745514 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5963657280000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:08:28.745855 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5441657280000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:08:28.746176 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5153657280001198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:08:28.746487 26650 connection.cc:256] RPC call timeout handler was delayed by -1.4190657280000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22610000000000002s for a response
I20260709 13:08:28.685122 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:28.676725 30242 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:08:28.747922 27315 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 5.
I20260709 13:08:28.700965 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:28.566461 30184 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.715956 30024 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:28.701563 30047 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.002s
W20260709 13:08:28.721275 30142 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.028s	user 0.006s	sys 0.005s
I20260709 13:08:28.721771 30134 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:28.722926 30159 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:28.723377 30255 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:28.724615 30119 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:28.725783 30248 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:08:28.733155 27313 raft_consensus.cc:2368] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:28.790097 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.675405 30049 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.678700 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:28.736258 26606 pending_rounds.cc:85] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 4
I20260709 13:08:28.791113 26606 pending_rounds.cc:107] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:28.788923 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1553) took 1231 ms. Trace:
I20260709 13:08:28.791410 26606 raft_consensus.cc:2889] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.791589 26754 rpcz_store.cc:276] 0709 13:08:27.557727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.558006 (+   279us) service_pool.cc:224] Handling call
0709 13:08:27.558320 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.558669 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.558697 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.559222 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.937943 (+378721us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:27.938005 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.938105 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.788685 (+850580us) raft_consensus.cc:1685] finished
0709 13:08:28.788706 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.788864 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":58,"thread_start_us":378296,"threads_started":1,"wal-append.queue_time_us":610782}
I20260709 13:08:28.792788 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:28.793709 26606 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:28.736485 26612 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:28.738085 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:28.796710 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:28.738834 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 186995us
I20260709 13:08:28.747128 30092 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:28.700956 30199 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.002s
I20260709 13:08:28.749054 26683 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.750110 26611 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:28.715575 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.751230 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.814190 27316 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:28.683696 30143 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.630946 30182 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:28.747414 26650 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.506s (SENT)
I20260709 13:08:28.822119 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:28.699419 30026 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:28.761037 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:28.772392 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:28.751787 30024 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.785344 30047 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.786047 29659 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.796155 30049 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.786513 30164 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.797824 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:28.843457 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45730.5us
W20260709 13:08:28.843990 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 96598.7us
W20260709 13:08:28.844636 26650 leader_election.cc:336] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.548s (SENT)
I20260709 13:08:28.845005 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:28.797223 26607 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:28.800791 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.801137 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:28.783908 30128 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.806566 30057 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.001s
I20260709 13:08:28.844746 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:28.770422 30103 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:28.788532 30221 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.790167 30142 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:28.827057 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 54772us
I20260709 13:08:28.739192 26608 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:28.859910 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:28.846419 26607 pending_rounds.cc:85] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 5
I20260709 13:08:28.860778 26607 pending_rounds.cc:107] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:08:28.861120 26607 raft_consensus.cc:2889] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.846903 26683 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:28.809324 30261 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:08:28.848315 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1555) took 1249 ms. Trace:
I20260709 13:08:28.849444 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.835904 30024 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.816354 30134 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:28.882277 29919 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:08:28.882526 30134 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.866072 30103 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.884617 30134 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:28.836275 30260 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.885636 30103 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:28.846342 30189 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.888043 27318 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:28.887955 30026 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.863098 26604 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:28.817555 30199 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.786540 30073 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.863507 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:28.867175 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 129766us
I20260709 13:08:28.866914 26755 rpcz_store.cc:276] 0709 13:08:27.598417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.598562 (+   145us) service_pool.cc:224] Handling call
0709 13:08:27.599021 (+   459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.599477 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.599521 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.600317 (+   796us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.086448 (+486131us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:28.086489 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.086555 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.848119 (+761564us) raft_consensus.cc:1685] finished
0709 13:08:28.848140 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.848261 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1539,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":485701,"threads_started":1,"wal-append.queue_time_us":714516}
I20260709 13:08:28.870095 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:28.875609 30069 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.876119 30047 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:28.862375 30128 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:28.878998 30122 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.889623 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:28.983796 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:29.146847 30276 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.208611 30276 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.209407 30073 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:29.209936 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 365303us
W20260709 13:08:29.210605 26650 leader_election.cc:336] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.564s (SENT)
I20260709 13:08:29.210179 30024 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:28.994477 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:29.214233 26754 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 5.
I20260709 13:08:29.214506 26606 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:08:28.994194 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 134389us
I20260709 13:08:29.215894 26758 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.216460 26758 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:29.216557 26757 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.052366 27314 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:28.866472 30262 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:28.891808 30269 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:28.889860 29860 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:29.042500 30271 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:29.169191 30221 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:29.207480 30128 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.207901 26611 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:29.205765 27318 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:28.844535 30049 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.894966 27320 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:29.217240 26758 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:29.219478 26650 leader_election.cc:336] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.838s (SENT)
I20260709 13:08:29.247752 26758 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.198674 30119 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.205003 30058 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.921908 29659 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.891527 30001 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:28.890864 30136 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.220178 30120 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:29.268321 30120 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:29.269210 30120 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.231973 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.272100 26684 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:29.234529 26724 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:29.273218 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 56447.1us
I20260709 13:08:29.273474 26758 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:29.274022 26758 pending_rounds.cc:85] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:08:29.275977 26757 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:29.247598 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:29.277029 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57557.9us
I20260709 13:08:29.277330 30128 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:29.278225 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.278882 26606 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
W20260709 13:08:29.279146 26650 leader_election.cc:336] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.154s (SENT)
I20260709 13:08:29.221207 27316 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:29.223130 30200 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:28.862709 30057 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.112588 30092 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.250342 30221 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.265216 30276 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.236815 30269 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.245649 30271 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.234195 30184 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:29.251607 30195 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.002s
I20260709 13:08:29.239029 30262 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:29.281863 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.024221 30211 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.308616 30211 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.309794 30221 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:29.310812 30211 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:29.285565 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.311964 30269 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:29.299104 30275 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:08:29.313165 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:29.314785 29659 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:29.290331 26650 leader_election.cc:336] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.261s (SENT)
I20260709 13:08:29.293074 27313 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:29.296427 27318 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:29.316314 26650 leader_election.cc:336] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.895s (SENT)
I20260709 13:08:29.274303 26758 pending_rounds.cc:107] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:29.316845 26758 raft_consensus.cc:2889] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.317240 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:29.274279 30199 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:29.317595 30115 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:29.293197 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:29.318773 27314 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:29.318929 30115 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:29.312018 26683 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:29.244850 29993 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.317341 30262 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.037925 30023 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:29.316713 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:29.325114 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.322104 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:29.325934 26757 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:29.339078 30260 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:29.339645 30260 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.340090 30260 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.260828 30119 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.348625 26612 raft_consensus.cc:1217] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-10.6]   Dedup: 7.4->[8.5-10.6]
I20260709 13:08:29.368115 26612 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:08:29.354714 26684 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:29.357180 29993 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.346230 30221 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:29.346400 29659 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:29.324487 30069 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:29.361306 30057 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:29.363333 30049 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.336911 30199 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:29.254395 29860 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.319582 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:29.364326 30023 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.374372 30026 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.359902 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43613.2us
W20260709 13:08:29.412014 26650 leader_election.cc:336] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.107s (SENT)
I20260709 13:08:29.413635 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.414950 26650 leader_election.cc:400] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:29.415318 26650 leader_election.cc:403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.379247 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.385495 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.416342 26603 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:29.417351 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.417807 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.364503 30260 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.424480 30260 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:29.373075 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.424962 30184 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.427897 30211 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:29.428483 30211 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:29.428927 30211 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:29.320675 30195 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.395526 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.434103 26606 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:29.406208 26608 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 13:08:29.383001 30257 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.746s	user 0.000s	sys 0.010s
I20260709 13:08:29.418015 26603 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:29.365130 30271 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:29.346329 30103 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:29.453218 30103 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.453758 30103 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:29.388082 30069 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:29.454828 26681 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:29.422134 27314 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:29.432643 26612 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:29.390681 29860 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.464339 26612 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:29.403781 30280 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:08:29.436407 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 63422.7us
I20260709 13:08:29.480876 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:29.400317 30282 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:08:29.438092 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:29.440758 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:29.402556 30049 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.468935 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.485291 27321 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:29.486073 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.472842 30056 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.473305 30044 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:29.473204 30103 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.478479 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.482645 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:29.499145 26612 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.471740 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.486931 26681 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:29.485889 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.456038 29884 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:29.483474 30001 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.461767 30247 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.000s
I20260709 13:08:29.455786 30023 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:29.507297 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.500691 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.517158 26687 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:29.506008 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 343) took 1149 ms. Trace:
W20260709 13:08:29.501145 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 63147.3us
I20260709 13:08:29.517889 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.517750 26609 rpcz_store.cc:276] 0709 13:08:28.356556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.356728 (+   172us) service_pool.cc:224] Handling call
0709 13:08:29.505753 (+1149025us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540037a0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:29.505934 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862673792}
I20260709 13:08:29.518544 26687 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.508677 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.492331 30069 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.510725 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.519047 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:29.519642 26683 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.496299 27319 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.520938 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.513804 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.524258 26682 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:29.522634 26681 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:29.518123 26612 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:29.435827 30026 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:29.529539 30026 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.530676 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:29.531384 26755 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:29.532938 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.535092 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.535957 26679 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:29.525223 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:29.502449 30136 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.540807 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.509701 29884 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.532680 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.510157 29860 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.527201 30119 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.544759 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.557541 26754 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.514972 30057 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.549923 26681 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:29.550004 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64188.8us
I20260709 13:08:29.497756 30056 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.556221 26683 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:29.566594 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.569173 26754 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:29.558109 26687 raft_consensus.cc:2410] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:29.549108 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.559391 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.524428 30103 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.564680 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.523479 30128 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:29.551263 26755 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:29.578981 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.561594 30023 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:29.581552 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.582500 26683 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:29.563446 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:29.584918 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.597164 26687 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:29.579478 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:29.587971 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79673.2us
I20260709 13:08:29.589304 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:29.557124 29884 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.520651 30001 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.522255 30247 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.614066 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:29.625998 26576 leader_election.cc:400] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8.
I20260709 13:08:29.645191 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:29.659489 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 126624us
I20260709 13:08:29.659578 26679 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:29.648047 30277 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.413s	user 0.007s	sys 0.000s
I20260709 13:08:29.649830 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:29.560866 30221 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:29.561285 30122 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.653218 26683 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:29.653923 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.658110 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:29.660808 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:29.660933 26576 leader_election.cc:403] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.578127 29993 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:29.739558 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 183182us
I20260709 13:08:29.713629 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:29.578518 30119 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:29.587997 30026 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.585091 30210 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.745231 30221 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:29.669971 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:29.649012 30083 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:29.648711 30073 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:29.610319 30136 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:29.560737 29860 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.652432 29881 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:29.586589 30128 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:29.751870 26607 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:29.751578 30119 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.663874 26681 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:29.578312 30089 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:08:29.572409 30057 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:29.762650 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 136869us
I20260709 13:08:29.773586 26682 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:29.585772 30271 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 13:08:29.585973 30276 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
W20260709 13:08:29.741700 30274 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:08:29.753046 30280 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:29.783180 30221 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.811939 27321 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:29.821542 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.654507 30023 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.737414 30298 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:29.675745 30230 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:08:29.844475 26607 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:29.845427 26679 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:29.847183 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:29.786250 30184 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8.
I20260709 13:08:29.825062 30128 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.856345 27321 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:29.752974 29993 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.830755 30119 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.841704 30195 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:29.864804 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 122174us
I20260709 13:08:29.850580 30049 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.812500 30083 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:29.841450 30303 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:29.823206 30073 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.771404 30026 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.910518 29860 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.912585 30026 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.810686 30210 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.915216 30210 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.825344 30136 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.916988 30056 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:29.887266 30049 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.920455 30049 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:29.872087 30291 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:08:29.887913 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:29.894047 30289 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.472s	user 0.002s	sys 0.000s
W20260709 13:08:29.895747 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.896518 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.925495 26603 raft_consensus.cc:2376] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10. Re-sending same reply.
I20260709 13:08:29.926525 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.927090 26603 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:29.897948 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.902778 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2571) took 1163 ms. Trace:
I20260709 13:08:29.928056 26611 rpcz_store.cc:276] 0709 13:08:28.739294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.812453 (+ 73159us) service_pool.cc:224] Handling call
0709 13:08:28.812770 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.246818 (+434048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.902472 (+655654us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54003791d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:29.902701 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908171136}
I20260709 13:08:29.908267 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 435) took 2602 ms. Trace:
I20260709 13:08:29.908411 30001 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.909946 29852 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:29.930274 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:29.929286 27317 rpcz_store.cc:276] 0709 13:08:27.305448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.305578 (+   130us) service_pool.cc:224] Handling call
0709 13:08:27.315950 (+ 10372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.707182 (+1391232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.907972 (+1200790us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54005406d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:29.908196 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3059731712}
I20260709 13:08:29.939850 26603 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:29.941082 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.945081 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:29.855651 30298 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:29.950071 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.953642 30308 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:29.960698 30293 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:29.961534 30024 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:29.965747 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.976938 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.911509 29860 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:29.980950 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:29.984900 26607 raft_consensus.cc:2376] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6. Re-sending same reply.
I20260709 13:08:29.985982 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.944378 29852 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:29.970057 30292 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
W20260709 13:08:29.991012 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 125565us
I20260709 13:08:29.987303 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:29.927202 30303 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.028034 26607 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 6: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:29.964422 30276 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:08:30.043622 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.048063 27321 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:30.048553 27321 pending_rounds.cc:85] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 8
I20260709 13:08:30.048823 27321 pending_rounds.cc:107] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:30.049091 27321 raft_consensus.cc:2889] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.046499 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:30.017485 29860 consensus_queue.cc:1243] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:29.992390 29881 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:30.107087 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45357us
I20260709 13:08:30.113982 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:29.990725 30305 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:08:30.047037 30136 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:30.126474 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 248400us
I20260709 13:08:30.123126 30026 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:30.116976 30302 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:30.122557 30089 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:30.128437 30057 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.135445 29881 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:30.143527 30300 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:08:30.143414 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.144268 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:30.145351 30299 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:08:30.162983 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.122612 30056 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:30.138501 30122 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.155849 26756 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:30.157280 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.155619 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.156478 26754 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:08:30.136850 30260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.017s	sys 0.027s
W20260709 13:08:30.147245 30058 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.002s
I20260709 13:08:30.166435 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.139443 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.191558 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.139163 30023 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:30.197593 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 344) took 1722 ms (client timeout 1524 ms). Trace:
W20260709 13:08:30.198258 26605 rpcz_store.cc:269] 0709 13:08:28.475596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.475789 (+   193us) service_pool.cc:224] Handling call
0709 13:08:30.197354 (+1721565us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54002391d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:30.197506 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695866112}
I20260709 13:08:30.198745 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:30.172360 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.172158 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.203425 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.204155 26605 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:30.205229 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.206700 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.180608 30310 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:30.152272 30026 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:30.181609 30256 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.547s	user 0.007s	sys 0.011s
I20260709 13:08:30.163919 26606 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:30.191151 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.195907 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:30.125873 29852 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.149194 30302 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.153877 30089 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.216908 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.152907 30083 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:30.595222 26756 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:30.597383 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.597451 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.605257 30136 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.605491 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:30.606264 30136 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:30.606523 30253 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:30.606660 30136 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:30.607095 30253 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:30.607506 30136 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.607991 30253 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.609265 30136 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.597859 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.596607 30310 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.612562 26608 raft_consensus.cc:2368] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:30.613382 26757 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:30.596046 26611 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:30.614712 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.598300 30303 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:30.598667 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.257752 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:30.580658 30271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.002s	sys 0.016s
W20260709 13:08:30.470196 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.618162 26606 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:30.247875 30244 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.859s	user 0.009s	sys 0.000s
W20260709 13:08:30.583597 30221 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.000s
I20260709 13:08:30.600759 30305 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.203143 30122 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.663018 30305 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.664410 30122 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:30.566155 30184 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.665196 30305 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.665612 30184 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:30.667387 29884 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.006s	user 0.008s	sys 0.002s
I20260709 13:08:30.667898 29884 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.668401 30184 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:30.246923 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 116077us
I20260709 13:08:30.580689 30315 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:30.669899 30315 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.672008 30315 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:30.260639 30265 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.585s	user 0.011s	sys 0.006s
I20260709 13:08:30.601894 30302 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.245451 26605 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:30.673758 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.603724 30260 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:30.674329 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:30.674678 26605 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:30.604826 30322 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:30.593716 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.674981 27315 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:30.620937 26756 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:30.678978 26607 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:30.677049 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.681927 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.682739 26678 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:08:30.676680 30128 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.804s	user 0.005s	sys 0.006s
I20260709 13:08:30.622217 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.613662 30089 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.623015 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2614) took 2401 ms. Trace:
I20260709 13:08:30.623911 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 334) took 2944 ms. Trace:
W20260709 13:08:30.620121 30271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.002s	sys 0.017s
I20260709 13:08:30.681650 30322 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.600045 30026 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.604341 30298 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:30.613691 30211 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.175s	user 0.008s	sys 0.004s
I20260709 13:08:30.638962 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 352) took 1040 ms. Trace:
I20260709 13:08:30.700567 26608 rpcz_store.cc:276] 0709 13:08:29.598961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.637957 (+1038996us) service_pool.cc:224] Handling call
0709 13:08:30.638270 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.638613 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.638643 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.638685 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:30.638722 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.638778 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.638900 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":853,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74}
I20260709 13:08:30.702092 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.703562 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.703924 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.704563 26608 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:30.704643 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.705265 26684 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:08:30.641072 30103 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.050s	user 0.008s	sys 0.000s
W20260709 13:08:30.644989 30119 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
I20260709 13:08:30.685772 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:30.685901 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.711514 26607 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:30.687167 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.712543 26761 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:30.712404 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.219123 30073 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.629258 30310 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:30.689395 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.688742 26685 rpcz_store.cc:276] 0709 13:08:27.679575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.681881 (+  2306us) service_pool.cc:224] Handling call
0709 13:08:27.682303 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.694193 (+ 11890us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:27.694229 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.694735 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.986653 (+291918us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:27.986692 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.986770 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.190440 (+2203670us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:30.623587 (+433147us) raft_consensus.cc:1685] finished
0709 13:08:30.623609 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.623842 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6380,"raft.queue_time_us":19255,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":23934,"spinlock_wait_cycles":45956992,"thread_start_us":291521,"threads_started":1,"wal-append.queue_time_us":597646}
I20260709 13:08:30.718411 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.719163 26685 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:30.691277 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.691612 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.688499 26680 rpcz_store.cc:276] 0709 13:08:28.221949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.222231 (+   282us) service_pool.cc:224] Handling call
0709 13:08:28.222654 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.222957 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.222994 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.223508 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.425588 (+202080us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:28.425625 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.425690 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.180969 (+1755279us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:30.622719 (+441750us) raft_consensus.cc:1685] finished
0709 13:08:30.622741 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.622943 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213774208,"thread_start_us":201823,"threads_started":1,"wal-append.queue_time_us":323385}
I20260709 13:08:30.721906 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.697077 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:30.696269 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.722899 26686 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:30.707823 26753 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:30.708338 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:30.674691 30221 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.676134 30115 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:08:30.689668 30308 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.002s
I20260709 13:08:30.709234 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.756738 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.757884 26608 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:30.758961 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.713984 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.682406 30260 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.715055 26759 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:30.764175 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.765692 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:30.766032 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.766754 26608 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:30.763556 26607 raft_consensus.cc:2376] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9. Re-sending same reply.
I20260709 13:08:30.767869 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.768852 26608 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.688416 30314 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:30.693107 30128 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.772608 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.688345 30320 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:08:30.776253 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:30.773415 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49604.8us
I20260709 13:08:30.780305 26755 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:30.781674 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 171955us
I20260709 13:08:30.781810 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.782614 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.784780 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.762419 30103 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.794503 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.791956 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:30.795470 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.790458 26608 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:30.762893 30073 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.792193 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.710045 30211 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.798889 30305 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.808372 26687 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:30.808610 30305 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:30.807524 30211 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:30.809504 30305 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:30.810019 30211 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:30.714538 30326 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:30.799939 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.811534 26608 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:30.800383 30073 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.801348 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.811610 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:30.802063 30281 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.484s	user 0.012s	sys 0.000s
I20260709 13:08:30.802680 30310 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:30.814349 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.712173 30119 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.800706 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.789649 30298 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.800516 30323 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:08:30.807572 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:30.821731 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1299) took 1165 ms. Trace:
I20260709 13:08:30.822224 26758 rpcz_store.cc:276] 0709 13:08:29.655947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.807286 (+1151339us) service_pool.cc:224] Handling call
0709 13:08:30.821652 (+ 14366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.804442 30128 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:30.766748 30271 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:08:30.816119 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.833141 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:30.834110 26608 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:30.812227 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.825946 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.835417 26679 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:30.798717 30315 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.835592 30184 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.837916 30232 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.839179 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.839891 26682 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:30.834358 26607 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:30.836612 26608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:30.813308 30083 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.800534 30228 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:30.810451 30211 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:30.833420 30253 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:30.820261 30302 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.845674 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.836918 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.859498 26608 raft_consensus.cc:606] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:30.862627 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.842849 30092 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.863981 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:30.862378 26608 raft_consensus.cc:614] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:30.866953 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.832100 30310 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:30.868439 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:30.869383 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 71778.7us
I20260709 13:08:30.848629 30253 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:30.850672 30302 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:30.878293 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2575) took 2122 ms. Trace:
I20260709 13:08:30.878727 26604 rpcz_store.cc:276] 0709 13:08:28.756349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.890130 (+133781us) service_pool.cc:224] Handling call
0709 13:08:28.890612 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.890966 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.890990 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.016285 (+125295us) log.cc:844] Serialized 572 byte log entry
0709 13:08:29.307871 (+291586us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:29.307909 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.307975 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.801374 (+1493399us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:30.870837 (+ 69463us) raft_consensus.cc:1685] finished
0709 13:08:30.870864 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.878223 (+  7359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9043712,"thread_start_us":287060,"threads_started":1,"wal-append.queue_time_us":301645}
I20260709 13:08:30.862056 30260 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:30.865043 30083 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.875435 30262 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.869549 30184 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.876461 30315 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:30.874830 30250 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.875128 30303 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.894913 30227 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:30.916337 30322 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:30.917307 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:30.918769 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2594) took 1437 ms. Trace:
I20260709 13:08:30.879171 30089 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:30.890599 30302 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:30.931151 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 133232us
I20260709 13:08:30.935412 26611 rpcz_store.cc:276] 0709 13:08:29.481694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.620174 (+1138480us) service_pool.cc:224] Handling call
0709 13:08:30.633285 (+ 13111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.633649 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.633683 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.634103 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.846333 (+212230us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:30.846391 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.846501 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.918476 (+ 71975us) raft_consensus.cc:1685] finished
0709 13:08:30.918506 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.918689 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":529,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":211824,"threads_started":1,"wal-append.queue_time_us":282183}
I20260709 13:08:30.940358 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:30.941015 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 345) took 1401 ms. Trace:
I20260709 13:08:30.941217 26679 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:30.941574 26610 rpcz_store.cc:276] 0709 13:08:29.539394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.620293 (+1080899us) service_pool.cc:224] Handling call
0709 13:08:30.626727 (+  6434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.626951 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:30.870667 (+243716us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.909702 (+ 39035us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.912136 (+  2434us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.940536 (+ 28400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.940610 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:30.940681 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.940774 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.940931 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1799,"raft.queue_time_us":22739,"spinlock_wait_cycles":12770560,"thread_start_us":308124,"threads_started":3,"wal-append.queue_time_us":49722}
I20260709 13:08:30.945499 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2597) took 1276 ms. Trace:
I20260709 13:08:30.945945 26610 rpcz_store.cc:276] 0709 13:08:29.669416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.944388 (+1274972us) service_pool.cc:224] Handling call
0709 13:08:30.944787 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.945013 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.945119 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.945187 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:30.945232 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.945304 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.945432 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.926447 30184 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:30.968443 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94368.4us
I20260709 13:08:30.968623 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:30.969398 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.886495 29852 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:08:30.962770 30323 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.979569 26679 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:30.959352 30221 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:30.891160 30211 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:30.983150 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:30.988761 26611 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.984213 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:30.970842 30184 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.991173 26679 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:30.975840 30315 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:31.016243 26682 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:30.959893 30253 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:31.019831 30332 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:31.019927 30128 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.020694 30128 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.021762 30260 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:31.012409 30119 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.022596 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2595) took 1373 ms. Trace:
I20260709 13:08:31.022367 30260 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:30.993496 30348 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.968710 30310 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.022984 26606 rpcz_store.cc:276] 0709 13:08:29.649545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.620714 (+971169us) service_pool.cc:224] Handling call
0709 13:08:30.629994 (+  9280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.632770 (+  2776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.632828 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.633447 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.847467 (+214020us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:30.847526 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.847610 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.022379 (+174769us) raft_consensus.cc:1685] finished
0709 13:08:31.022400 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.022544 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1757,"raft.queue_time_us":2102,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":213552,"threads_started":1,"wal-append.queue_time_us":275035}
I20260709 13:08:31.025470 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2598) took 1282 ms. Trace:
I20260709 13:08:31.027113 26606 rpcz_store.cc:276] 0709 13:08:29.743473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.024688 (+1281215us) service_pool.cc:224] Handling call
0709 13:08:31.024987 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.025150 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.025171 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.025207 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:31.025242 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.025296 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.025393 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.027040 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.028676 26611 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:31.030983 26606 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:31.032075 26611 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:31.030812 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:31.029302 30073 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.033442 29881 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:31.033962 29881 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.036103 29881 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.037169 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:31.037806 26758 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.040479 30199 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:31.041029 30199 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:31.041863 30199 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.042764 30184 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.044922 30348 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:31.067104 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.060918 26758 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:31.074077 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:31.047379 30314 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.076253 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.076998 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:31.031556 30347 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.079046 26756 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:31.079399 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:31.081313 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.077970 29852 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:31.081683 30083 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:31.082084 29852 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:31.082489 30228 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:31.082363 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:31.083305 26679 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.083186 30228 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:31.077682 30350 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.071321 30073 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.083067 29852 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.084352 30228 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.084872 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.084431 30302 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.089869 30232 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:31.090397 26604 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:31.099064 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1561) took 1334 ms. Trace:
I20260709 13:08:31.099625 26755 rpcz_store.cc:276] 0709 13:08:29.764531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.764702 (+   171us) service_pool.cc:224] Handling call
0709 13:08:29.784241 (+ 19539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.780860 (+996619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.098741 (+317881us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54000dc5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:31.098985 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290279680}
I20260709 13:08:31.100638 30315 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.101409 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 449) took 1282 ms. Trace:
I20260709 13:08:31.101771 27320 rpcz_store.cc:276] 0709 13:08:29.818630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.819501 (+   871us) service_pool.cc:224] Handling call
0709 13:08:31.101075 (+1281574us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:08:31.101341 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20136832}
I20260709 13:08:31.091110 30026 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.113983 26679 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:31.115041 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.117944 30302 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.084357 30350 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:31.165048 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94161.1us
I20260709 13:08:31.166152 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:31.115849 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 468) took 2203 ms. Trace:
I20260709 13:08:31.091288 30314 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.119521 30026 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:31.173301 30352 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:31.182374 30164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.866s	user 0.008s	sys 0.025s
I20260709 13:08:31.196828 30184 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.199254 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2591) took 1718 ms. Trace:
I20260709 13:08:31.199729 26612 rpcz_store.cc:276] 0709 13:08:29.480827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.537412 (+ 56585us) service_pool.cc:224] Handling call
0709 13:08:29.537695 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.537905 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:29.560552 (+ 22647us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.198801 (+1638249us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b180047ce00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:08:31.198896 (+    95us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.198937 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:31.198985 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.199051 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.199186 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61425,"prepare.queue_time_us":26001,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":102397,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":73824,"spinlock_wait_cycles":19896576,"thread_start_us":55049,"threads_started":1}
W20260709 13:08:31.195859 30164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.880s	user 0.008s	sys 0.025s
I20260709 13:08:31.186542 30355 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:31.170179 27319 rpcz_store.cc:276] 0709 13:08:28.912534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.036978 (+124444us) service_pool.cc:224] Handling call
0709 13:08:29.037343 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.542305 (+504962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.103230 (+1560925us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400600754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:31.110667 (+  7437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007845760}
I20260709 13:08:31.242056 30350 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.244259 30026 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.246166 30323 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.248135 30314 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.249003 30355 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:31.250267 30355 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.255585 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 447) took 1971 ms. Trace:
I20260709 13:08:31.256304 27312 rpcz_store.cc:276] 0709 13:08:29.284404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.377000 (+ 92596us) service_pool.cc:224] Handling call
0709 13:08:29.379049 (+  2049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.379395 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.379425 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.383700 (+  4275us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.107539 (+1723839us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800403240. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:08:31.202889 (+ 95350us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:31.202929 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.202994 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.255129 (+ 52135us) raft_consensus.cc:1685] finished
0709 13:08:31.255161 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.255492 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2946,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4209,"spinlock_wait_cycles":31555328,"thread_start_us":95146,"threads_started":1,"wal-append.queue_time_us":1861233}
W20260709 13:08:31.306581 26576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.831s (SENT) [suppressed 36 similar messages]
I20260709 13:08:31.313392 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.330127 30199 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.331579 30199 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.333909 30026 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.336334 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.337320 30199 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.337564 27312 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:31.350831 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.364203 29852 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.391484 26684 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:08:31.393276 26686 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:08:31.396929 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1302) took 1255 ms. Trace:
I20260709 13:08:31.402931 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1301) took 1264 ms. Trace:
I20260709 13:08:31.403400 26757 rpcz_store.cc:276] 0709 13:08:30.138931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.139140 (+   209us) service_pool.cc:224] Handling call
0709 13:08:31.402528 (+1263388us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54000db6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:31.402761 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968319232}
I20260709 13:08:31.405689 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:31.406494 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1290) took 1894 ms (client timeout 1831 ms). Trace:
W20260709 13:08:31.406982 26761 rpcz_store.cc:269] 0709 13:08:29.511591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.520716 (+  9125us) service_pool.cc:224] Handling call
0709 13:08:31.406033 (+1885317us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400225e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:31.406289 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732796288}
I20260709 13:08:31.397554 26753 rpcz_store.cc:276] 0709 13:08:30.141265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.141453 (+   188us) service_pool.cc:224] Handling call
0709 13:08:31.396370 (+1254917us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000dbbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:31.396619 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215034112}
I20260709 13:08:31.396286 26678 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:31.436002 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 396) took 2681 ms. Trace:
I20260709 13:08:31.436553 27313 rpcz_store.cc:276] 0709 13:08:28.754551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.812931 (+ 58380us) service_pool.cc:224] Handling call
0709 13:08:29.220707 (+407776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.316566 (+ 95859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.418365 (+2101799us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400570154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:31.421601 (+  3236us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400570150. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:31.435801 (+ 14200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103114240}
I20260709 13:08:31.442408 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.457201 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:31.458284 26611 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.462284 27313 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:31.469275 30161 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:31.469333 27286 connection.cc:256] RPC call timeout handler was delayed by -1.3951372379999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:08:31.470063 30161 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:31.477836 29884 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.481132 30161 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.482698 30161 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.484251 26607 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:31.485601 30047 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:31.485956 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.487607 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:31.488284 27318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 446) took 2211 ms (client timeout 1966 ms). Trace:
I20260709 13:08:31.488480 26607 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.486091 30047 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:31.488842 27318 rpcz_store.cc:269] 0709 13:08:29.276335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.316977 (+ 40642us) service_pool.cc:224] Handling call
0709 13:08:31.474270 (+2157293us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54004c7cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:31.488009 (+ 13739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509181824}
I20260709 13:08:31.494601 30247 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:31.495986 30047 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.498790 30047 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.503425 30260 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.511420 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:31.512517 30290 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.861s	user 0.000s	sys 0.017s
I20260709 13:08:31.514201 30026 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.512542 26606 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:31.522629 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.524721 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:31.526652 30303 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:31.527179 30303 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:31.540158 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:31.542856 30345 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.510s	user 0.000s	sys 0.001s
I20260709 13:08:31.515138 27313 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:31.573205 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.575273 30303 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.573971 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:31.576798 30303 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.576241 26612 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:31.583232 26612 raft_consensus.cc:1217] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-10.6]   Dedup: 7.4->[8.5-10.6]
I20260709 13:08:31.571341 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:31.584048 26612 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:08:31.591197 26606 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:31.597211 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.598691 30227 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:31.601163 27319 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:08:31.602304 29881 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:31.604664 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.605707 26753 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:31.606892 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.603193 29881 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.599452 30227 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.613216 30128 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.614059 30227 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.615438 29993 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.618285 30026 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:31.618988 30250 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:31.618461 30348 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:31.623904 26608 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:31.625501 27312 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.631177 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.634017 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.657617 26612 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:31.674993 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.663375 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.694411 26756 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:31.674715 29881 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:31.698982 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.679466 30353 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.710685 26607 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:31.716018 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:31.704509 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.723399 26755 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:31.725437 26678 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.724323 30260 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.737233 30182 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:08:31.737720 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57378.9us
I20260709 13:08:31.739785 30103 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.739894 30222 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.740617 30103 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.740881 30232 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:31.741885 30228 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.743125 30103 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.743435 27286 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:31.745519 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:31.745757 30232 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:31.747248 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:31.747434 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:31.752120 30120 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.728834 29881 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:31.735899 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.757159 30269 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:31.752158 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:31.762131 30088 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:31.762727 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:31.762969 26758 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.763067 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.764245 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.764966 26686 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:31.766572 26679 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:08:31.766458 30269 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:31.767201 29919 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:31.767724 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:31.768314 29881 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:31.768824 29881 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:31.740648 30222 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.769305 26679 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:08:31.770195 29881 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.763204 30088 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:31.772080 30375 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:31.772004 26684 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:31.779435 30260 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.777555 30126 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:31.781546 30126 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.777742 30353 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.784451 29881 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.784559 30253 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.786124 30353 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.771150 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.798137 27312 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
W20260709 13:08:31.800575 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53484.1us
W20260709 13:08:31.779361 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.803234 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.804426 29919 tablet_bootstrap.cc:492] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:08:31.806082 26678 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:31.771857 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:31.810861 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.813771 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:31.798842 30088 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:31.815527 30026 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.815403 30088 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.816241 30026 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.816946 30088 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.818550 30026 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:31.819550 26684 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:31.819962 26684 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:31.820197 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:31.820909 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.822396 30128 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.820505 30227 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:31.852977 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:31.853237 30128 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.853905 26607 raft_consensus.cc:606] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:31.854305 26607 raft_consensus.cc:614] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:31.771080 30222 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:31.856892 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47484.1us
I20260709 13:08:31.857486 30323 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:31.860464 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:31.861055 26607 raft_consensus.cc:606] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:31.861359 26607 raft_consensus.cc:614] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:31.866446 30222 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:31.868510 26679 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:31.868799 26756 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:31.869112 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.869661 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:31.870110 30318 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:31.870770 30318 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:31.873214 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 125901us
W20260709 13:08:31.874540 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.875703 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.866853 30044 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:31.877728 30222 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:31.878036 30044 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:31.878417 30222 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:31.857649 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:31.882738 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.884083 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:31.884380 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.884467 30318 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.886134 30123 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:31.889003 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:31.821022 26753 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:31.890678 30353 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.820283 27316 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:31.886752 30123 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:31.896517 30123 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:31.894356 26679 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:31.892239 26686 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:31.821002 26684 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.914746 26678 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:31.820210 30305 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:31.822604 29919 ts_tablet_manager.cc:1403] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 2.941s	user 0.050s	sys 0.032s
W20260709 13:08:31.923302 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.924748 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:31.809185 30126 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.892380 30161 raft_consensus.cc:2764] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:31.909412 30047 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:31.982023 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57446.9us
I20260709 13:08:31.879223 30044 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:31.919448 30103 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.995865 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 163350us
I20260709 13:08:31.978583 30128 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:31.981386 30227 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:31.992218 30269 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.003067 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:31.894106 30222 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.011265 26684 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:32.012538 30221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.014s	sys 0.014s
W20260709 13:08:32.013052 30221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.015s	sys 0.014s
I20260709 13:08:32.013134 30305 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.014206 30222 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.012465 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:32.019181 26610 raft_consensus.cc:606] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.019739 26610 raft_consensus.cc:614] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:32.022531 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.026587 26606 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:32.008299 30227 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:32.034785 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:32.034267 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:32.020341 30305 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.066617 27320 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:32.067174 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:32.067991 26612 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:32.068912 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:32.069561 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.075533 26650 connection.cc:256] RPC call timeout handler was delayed by -1.7391877079999176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:08:32.080125 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6977877079999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:08:32.075843 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:32.082022 26650 connection.cc:256] RPC call timeout handler was delayed by -1.6689877079999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:08:32.082352 26650 connection.cc:256] RPC call timeout handler was delayed by -1.628487707999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:08:32.082461 27320 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
W20260709 13:08:32.082667 26650 connection.cc:256] RPC call timeout handler was delayed by -1.61858770799995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 13:08:32.084622 26603 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
W20260709 13:08:32.085208 30115 consensus_queue.cc:1175] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "687d192f79a044ce838f0bf292f0c09f" responder_term: 10 status { last_received { term: 8 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [7.5-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:32.085065 27313 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:32.093408 30056 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.094003 30056 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:32.096633 30382 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:32.100766 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63376.6us
I20260709 13:08:32.101737 30247 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.102406 30247 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.085105 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:32.105919 26610 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:32.106233 26610 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:32.107563 30331 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:32.110487 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:32.111325 26680 raft_consensus.cc:2376] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9. Re-sending same reply.
I20260709 13:08:32.115767 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.029969 30103 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.122776 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:32.129738 26684 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:32.107256 26610 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.145037 26685 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:32.146090 30211 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.151202 26686 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:08:32.154978 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52789.7us
W20260709 13:08:32.156689 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.157671 30047 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:32.158802 26610 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:32.159062 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:32.160063 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48463.2us
I20260709 13:08:32.160967 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.161972 30047 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.162426 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:32.163373 26682 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:32.173460 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:32.177913 26610 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:32.175518 26650 leader_election.cc:336] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.502s (SENT)
I20260709 13:08:32.128599 30305 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:32.179649 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.179534 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.183113 30228 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.190886 30228 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.193313 30228 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.193620 30398 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:32.194298 30398 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.188352 30120 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:32.196210 30120 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:32.196615 30120 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.203399 26754 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:32.203997 30376 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.572s	user 0.002s	sys 0.009s
I20260709 13:08:32.204600 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.205935 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.080422 29919 raft_consensus.cc:359] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:32.206199 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2644) took 1214 ms. Trace:
W20260709 13:08:32.206436 30378 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.506s	user 0.002s	sys 0.006s
I20260709 13:08:32.207033 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:32.183269 30303 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.005s
I20260709 13:08:32.219858 26760 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:32.220906 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.222080 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.223093 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.224623 30247 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:32.188023 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:32.218716 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:32.219054 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 351) took 2640 ms (client timeout 2095 ms). Trace:
I20260709 13:08:32.208657 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:32.225936 26606 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
W20260709 13:08:32.226678 26603 rpcz_store.cc:269] 0709 13:08:29.578554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.976017 (+397463us) service_pool.cc:224] Handling call
0709 13:08:32.218775 (+2242758us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:32.218932 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4756388224}
I20260709 13:08:32.236094 26753 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:32.233132 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.241665 26761 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:32.242030 26759 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:32.212901 30103 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:32.247967 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95556.4us
I20260709 13:08:32.248066 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.187403 30044 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:32.236155 30318 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.250675 30247 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:32.241261 29919 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:08:32.244585 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.239166 30253 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:32.257763 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:32.259867 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 97579us
W20260709 13:08:32.260428 26650 leader_election.cc:336] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.549s (SENT)
I20260709 13:08:32.268579 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:32.269111 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.270123 26758 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:32.242729 30120 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.279947 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:32.280936 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.281814 30120 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:32.282825 26612 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.283483 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:32.283926 30398 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:32.259141 30056 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:32.286052 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5924877079999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:08:32.286283 30089 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:32.286733 26650 leader_election.cc:336] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.568s (SENT)
I20260709 13:08:32.286882 30089 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.287217 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.268198 30103 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:32.287961 30089 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.289105 30306 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:32.289552 30306 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.290391 30306 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.291380 30306 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.263403 30253 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:32.278903 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.257124 30247 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:32.291863 30088 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:32.287982 30103 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.292138 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.293525 30318 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.293617 30056 raft_consensus.cc:2764] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:32.294109 30222 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:32.294314 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50675.4us
I20260709 13:08:32.294879 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.295022 30199 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:32.343537 30390 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:08:32.343894 30199 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:32.344394 30199 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:32.298112 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.348448 26755 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:32.300482 26759 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:32.301645 26760 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:32.302634 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.303475 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.306181 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.242069 30227 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.308185 29919 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:32.217124 26683 rpcz_store.cc:276] 0709 13:08:30.991520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.378305 (+386785us) service_pool.cc:224] Handling call
0709 13:08:31.379044 (+   739us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:31.396677 (+ 17633us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:31.397106 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.517093 (+119987us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:31.571154 (+ 54061us) log.cc:844] Serialized 52 byte log entry
0709 13:08:31.571316 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:31.571358 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.571430 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.999116 (+427686us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:32.205720 (+206604us) raft_consensus.cc:1685] finished
0709 13:08:32.205820 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.205998 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":835,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":1409,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":4477,"spinlock_wait_cycles":13560064,"thread_start_us":119109,"threads_started":1,"wal-append.queue_time_us":197042}
W20260709 13:08:32.318794 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.340802 30120 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:32.342000 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49968.8us
I20260709 13:08:32.351815 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.311946 30247 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.311676 30103 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:32.349668 26759 pending_rounds.cc:85] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:32.311743 30088 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:32.396770 30044 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:32.397683 30044 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:32.398042 30044 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:32.398825 29919 ts_tablet_manager.cc:1434] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.417s	user 0.012s	sys 0.009s
I20260709 13:08:32.398998 30044 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.400539 30044 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.292090 30406 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:08:32.406486 26753 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:08:32.407055 26753 pending_rounds.cc:85] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:32.406612 26758 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:32.410140 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.410667 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.411381 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.411898 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:32.419776 30411 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:08:32.420437 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.420392 30253 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.421936 30253 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.412822 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.424823 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.426120 30303 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.426843 30303 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.407346 26753 pending_rounds.cc:107] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:08:32.428483 26753 raft_consensus.cc:2889] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:32.419931 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 125128us
I20260709 13:08:32.416592 26760 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:32.394996 30088 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.416952 26759 pending_rounds.cc:107] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:32.426064 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.416489 30061 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:32.421949 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.418892 30398 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:32.429896 26759 raft_consensus.cc:2889] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.432986 26683 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:32.438769 26755 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:32.439260 26755 pending_rounds.cc:85] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:32.439450 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.441912 26755 pending_rounds.cc:107] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:32.437798 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.442327 26755 raft_consensus.cc:2889] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.442562 26683 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:32.430814 30061 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.458186 30061 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.459837 30318 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.460595 30318 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.452248 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.453768 26753 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:32.436304 30056 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:32.467288 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 178729us
W20260709 13:08:32.472872 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67072.7us
I20260709 13:08:32.440465 30398 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.479849 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:32.481103 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.471979 30161 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:32.482959 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.482177 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:32.488050 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:32.490399 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54164.8us
I20260709 13:08:32.474884 30318 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:32.482523 30120 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:32.496083 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5744877079998787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:08:32.496826 26650 connection.cc:256] RPC call timeout handler was delayed by -1.5249877079999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:08:32.497373 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3701877079998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:08:32.499158 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 47032.5us
I20260709 13:08:32.500372 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:32.500864 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:32.503579 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3620877079998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 13:08:32.501642 26683 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
W20260709 13:08:32.504174 26650 connection.cc:256] RPC call timeout handler was delayed by -1.31258770799991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:08:32.504921 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3116877079999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:08:32.505404 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3017877079998925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:08:32.505844 26650 connection.cc:256] RPC call timeout handler was delayed by -1.226187707999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22940000000000002s for a response
I20260709 13:08:32.477555 30182 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:32.494867 30061 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.513954 26611 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:32.510802 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:32.495832 30120 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:32.519485 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2601) took 1110 ms. Trace:
W20260709 13:08:32.543934 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 43694.2us
I20260709 13:08:32.520031 26608 rpcz_store.cc:276] 0709 13:08:31.403843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.405207 (+  1364us) service_pool.cc:224] Handling call
0709 13:08:32.513530 (+1108323us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003787d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:32.513608 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249634560}
I20260709 13:08:32.544796 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:32.550216 26650 connection.cc:256] RPC call timeout handler was delayed by -1.1136877079999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2419s for a response
W20260709 13:08:32.550886 26650 connection.cc:256] RPC call timeout handler was delayed by -1.022252281999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 13:08:32.496868 30199 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.549052 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.553061 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.540607 30115 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.560362 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.543500 30120 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:32.562011 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123889us
I20260709 13:08:32.564477 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.568248 27320 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:32.564642 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84993.5us
I20260709 13:08:32.563923 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:32.516510 30269 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:32.547983 30305 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.587069 30400 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:08:32.587741 30305 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.590639 30305 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.566457 30136 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:32.591831 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 47069us
I20260709 13:08:32.592257 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:32.571430 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:08:32.596652 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-272d473e821e4c15a9f3fa0471adfdc6 on tablet 272d473e821e4c15a9f3fa0471adfdc6 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:32.571803 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1336) took 3073 ms. Trace:
I20260709 13:08:32.573066 30199 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:32.566495 30083 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:32.599989 26687 rpcz_store.cc:276] 0709 13:08:29.491403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.666281 (+174878us) service_pool.cc:224] Handling call
0709 13:08:29.666577 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.808876 (+1142299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.519200 (+1710324us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001dae54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:32.564592 (+ 45392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625260288}
I20260709 13:08:32.601495 30120 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.564328 30132 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:32.575181 30386 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.552s	user 0.002s	sys 0.000s
I20260709 13:08:32.574638 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:32.579023 26685 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:08:32.561285 30056 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:32.566737 30047 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:32.564260 30123 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:32.608796 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51007.8us
I20260709 13:08:32.610575 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:32.579214 30260 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:32.613157 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 52893.1us
I20260709 13:08:32.609638 30417 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.591578 30136 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:32.622288 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47834us
I20260709 13:08:32.625072 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.599313 30103 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.632848 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:32.608541 30047 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:32.635380 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.637390 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:32.627218 30083 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:32.634842 30115 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:32.641695 30083 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.634682 30303 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:08:32.634549 30126 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:32.644129 26761 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
W20260709 13:08:32.644461 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 133940us
I20260709 13:08:32.643105 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:32.638370 30047 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:32.620883 30056 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.666496 30131 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:32.666998 30131 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.667389 30131 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:32.667825 30389 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.686s	user 0.004s	sys 0.000s
I20260709 13:08:32.668710 30103 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:32.570528 30398 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:32.674113 30394 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 13:08:32.677349 30227 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:32.644556 30115 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.642170 30305 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:32.680248 30305 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:32.680123 30115 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.681263 30305 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:32.636485 30120 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.642151 30026 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.644408 30126 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.687323 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51699.1us
I20260709 13:08:32.628410 30089 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:08:32.644783 30083 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:32.632000 30247 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:32.708649 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 83630.5us
I20260709 13:08:32.718679 26760 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.704952 30126 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:32.720858 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 149328us
I20260709 13:08:32.727718 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.736579 26686 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:32.729374 30353 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:32.751061 26681 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:32.751297 30226 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:08:32.753242 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.754448 30303 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:32.756130 30136 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.742323 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:32.747161 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.748390 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.720045 30026 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:32.771091 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.720470 30120 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:32.777122 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:32.780323 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2596) took 3118 ms. Trace:
I20260709 13:08:32.780786 26604 rpcz_store.cc:276] 0709 13:08:29.661462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.891902 (+1230440us) service_pool.cc:224] Handling call
0709 13:08:30.892332 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.090783 (+198451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.779841 (+1689058us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540003ded4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:32.780110 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455094016}
I20260709 13:08:32.736363 30088 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.794934 30088 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:32.771818 30353 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:32.796481 30353 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.797729 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:32.800364 26757 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:32.801010 26755 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:32.733199 30047 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.805909 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:32.824993 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:32.830839 26683 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:32.831497 26683 pending_rounds.cc:85] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:32.832430 26683 pending_rounds.cc:107] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:32.832749 26683 raft_consensus.cc:2889] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:32.833003 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.842459 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.836927 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:32.849026 30306 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.004s
I20260709 13:08:32.850905 30301 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:32.853271 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 127143us
I20260709 13:08:32.867015 30247 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:32.851600 30301 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.881362 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65081.3us
I20260709 13:08:32.880029 26756 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:32.883443 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:32.886372 30047 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.880538 30301 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.887980 30056 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.890429 26605 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:32.894802 30083 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.896894 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:32.881593 30303 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.903501 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2588) took 3540 ms. Trace:
I20260709 13:08:32.903952 26609 rpcz_store.cc:276] 0709 13:08:29.344702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.518913 (+174211us) service_pool.cc:224] Handling call
0709 13:08:29.519199 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.990075 (+470876us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:30.034476 (+ 44401us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.579238 (+1544762us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b180047d6a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a 00007f40f329aa2a
0709 13:08:31.656960 (+ 77722us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.735783 (+ 78823us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.759958 (+ 24175us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:31.759993 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.885182 (+1125189us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400162e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:32.885253 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.885310 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:32.885328 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.885491 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18508,"prepare.queue_time_us":44280,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":52467,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":785932928,"thread_start_us":207750,"threads_started":2,"wal-append.queue_time_us":1670458,"wal-append.run_cpu_time_us":2283,"wal-append.run_wall_time_us":1029357}
I20260709 13:08:32.933001 26760 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:32.899353 30131 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.937652 30269 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:32.939103 30131 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:32.941944 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.947101 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1580) took 1245 ms. Trace:
I20260709 13:08:32.947690 26752 rpcz_store.cc:276] 0709 13:08:31.699756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.729034 (+ 29278us) service_pool.cc:224] Handling call
0709 13:08:31.771625 (+ 42591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.960330 (+188705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.960369 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.980966 (+ 20597us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:31.981026 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.944746 (+963720us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002ea4d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:32.944817 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.945023 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295932672}
I20260709 13:08:32.978240 30353 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.979225 30047 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:32.979835 30056 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:32.979780 30047 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.981853 30047 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.978811 30353 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:32.985816 30353 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:32.987149 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:32.988164 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 265994us
I20260709 13:08:32.990532 30303 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:32.990907 30303 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:32.991290 30303 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.992897 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:32.994293 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:32.991235 30433 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:32.999820 26605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:32.999967 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.000411 26605 raft_consensus.cc:606] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:33.000856 26605 raft_consensus.cc:614] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.002118 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:33.014911 30247 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:33.016083 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:33.016387 30247 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:33.016934 30247 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:32.998303 30433 consensus_queue.cc:1243] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:33.017978 30247 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.019299 30433 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:33.019914 30433 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:33.021471 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:33.022360 30306 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.023063 30433 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:33.026558 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:33.027520 30306 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:33.029253 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.030778 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.031487 26684 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:33.031387 30432 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.163s	user 0.001s	sys 0.002s
I20260709 13:08:33.072029 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:08:33.073227 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 73851.6us
I20260709 13:08:33.074277 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.076467 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:33.080919 27316 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 4
I20260709 13:08:33.081457 27316 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:08:33.081809 27316 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.000612 30120 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:08:33.084324 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 81808.4us
I20260709 13:08:33.058200 30353 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:33.094719 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:33.095801 27320 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:33.061967 30433 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:33.103930 30433 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.104662 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.106258 30433 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.107017 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:33.110299 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:33.107645 27318 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:33.113988 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.092182 30353 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.122537 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.124267 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.106890 30433 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.107328 29881 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:33.130487 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.140842 26603 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:33.142412 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:33.146860 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 250080us
I20260709 13:08:33.110294 30083 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.204497 26607 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:33.204756 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49035.9us
I20260709 13:08:33.129057 30353 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:33.127307 29884 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.127818 30026 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.133766 30434 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.116412 30258 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:08:33.220811 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.116010 30226 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:08:33.216900 26608 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:33.227474 26605 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:33.148651 30446 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:33.230890 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:33.236608 26610 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.254168 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:33.260742 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 169604us
I20260709 13:08:33.226310 30417 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.264892 30450 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:33.265087 30436 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:08:33.262683 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:33.266778 30450 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.223278 30123 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.226531 30136 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.229875 30120 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.273449 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.290343 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:33.265148 30433 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.302620 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.307533 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.257359 30083 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:08:33.275403 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153002us
I20260709 13:08:33.260004 30260 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:08:33.315423 26609 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:33.316474 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.229773 30026 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.312194 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.321115 26607 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.284330 30450 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:33.319154 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54654.1us
I20260709 13:08:33.325568 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:33.325820 30331 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:33.319208 30120 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.326205 26603 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:33.329504 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:33.330271 26678 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:33.315901 26687 pending_rounds.cc:85] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:08:33.333740 26687 pending_rounds.cc:107] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:33.334013 26687 raft_consensus.cc:2889] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.263423 30446 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.282524 30123 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.272060 30305 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:08:33.347832 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.352391 26510 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.291224 30136 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.355505 30136 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.323652 30450 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.356921 30450 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.320027 30439 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.364693 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47791.7us
I20260709 13:08:33.354498 26510 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 2 to 4, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:33.366844 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:33.377722 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.269766 30434 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:33.385846 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 178017us
I20260709 13:08:33.380132 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.394480 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.398640 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.399276 26605 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:33.404843 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 178021us
I20260709 13:08:33.420795 26756 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:33.421944 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:33.424701 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:33.428320 30441 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:08:33.337337 30433 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.350050 30318 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:08:33.404374 30253 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:33.442346 26510 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 7, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 7 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.450412 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:33.450608 30444 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:33.451066 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:33.451680 30433 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.410282 30211 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:33.451948 30123 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:33.452804 30120 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.453795 30318 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:33.455744 26507 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 114) took 18674 ms (client timeout 15000 ms). Trace:
I20260709 13:08:33.456002 30434 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:33.436138 30448 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:33.456640 30026 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.463994 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.467614 26609 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:33.509145 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:33.509817 26609 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:33.486068 26605 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:33.488122 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.510581 26607 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:33.492607 26678 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:33.399802 30305 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:08:33.434548 30445 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:33.506944 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.514539 26603 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.513636 26756 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:33.431106 30047 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:08:33.460764 30253 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:33.513615 30303 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:08:33.394843 30439 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:33.496383 30211 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:33.534448 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.498152 30318 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:33.534476 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:33.549091 26607 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:33.549886 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:33.514272 30445 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:33.554587 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.507993 30433 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:33.525924 30253 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.564669 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.549225 26510 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 4 to 5, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 5 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:33.531424 30120 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:33.687320 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.690587 26678 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
W20260709 13:08:33.694758 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 257495us
I20260709 13:08:33.552985 30434 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.714564 26684 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
W20260709 13:08:33.683391 30394 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:08:33.685521 30433 consensus_queue.cc:1243] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:08:33.693460 30126 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.961s	user 0.007s	sys 0.006s
I20260709 13:08:33.547940 30303 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.713419 30247 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.748539 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:33.749713 26678 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:33.769407 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.720894 30434 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:33.700584 30450 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.776232 26607 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:33.762468 30455 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.228s	user 0.000s	sys 0.004s
I20260709 13:08:33.788264 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:33.733582 30126 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.791078 30126 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:33.793159 30303 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.791386 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.729861 30120 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:33.797652 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.798738 26678 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:33.799278 26603 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:33.786451 30453 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:33.813467 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90702.7us
I20260709 13:08:33.814097 26607 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:33.804616 30462 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.803288 30446 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.743527 30211 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:33.498289 26507 rpcz_store.cc:269] 0709 13:08:14.630230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.631865 (+  1635us) service_pool.cc:224] Handling call
0709 13:08:33.298168 (+18666303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:28.417284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:28.561366 (+144082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:28.564637 (+  3271us) write_op.cc:435] Acquired schema lock
0709 13:08:28.574156 (+  9519us) tablet.cc:662] Decoding operations
0709 13:08:28.786302 (+212146us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:28.786360 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:28.786389 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:08:28.787438 (+  1049us) tablet.cc:701] Row locks acquired
0709 13:08:28.787460 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:28.787619 (+   159us) write_op.cc:270] Start()
0709 13:08:28.791910 (+  4291us) write_op.cc:276] Timestamp: P: 1783602508787575 usec, L: 0
0709 13:08:28.797639 (+  5729us) op_driver.cc:348] REPLICATION: starting
0709 13:08:28.873934 (+ 76295us) log.cc:844] Serialized 4911 byte log entry
0709 13:08:29.564414 (+690480us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:30.151762 (+587348us) op_driver.cc:464] REPLICATION: finished
0709 13:08:30.705814 (+554052us) write_op.cc:301] APPLY: starting
0709 13:08:30.709864 (+  4050us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:30.786445 (+ 76581us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:30.790563 (+  4118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:30.882729 (+ 92166us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:30.883070 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:08:30.883141 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:30.883581 (+   440us) log.cc:844] Serialized 83 byte log entry
0709 13:08:30.883804 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.883985 (+   181us) write_op.cc:454] Released schema lock
0709 13:08:30.884058 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:30.884587 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.884623 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":615940,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":535118,"apply.run_cpu_time_us":4762,"apply.run_wall_time_us":187716,"num_ops":11,"prepare.queue_time_us":299357,"prepare.run_cpu_time_us":19691,"prepare.run_wall_time_us":794666,"raft.queue_time_us":291930,"raft.run_cpu_time_us":17254,"raft.run_wall_time_us":446659,"replication_time_us":1353867,"spinlock_wait_cycles":10176896,"thread_start_us":1087082,"threads_started":4,"wal-append.queue_time_us":343425,"wal-append.run_cpu_time_us":31486,"wal-append.run_wall_time_us":2681708}]]}
W20260709 13:08:33.828539 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.818811 30438 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:08:33.831929 26510 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 6, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 6 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:33.812894 30453 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:33.772846 30318 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.802534 30454 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.309s
I20260709 13:08:33.853343 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:33.828544 30440 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:08:33.838546 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2684) took 1099 ms. Trace:
I20260709 13:08:33.857650 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:33.857311 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.877354 30459 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.877947 30459 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:33.880179 30456 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:08:33.880666 30458 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:08:33.851694 30453 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.880748 26510 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:08:33.882663 30465 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:33.882858 30439 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:33.857205 26681 rpcz_store.cc:276] 0709 13:08:32.738597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.844805 (+106208us) service_pool.cc:224] Handling call
0709 13:08:32.857685 (+ 12880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.857946 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:32.858242 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.835954 (+977712us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b18001f7980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:08:33.837909 (+  1955us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.838119 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.838177 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:33.838235 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.838323 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.838467 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312574,"prepare.queue_time_us":2255,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":286003,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":71460,"spinlock_wait_cycles":10293632,"thread_start_us":205214,"threads_started":1}
I20260709 13:08:33.866786 30115 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.861825 30454 consensus_queue.cc:1243] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:33.877805 30318 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.900358 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:33.892539 30226 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.901473 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 358) took 1160 ms. Trace:
I20260709 13:08:33.903798 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:33.904203 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:33.904593 26510 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:33.894300 30430 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:33.892903 30123 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.833716 30434 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.911474 30258 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:08:33.919219 26510 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.920892 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 363) took 1159 ms. Trace:
I20260709 13:08:33.919293 30120 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:33.899055 30115 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.911652 30226 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.932862 30047 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:33.903903 26679 rpcz_store.cc:276] 0709 13:08:32.732487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.824353 (+ 91866us) service_pool.cc:224] Handling call
0709 13:08:32.837766 (+ 13413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.098482 (+260716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.098537 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.107616 (+  9079us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.241320 (+133704us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b48002826d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:08:33.336824 (+ 95504us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:33.561447 (+224623us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.562871 (+  1424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.562948 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.884033 (+321085us) raft_consensus.cc:1685] finished
0709 13:08:33.892556 (+  8523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.892754 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":322251,"prepare.queue_time_us":120938,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":306383,"raft.run_cpu_time_us":2177,"raft.run_wall_time_us":101891,"spinlock_wait_cycles":114236672,"thread_start_us":367098,"threads_started":2,"wal-append.queue_time_us":415048}
I20260709 13:08:33.827257 30462 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:33.939733 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.909610 30406 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:08:33.948220 26753 rpcz_store.cc:276] 0709 13:08:32.761542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.771383 (+  9841us) service_pool.cc:224] Handling call
0709 13:08:32.772498 (+  1115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.779156 (+  6658us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:32.821100 (+ 41944us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.078337 (+257237us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.084157 (+  5820us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.084309 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:33.084346 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.084496 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.920627 (+836131us) raft_consensus.cc:1685] finished
0709 13:08:33.920655 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.920820 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44674,"prepare.queue_time_us":41907,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1492,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":20263,"thread_start_us":214209,"threads_started":1,"wal-append.queue_time_us":302013}
I20260709 13:08:33.974306 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:33.938630 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:33.974877 26759 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:33.954865 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:33.955044 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 118281us
W20260709 13:08:33.935515 30301 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.019s	user 0.014s	sys 0.000s
I20260709 13:08:33.957365 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.984545 26758 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:33.961606 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:33.934945 30433 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.940574 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.970659 26679 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:33.988191 26575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.007s
I20260709 13:08:33.976615 26611 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:33.950656 30446 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.985440 26756 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:33.987427 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.908986 30088 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:33.989500 26575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.007s
I20260709 13:08:33.972389 30434 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:34.000280 30470 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:34.002388 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.003279 26610 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:34.008015 26510 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:34.008653 30452 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:34.010715 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:33.973737 30459 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:33.941192 30123 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.009794 26510 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:08:34.027632 30474 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:34.028086 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:34.028857 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.029881 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:34.018270 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79743.3us
W20260709 13:08:34.018812 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75128.9us
I20260709 13:08:33.983888 30450 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.007269 30253 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.032089 26611 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:34.031497 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.033038 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:34.015069 30466 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:08:34.037796 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:34.015348 30452 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.045985 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1379) took 1048 ms. Trace:
I20260709 13:08:34.046360 30452 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.046523 26685 rpcz_store.cc:276] 0709 13:08:32.997432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.999995 (+  2563us) service_pool.cc:224] Handling call
0709 13:08:33.000297 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.210784 (+210487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.210826 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.259286 (+ 48460us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.556387 (+297101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:33.556430 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.556503 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.045760 (+489257us) raft_consensus.cc:1685] finished
0709 13:08:34.045779 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.045914 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187545,"raft.queue_time_us":221869,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8550,"thread_start_us":251766,"threads_started":1,"wal-append.queue_time_us":514793}
I20260709 13:08:34.023828 30303 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:34.024405 30120 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.010005 30446 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.011613 30433 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.050983 30446 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.052023 26605 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:34.052078 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:33.983378 30047 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.052744 30433 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.055214 26607 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:08:34.045487 30479 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:08:33.991397 30301 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:34.060653 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 152353us
I20260709 13:08:34.061075 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:34.064720 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:34.072322 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.065531 26755 pending_rounds.cc:85] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 4
I20260709 13:08:34.078789 26755 pending_rounds.cc:107] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:08:34.079138 26755 raft_consensus.cc:2889] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.066747 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.046474 30123 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:34.086325 27320 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:08:34.085812 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.085346 30247 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.093561 30453 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.094547 30258 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.094933 26682 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.095149 30258 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.095989 30314 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.097749 30258 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.100569 26510 catalog_manager.cc:5697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:08:34.104182 30463 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.370s	user 0.003s	sys 0.000s
W20260709 13:08:34.107014 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46054.7us
I20260709 13:08:34.064993 30450 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.067169 30047 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.063823 30486 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.064838 30303 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:34.118367 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2619) took 1003 ms. Trace:
I20260709 13:08:34.119134 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.121498 30433 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.133584 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.135632 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.064143 30398 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:34.131273 26606 rpcz_store.cc:276] 0709 13:08:33.114528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.114636 (+   108us) service_pool.cc:224] Handling call
0709 13:08:33.134348 (+ 19712us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:33.371927 (+237579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.371970 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:33.417326 (+ 45356us) log.cc:844] Serialized 52 byte log entry
0709 13:08:33.855422 (+438096us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:33.891931 (+ 36509us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.939900 (+ 47969us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.015175 (+ 75275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.015250 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.115693 (+100443us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b180047d9a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:34.118106 (+  2413us) raft_consensus.cc:1685] finished
0709 13:08:34.118130 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.118303 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191164,"prepare.queue_time_us":37743,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":7862,"raft.queue_time_us":202605,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":21498,"spinlock_wait_cycles":19575680,"thread_start_us":542796,"threads_started":2,"wal-append.queue_time_us":513688}
I20260709 13:08:34.136318 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:34.136660 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.149390 26683 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.137498 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.138649 30460 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.138863 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 357) took 1407 ms. Trace:
I20260709 13:08:34.139998 30303 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.131472 30448 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:34.135998 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.109306 30083 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.145925 26679 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:34.119622 30026 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:34.153023 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.153532 30477 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.156540 26683 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:34.157231 30434 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:34.127967 29884 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.161075 26687 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:34.120646 30450 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.169962 26685 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:34.110006 30123 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:08:34.188171 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.181842 30491 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.181809 30318 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:34.179967 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:34.188944 26684 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:34.199234 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.161185 26680 rpcz_store.cc:276] 0709 13:08:32.731379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.824615 (+ 93236us) service_pool.cc:224] Handling call
0709 13:08:32.824915 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.092629 (+267714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.092658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.114286 (+ 21628us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.692819 (+578533us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b1800464080. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:08:33.986758 (+293939us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:33.993907 (+  7149us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.111733 (+117826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.138507 (+ 26774us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.138558 (+    51us) raft_consensus.cc:1685] finished
0709 13:08:34.138664 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.138807 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334928,"prepare.queue_time_us":6595,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":50,"raft.queue_time_us":463880,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":13577,"spinlock_wait_cycles":116890496,"thread_start_us":392830,"threads_started":2,"wal-append.queue_time_us":888703}
I20260709 13:08:34.199785 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:34.163806 30433 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:34.183970 30026 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.219506 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 134409us
I20260709 13:08:34.210856 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.189327 30450 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.220927 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.185823 30434 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.222208 30026 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:34.240021 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:34.240870 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.204355 30453 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.203581 30486 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.204015 30439 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.208555 30120 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:34.248708 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:08:34.251262 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51604.7us
I20260709 13:08:34.253258 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.254307 30499 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:34.254578 30498 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:34.256390 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 204414us
I20260709 13:08:34.258018 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.257666 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:34.237741 30434 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.259186 26685 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:34.245111 30253 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.263499 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:34.255734 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 75744.9us
I20260709 13:08:34.267128 30493 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:34.267714 30497 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:34.208717 30460 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:34.218348 30318 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.252673 30406 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:34.259261 30446 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.258618 30120 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.262295 30499 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.283180 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.208163 30491 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.255789 30398 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:34.291108 30120 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.252840 30433 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.291460 26757 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:34.276567 30486 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.280661 30439 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:34.292997 30499 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.308492 30318 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.309705 30247 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.293368 30301 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.312068 30487 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.295538 30406 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:34.312522 26679 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:34.314450 30226 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:34.316037 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.325433 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:34.350029 26757 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:34.343329 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 85727.3us
I20260709 13:08:34.296911 30446 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:34.360023 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44115us
W20260709 13:08:34.350113 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 86205.5us
I20260709 13:08:34.355000 30478 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.354686 30493 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:34.358649 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:34.322873 30495 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
I20260709 13:08:34.362648 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:34.273910 30498 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.321038 30439 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.348454 30477 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:34.371382 30496 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:34.371618 30226 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:34.375394 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 13:08:34.347961 30247 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.365732 30487 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:34.380791 26650 leader_election.cc:400] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:34.384493 26760 raft_consensus.cc:1217] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-11.6]   Dedup: 7.4->[9.5-11.6]
I20260709 13:08:34.433347 26760 pending_rounds.cc:85] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 4
I20260709 13:08:34.433697 26760 pending_rounds.cc:107] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:34.433984 26760 raft_consensus.cc:2889] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:34.420312 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.435508 26650 leader_election.cc:403] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:34.427605 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54777.9us
I20260709 13:08:34.365851 30222 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:34.367659 30026 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.372089 30123 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:34.317168 30486 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.374951 30439 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:34.448266 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66241.1us
W20260709 13:08:34.432493 30353 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.212s	user 0.011s	sys 0.003s
I20260709 13:08:34.365557 30478 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:34.450604 30496 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:34.385288 30120 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:34.466740 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.04585e+06us
I20260709 13:08:34.468540 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:34.470984 30490 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
W20260709 13:08:34.471261 30489 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:08:34.472218 30494 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.472573 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2687) took 1097 ms. Trace:
I20260709 13:08:34.473572 30511 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:34.476038 30199 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:34.476599 30199 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.477491 30514 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.478955 30199 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:34.479827 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 930129us
I20260709 13:08:34.380266 30477 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.473002 26678 rpcz_store.cc:276] 0709 13:08:33.375052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.905253 (+530201us) service_pool.cc:224] Handling call
0709 13:08:33.916757 (+ 11504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.917152 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.917180 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.940556 (+ 23376us) log.cc:844] Serialized 26 byte log entry
0709 13:08:34.057927 (+117371us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:34.057981 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.058085 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.472349 (+414264us) raft_consensus.cc:1685] finished
0709 13:08:34.472369 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.472514 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1291,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":80000,"threads_started":1,"wal-append.queue_time_us":203468}
I20260709 13:08:34.469051 30492 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.492074 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:34.495787 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124691us
I20260709 13:08:34.436054 30501 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
W20260709 13:08:34.502002 30504 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:34.449877 30446 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.462147 30353 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.446693 30406 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.545938 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.549002 26608 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9.
I20260709 13:08:34.543592 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:34.553079 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61105.7us
I20260709 13:08:34.516356 30226 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:34.556262 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.557106 26756 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:34.558905 26756 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:34.559157 26756 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:34.559442 26756 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.557605 26758 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:34.532315 30182 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:34.566581 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.568040 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 463) took 1499 ms. Trace:
I20260709 13:08:34.543100 30491 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.547590 30269 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.574005 30303 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:34.518164 30492 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.462244 30493 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.577767 30026 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.571316 30514 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:34.590655 30450 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.595849 30509 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.598012 30426 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:34.578337 30353 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.579164 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 498) took 1413 ms. Trace:
I20260709 13:08:34.555827 30305 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.605446 30492 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.568408 27316 rpcz_store.cc:276] 0709 13:08:33.068203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.068699 (+   496us) service_pool.cc:224] Handling call
0709 13:08:33.080656 (+ 11957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.085741 (+  5085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.085774 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.274790 (+189016us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b2c00040b88. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:33.275280 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.736999 (+461719us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:33.758635 (+ 21636us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.554735 (+796100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.554932 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.554995 (+    63us) raft_consensus.cc:1685] finished
0709 13:08:34.564483 (+  9488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.567985 (+  3502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":722561,"prepare.queue_time_us":21649,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":748844,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8191,"spinlock_wait_cycles":6530304,"thread_start_us":490746,"threads_started":2,"wal-append.queue_time_us":567745}
I20260709 13:08:34.556584 30047 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.605036 27321 rpcz_store.cc:276] 0709 13:08:33.093744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.093896 (+   152us) service_pool.cc:224] Handling call
0709 13:08:33.106074 (+ 12178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.106367 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:33.283531 (+177164us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.506885 (+1223354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.506966 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:34.507044 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.507154 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.507327 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1019985,"prepare.queue_time_us":224506,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":8281,"raft.queue_time_us":1093458,"thread_start_us":368343,"threads_started":2,"wal-append.queue_time_us":432386}
I20260709 13:08:34.610816 30426 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:34.611367 30426 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.611871 30301 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:34.528296 30487 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.612421 30301 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.614624 30301 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.578280 30503 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:34.580009 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.601848 30226 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.582429 26756 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:34.576391 30247 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
W20260709 13:08:34.640590 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127752us
I20260709 13:08:34.622772 26757 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:34.645979 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.676807 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.576776 30182 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:34.680274 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 234931us
I20260709 13:08:34.585374 30269 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.684414 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:34.645535 30494 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:34.685142 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 109933us
I20260709 13:08:34.693806 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.694706 26610 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:34.675412 30123 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.695475 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.697032 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.698525 26611 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:34.699412 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.633214 30503 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.691922 30120 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.707266 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:34.708201 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:34.710629 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:34.702175 30452 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.009s
I20260709 13:08:34.684825 30103 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:34.731812 26604 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:34.704887 30301 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:34.702576 30439 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.721248 30260 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:34.804841 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 94273.7us
I20260709 13:08:34.766714 30426 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:34.813916 26761 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:34.815340 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.818282 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:34.818738 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:34.819442 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:34.822901 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.827806 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.829190 30439 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.751518 30523 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.760505 30503 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:34.757690 30518 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:08:34.831070 30518 consensus_queue.cc:1243] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:34.757810 30519 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.832427 30519 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.834656 30519 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.729547 30452 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.835311 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.836229 30492 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.836627 30452 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.836805 30494 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.800045 30353 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:34.837852 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182909us
I20260709 13:08:34.838529 26687 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:34.836645 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.807623 30260 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:34.867978 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 137022us
I20260709 13:08:34.827845 30510 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:34.757689 30301 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:34.899792 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63202.9us
I20260709 13:08:34.837546 30353 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.898396 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:34.895857 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.766587 30434 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.904160 27312 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:34.904472 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.904162 26684 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:34.906894 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.907384 26683 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:34.908589 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:34.909082 27316 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.910187 26678 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:34.889333 30523 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.912937 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:34.917663 26685 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:34.917544 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:34.905459 30518 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.929893 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.866731 30529 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:08:34.933197 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.915589 30462 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.903218 30510 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.941956 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:34.939441 30503 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.950286 30503 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.952934 30503 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.955581 30434 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:34.956422 30434 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.956967 30434 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.930931 30260 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:34.964164 30260 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:34.965893 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.945240 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:34.940346 30518 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:34.930519 30494 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:34.936422 30499 consensus_meta.cc:287] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.005s
I20260709 13:08:34.959410 30434 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:34.976855 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61503.6us
I20260709 13:08:35.011545 30115 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:34.975425 30499 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.112376 30301 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.235822 30089 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:35.135006 30486 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.136164 30269 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:35.236234 30089 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:35.237051 30459 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:35.237617 30459 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:35.238072 30499 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.230033 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2696) took 1826 ms. Trace:
I20260709 13:08:35.230232 30450 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:35.230655 30464 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.375s	user 0.010s	sys 0.013s
I20260709 13:08:35.232095 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 466) took 2135 ms. Trace:
I20260709 13:08:35.309379 27320 rpcz_store.cc:276] 0709 13:08:33.096953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.097372 (+   419us) service_pool.cc:224] Handling call
0709 13:08:33.097609 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.089841 (+992232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.088010 (+998169us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400570154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:35.232035 (+144025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273053440}
I20260709 13:08:35.232417 27316 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.232896 30211 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.972379 30426 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.237670 30477 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.239421 30502 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:35.239956 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 371) took 1307 ms. Trace:
W20260709 13:08:35.240237 30544 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.268s	user 0.000s	sys 0.005s
I20260709 13:08:35.240640 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 370) took 1308 ms. Trace:
W20260709 13:08:35.241784 30484 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.119s	user 0.008s	sys 0.004s
I20260709 13:08:35.242324 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1596) took 1077 ms. Trace:
W20260709 13:08:35.244544 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.229377 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.291991 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2710) took 1054 ms. Trace:
I20260709 13:08:35.245987 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.319260 26608 rpcz_store.cc:276] 0709 13:08:33.932351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.940258 (+  7907us) service_pool.cc:224] Handling call
0709 13:08:35.105351 (+1165093us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:35.240585 (+135234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289216256}
I20260709 13:08:35.229144 30478 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.230057 30182 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.314574 26603 rpcz_store.cc:276] 0709 13:08:33.932672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.935549 (+  2877us) service_pool.cc:224] Handling call
0709 13:08:33.956898 (+ 21349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.054567 (+ 97669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.054618 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.054674 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:34.054722 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.133859 (+1079137us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b5400353254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:35.239782 (+105923us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.239895 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224038144}
I20260709 13:08:35.315423 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.301292 26682 rpcz_store.cc:276] 0709 13:08:33.405100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.957704 (+552604us) service_pool.cc:224] Handling call
0709 13:08:33.974396 (+ 16692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.095346 (+120950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.978778 (+883432us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000b4354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:35.229971 (+251193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276776704}
I20260709 13:08:35.321951 30426 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.331482 30430 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:35.331713 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102442us
I20260709 13:08:35.333737 30426 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.335307 30507 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.335731 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.335855 30507 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.336390 26687 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.336743 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.337888 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.338653 30537 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:35.339027 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1345) took 1893 ms. Trace:
I20260709 13:08:35.339172 30537 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.340075 26758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52970
I20260709 13:08:35.340658 26758 raft_consensus.cc:606] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:08:35.335358 30301 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.341980 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.342887 26684 raft_consensus.cc:2410] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:35.335340 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.314445 30502 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:35.344264 26683 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.344560 30518 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.344758 30502 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.237152 30089 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.339411 26754 rpcz_store.cc:276] 0709 13:08:33.445887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.521479 (+ 75592us) service_pool.cc:224] Handling call
0709 13:08:33.549703 (+ 28224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.557874 (+  8171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.557917 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.686265 (+128348us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.972065 (+285800us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:33.990175 (+ 18110us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.009374 (+ 19199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.009460 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.316029 (+306569us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:34.911579 (+595550us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b18003f5500. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:35.088747 (+177168us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b2400198f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e209d 00007f40f2e1410e 00007f40f2e2b88c 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221
0709 13:08:35.338829 (+250082us) raft_consensus.cc:1685] finished
0709 13:08:35.338850 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.338971 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1914,"prepare.queue_time_us":41613,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2178,"raft.queue_time_us":20057,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":132080,"spinlock_wait_cycles":49709952,"thread_start_us":225669,"threads_started":1,"wal-append.queue_time_us":331264}
I20260709 13:08:35.345983 30502 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.347035 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.347590 26754 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.311393 30510 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.327101 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.349190 26685 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.351040 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.351989 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.352761 26753 raft_consensus.cc:2410] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:35.353089 30445 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.354333 30445 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.354486 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2701) took 1128 ms. Trace:
I20260709 13:08:35.357417 30507 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:35.340199 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1381) took 2341 ms. Trace:
I20260709 13:08:35.357985 26686 rpcz_store.cc:276] 0709 13:08:32.998818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.001603 (+  2785us) service_pool.cc:224] Handling call
0709 13:08:33.010117 (+  8514us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:33.216902 (+206785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.216932 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:33.226713 (+  9781us) log.cc:844] Serialized 78 byte log entry
0709 13:08:33.534310 (+307597us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:33.550071 (+ 15761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.550124 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.018779 (+1468655us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b24000fd4d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e209d 00007f40f2e1410e 00007f40f2e2b88c 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221
0709 13:08:35.339912 (+321133us) raft_consensus.cc:1685] finished
0709 13:08:35.339933 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.340148 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255125,"raft.queue_time_us":245549,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7538,"spinlock_wait_cycles":20826496,"thread_start_us":241950,"threads_started":1,"wal-append.queue_time_us":535661}
I20260709 13:08:35.318361 30433 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.319512 26761 rpcz_store.cc:276] 0709 13:08:34.164680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.277047 (+112367us) service_pool.cc:224] Handling call
0709 13:08:34.291686 (+ 14639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.814598 (+522912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.136941 (+322343us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540010fed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:35.242245 (+105304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200376192}
I20260709 13:08:35.360432 26754 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:35.354930 26680 rpcz_store.cc:276] 0709 13:08:34.226369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.226604 (+   235us) service_pool.cc:224] Handling call
0709 13:08:34.227449 (+   845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.625694 (+398245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.625739 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.653336 (+ 27597us) log.cc:844] Serialized 26 byte log entry
0709 13:08:34.888681 (+235345us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:34.888718 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.888788 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.354296 (+465508us) raft_consensus.cc:1685] finished
0709 13:08:35.354316 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.354430 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37952,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":22365,"spinlock_wait_cycles":231168,"thread_start_us":584116,"threads_started":2,"wal-append.queue_time_us":287101}
I20260709 13:08:35.352586 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.363845 30426 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:35.364009 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:35.364606 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 47929.1us
I20260709 13:08:35.365940 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:35.326642 30477 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.366772 30258 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:35.367204 30258 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.367558 30056 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:35.367184 30477 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.343578 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.368040 30056 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:35.367878 30258 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.369030 30056 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.370173 30056 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.370374 30459 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.334136 26650 leader_election.cc:400] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
W20260709 13:08:35.313445 30538 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.083s	user 0.000s	sys 0.006s
I20260709 13:08:35.369644 30477 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:35.330178 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 84214.2us
I20260709 13:08:35.384414 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.384737 30353 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.385286 30426 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.385524 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.374338 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1356) took 1067 ms. Trace:
I20260709 13:08:35.385306 30353 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.386780 30353 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.386377 26760 rpcz_store.cc:276] 0709 13:08:34.306954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.374657 (+ 67703us) service_pool.cc:224] Handling call
0709 13:08:34.384210 (+  9553us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:34.704183 (+319973us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:34.704222 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:34.710942 (+  6720us) log.cc:844] Serialized 52 byte log entry
0709 13:08:34.856189 (+145247us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:34.856245 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.856343 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.374123 (+517780us) raft_consensus.cc:1685] finished
0709 13:08:35.374142 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.374282 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12781,"raft.queue_time_us":31627,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2291,"thread_start_us":351467,"threads_started":2,"wal-append.queue_time_us":257557}
I20260709 13:08:35.387842 30417 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.374809 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.390686 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.393978 30089 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.394351 30462 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.394765 30462 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.395081 30462 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.397763 26678 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:35.398442 30545 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.455s	user 0.003s	sys 0.000s
I20260709 13:08:35.398928 30430 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.389132 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.399432 30430 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.387364 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.400720 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.367337 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:35.365334 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.380765 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.380980 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.403069 26685 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.403383 26682 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.381639 26687 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:35.382726 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.383392 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.407325 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.408413 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:35.402173 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.361310 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47218.4us
I20260709 13:08:35.409240 26687 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.320043 26679 rpcz_store.cc:276] 0709 13:08:34.238051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.361246 (+123195us) service_pool.cc:224] Handling call
0709 13:08:34.361471 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.608455 (+246984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.608485 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.608550 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:34.608581 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.053927 (+445346us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400127ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:35.291763 (+237836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.291926 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567536512}
I20260709 13:08:35.410238 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.411254 26684 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:35.403412 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.418634 26759 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.408211 26753 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:35.410741 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.430622 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.422950 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.431532 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.432880 26683 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:35.433775 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.424520 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.434625 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:35.434940 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.431778 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:35.423691 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 58429.3us
I20260709 13:08:35.435595 26752 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
W20260709 13:08:35.459839 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49154.2us
I20260709 13:08:35.436326 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:35.440727 26753 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 6: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:35.460973 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.443413 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:35.462759 30497 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:35.419790 30126 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.465740 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.466572 26686 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:35.458575 30453 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.467820 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.468205 30453 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.469060 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.469434 29884 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:35.469588 30258 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.470214 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.470577 29884 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:35.471024 29884 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:35.474956 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:35.475090 30306 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:35.477881 30461 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:35.468443 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81133.7us
I20260709 13:08:35.483780 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:35.440364 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:35.489542 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49246.1us
I20260709 13:08:35.490450 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.491326 27286 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.495066 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.495548 26687 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:35.495127 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:35.496415 26606 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:35.389190 30353 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:35.412351 30417 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:35.495050 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 51760.1us
I20260709 13:08:35.504109 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.504717 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:35.506477 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.496345 26759 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.500283 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.502139 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.411635 30512 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:35.431401 30510 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.517215 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.546411 30512 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.492189 30258 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:35.513729 26754 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
W20260709 13:08:35.541227 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.538981 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:35.422804 30498 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:35.546829 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 67201us
I20260709 13:08:35.506560 30269 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.545643 26753 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:35.509321 26760 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:35.502895 30446 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:35.530738 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.487200 30494 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.541828 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.506718 30499 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.474944 30126 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:08:35.553519 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:35.553859 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.500023 30426 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:35.548219 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45960.1us
I20260709 13:08:35.479096 30486 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:35.496938 30247 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:35.544375 29884 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.545645 30301 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.572360 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.572751 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:35.579450 26687 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.580287 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:35.573096 30126 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:35.581588 30126 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:35.582415 30126 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.576624 30426 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:35.583860 30510 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.584251 30426 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.584403 30510 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.586534 30510 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.587879 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.588620 30503 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:35.588961 30498 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.589262 30503 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.590421 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.591292 30498 raft_consensus.cc:2764] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:35.591790 30486 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:35.592697 30486 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:35.592947 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62356us
I20260709 13:08:35.583653 30126 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.595911 30521 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:35.597078 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.583585 30446 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:35.604406 30446 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.605705 30301 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.588109 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.608106 26683 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:35.549875 30450 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.611014 26680 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:35.557708 30433 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:35.557513 30478 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:35.616761 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.557566 30269 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.618811 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.613514 30417 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.625101 30417 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.630983 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.631783 30478 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.620661 30433 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:35.620203 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.640719 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.615867 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:35.616149 30450 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.646059 26687 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:35.645228 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:35.644990 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.648631 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:35.635439 30269 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.573876 30494 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.658356 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:35.659297 26605 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:35.648382 30450 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.617724 30498 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:35.686213 26687 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: [5.6-8.8]
I20260709 13:08:35.656975 30056 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.699035 26682 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:35.707062 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.707319 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.707816 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:35.708092 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.708756 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.709138 26754 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:35.712189 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.713100 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.717356 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:35.723726 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:35.727320 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:35.691712 30536 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:35.737330 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:35.737785 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.738097 26752 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.740031 26754 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:35.743448 26678 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:08:35.743865 26678 pending_rounds.cc:85] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:35.744078 26678 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:35.744328 26678 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.744617 26678 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:35.744899 26678 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.716737 30510 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.735316 30536 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:35.724335 30353 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:35.719022 30056 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.771327 26678 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:35.743149 30512 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:35.782928 30548 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:08:35.785259 30453 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.766855 30477 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.777150 30536 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.718294 30433 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:35.791391 30430 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.757929 30510 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.796417 30126 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:35.820017 30126 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.822541 30126 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:35.824059 30417 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.830441 30462 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:35.833483 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:35.837217 26684 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:35.838665 26752 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:35.803711 30453 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.833871 30430 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:35.910413 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 450061us
I20260709 13:08:35.884152 30430 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:35.932809 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.932677 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:35.939769 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.907642 30507 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.924738 30494 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:35.926777 30353 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:35.934255 30430 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:35.994154 30461 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.031s
W20260709 13:08:36.011691 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 77504us
W20260709 13:08:36.018783 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86209.4us
I20260709 13:08:36.020200 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:36.027328 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 300098us
W20260709 13:08:36.025988 30103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.025s
I20260709 13:08:35.980955 30507 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.033500 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:36.017293 30056 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:36.055197 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 414559us
I20260709 13:08:36.060994 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:36.024776 30226 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.024044 30494 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:36.062630 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:36.054656 30103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.013s	sys 0.025s
I20260709 13:08:36.005854 30353 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:36.053046 30462 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.066118 30258 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:36.080927 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:36.061565 30558 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:36.083098 30551 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:08:36.084241 30552 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:36.084038 30526 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:36.078181 30247 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.099902 30247 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.100379 30247 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:36.100494 30550 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:36.104512 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.108191 30353 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.070960 30056 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:36.109498 30056 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:36.110710 30056 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:36.118387 30426 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.001s
I20260709 13:08:36.118875 30426 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.070535 30510 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.120014 30510 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:36.096201 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.077340 30445 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.000s
W20260709 13:08:36.116992 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44777.2us
W20260709 13:08:36.096599 26756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.011s	sys 0.018s
W20260709 13:08:36.130744 26756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.012s	sys 0.018s
W20260709 13:08:36.132606 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 516818us
W20260709 13:08:36.131291 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 297895us
I20260709 13:08:36.135540 27320 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:36.142310 26607 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:36.143052 26606 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:08:36.145227 26607 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:36.076550 30494 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.080286 30498 consensus_queue.cc:1243] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:36.129817 30448 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.140303 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:36.159813 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:36.160422 26608 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:36.179006 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:36.180267 26609 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:36.150207 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:36.120529 30510 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.188522 26609 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:08:36.194830 26609 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:36.194787 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 61540.7us
W20260709 13:08:36.195791 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.151031 30453 raft_consensus.cc:2764] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:36.197222 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.198390 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:36.199143 26611 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.203562 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:36.120319 30430 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.230655 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:36.159252 30559 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:36.194437 30450 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
W20260709 13:08:36.199083 30502 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.003s
I20260709 13:08:36.237090 30559 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.232954 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:36.155812 30269 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.165671 30258 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:08:36.240159 26755 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:36.267082 26612 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:36.270967 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 242402us
I20260709 13:08:36.273907 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.277701 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:36.239524 30529 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.278591 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.280548 26612 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:36.231243 30123 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:36.208241 30562 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.288255 26758 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:36.289273 30123 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:36.291447 30123 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.292562 30123 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:36.288080 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 205550us
I20260709 13:08:36.299144 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:36.302425 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:36.299202 30460 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:36.293298 30083 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:36.308254 26686 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:36.312000 26686 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:36.312523 26686 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:36.314039 26686 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.316929 26686 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.326581 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:36.335681 26687 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:36.333803 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59846.2us
W20260709 13:08:36.336896 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 176058us
I20260709 13:08:36.354451 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.358245 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:36.361064 26680 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:36.361845 27321 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:36.362214 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:36.363931 26685 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.301523 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:36.363857 26611 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:36.364758 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:36.360224 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 193552us
W20260709 13:08:36.368126 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76639.6us
I20260709 13:08:36.360849 26683 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:36.239617 30559 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.266898 30567 raft_consensus.cc:2764] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:08:36.185635 30448 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.266372 30556 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:36.388821 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 89642.2us
W20260709 13:08:36.393553 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 196444us
I20260709 13:08:36.390204 26685 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:36.402956 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:36.400229 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.358454 30578 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.267520 30450 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.420790 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.373793 30562 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:36.425240 26610 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 6.
I20260709 13:08:36.359158 30103 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:08:36.440775 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:36.451699 30083 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.445731 30503 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.422216 30556 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:36.453447 30556 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.451812 30459 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.425781 30578 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.457933 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 13:08:36.431365 30498 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:36.465374 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 186576us
I20260709 13:08:36.440682 30567 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.437099 30558 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:36.482115 27286 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:36.458572 30563 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:36.484447 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:36.484719 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.489269 27313 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:08:36.489488 30494 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.433079 30461 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:08:36.493320 27312 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:36.462620 29884 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.472892 30581 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:36.506248 26686 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:36.462165 30537 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.509069 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:36.473050 30578 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:36.521641 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 152748us
I20260709 13:08:36.512365 30502 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:36.521042 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.472134 30426 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.656271 30559 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:36.656802 30507 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:36.658131 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117775us
I20260709 13:08:36.659318 30258 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.659844 30258 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.526561 30494 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.660782 30494 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.661000 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:36.661985 30258 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:36.662580 30258 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:36.662921 30258 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:36.663061 30494 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.663307 30258 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.663743 30594 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:36.664534 30516 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:36.541663 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45426us
I20260709 13:08:36.626155 30498 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:36.652407 30247 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.001s
I20260709 13:08:36.498744 30563 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:36.526523 30493 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:36.695711 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 324688us
W20260709 13:08:36.698925 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.708777 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:36.714270 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:36.715528 26607 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:08:36.718079 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 209133us
I20260709 13:08:36.720211 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:36.693076 30563 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:36.736896 30597 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:08:36.737601 30572 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
W20260709 13:08:36.741214 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43997.1us
I20260709 13:08:36.491604 30558 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.722477 30587 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:36.686280 30247 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.717335 30568 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:36.718163 30593 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.677744 30559 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:36.723058 30510 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.760856 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:36.762384 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:36.764153 30574 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 13:08:36.765762 30603 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:36.685065 30537 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:08:36.757958 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 267309us
I20260709 13:08:36.733451 30269 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:36.757009 30503 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.705606 30498 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.835450 30498 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.835777 30507 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:36.836331 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.836966 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.837697 27314 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:36.838028 30592 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:08:36.837841 30258 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.838372 30591 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.814731 30478 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.840003 30503 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.842080 30503 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:36.783815 30568 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.745893 30576 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.844501 30576 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.845001 26753 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:36.845160 30568 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.845640 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.845456 30603 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:36.847352 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.777909 30589 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:36.839462 30269 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:08:36.844887 30576 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.779999 30606 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:36.832279 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 70016.7us
I20260709 13:08:36.847471 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1371) took 1141 ms. Trace:
I20260709 13:08:36.852411 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.852077 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:36.853291 27284 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.855s (SENT)
I20260709 13:08:36.856086 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:36.855262 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:36.852084 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.854347 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.813549 30593 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:36.939954 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 179168us
W20260709 13:08:36.852759 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.037185 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:37.232761 26757 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.233021 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.234488 26753 rpcz_store.cc:276] 0709 13:08:35.705766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.707752 (+  1986us) service_pool.cc:224] Handling call
0709 13:08:36.847267 (+1139515us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400082854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:36.847415 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591003392}
I20260709 13:08:37.237703 26752 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:36.859290 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:37.241752 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 382525us
I20260709 13:08:37.242774 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:37.166996 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.940969 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.249730 26754 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:37.250499 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:37.251238 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 397960us
W20260709 13:08:37.252208 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 2.087s (SENT) [suppressed 7 similar messages]
I20260709 13:08:36.936712 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:36.851116 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:37.290284 26684 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:37.267405 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:36.850593 30536 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.038s	user 0.010s	sys 0.002s
I20260709 13:08:37.291483 26686 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:37.290125 27315 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:37.297130 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.297866 26686 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:37.298525 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:37.277731 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.299968 26682 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
W20260709 13:08:37.284713 27321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 512) took 1697 ms (client timeout 2035 ms). Trace:
I20260709 13:08:37.280045 26757 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
W20260709 13:08:37.302130 27321 rpcz_store.cc:269] 0709 13:08:35.553133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.553278 (+   145us) service_pool.cc:224] Handling call
0709 13:08:37.249976 (+1696698us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:37.250142 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834251648}
W20260709 13:08:36.939025 30123 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:08:36.853075 30182 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:37.090694 30601 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.852620 30589 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:36.937274 30613 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:08:36.941143 30599 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:36.862753 30450 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:36.852119 30558 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:37.308983 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:36.940516 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:37.090209 30578 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:36.847632 30603 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:37.312062 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79377.4us
I20260709 13:08:37.312618 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:37.331694 30478 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.266889 30211 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.967574 30445 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.308677 30536 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.305243 30607 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:08:37.265980 30564 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.312592 30503 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.312364 30499 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.359261 27318 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:36.940200 30575 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.254830 30616 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:36.887945 30587 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.451s
I20260709 13:08:37.300213 30584 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.306354 30498 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:37.371927 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.372090 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.311453 30182 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:37.372985 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.374373 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.432102 26607 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:37.333449 30589 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:37.380015 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 127813us
I20260709 13:08:36.853089 30258 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:37.355831 30123 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.268525 30606 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.388288 26678 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.388895 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:37.442440 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53632.6us
I20260709 13:08:37.442816 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.443212 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.444458 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.365978 30560 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.412873 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:37.454658 26679 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:37.401360 30576 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:08:37.408226 30564 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:37.421664 27316 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:37.422771 30536 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:37.362509 30601 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.390486 27319 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
I20260709 13:08:37.431327 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.423501 30575 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.381313 30599 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.445063 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.446656 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:37.456278 30605 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:08:37.464104 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.456444 30450 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.471467 26605 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:37.423437 30499 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.454891 30478 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.423837 30503 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.457468 30568 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.411563 30445 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.484071 26678 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:37.459951 30353 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:08:37.485505 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:37.486354 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:37.503140 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 260446us
I20260709 13:08:37.432659 30498 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:37.505863 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123466us
I20260709 13:08:37.481767 30211 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:37.500844 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.443605 30584 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.501544 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.503626 26761 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.475598 30575 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.504071 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.498826 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.489585 30558 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.519762 26760 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:37.454710 30123 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.520504 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.486164 30598 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.507723 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.460175 30576 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.484547 26757 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:37.525460 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:37.518060 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.526475 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.527047 26757 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:37.460659 30560 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.529960 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.530604 26678 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:37.531797 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.531437 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:37.532745 26678 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:37.537253 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.538415 26612 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:37.540329 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.549446 26757 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:37.550483 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.550525 26761 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:37.551877 26761 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:37.553858 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1602) took 2090 ms. Trace:
I20260709 13:08:37.502763 30182 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:37.559792 30623 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:08:37.560797 30624 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:37.531728 30558 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:37.561738 30621 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:08:37.563100 30558 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:37.563730 30599 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.565682 30601 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:37.567202 30398 raft_consensus.cc:993] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower 687d192f79a044ce838f0bf292f0c09f to start an election
W20260709 13:08:37.574146 30563 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.803s	user 0.002s	sys 0.007s
I20260709 13:08:37.574615 30563 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.546308 30450 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:37.577225 26755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1607) took 2020 ms (client timeout 1783 ms). Trace:
W20260709 13:08:37.577677 26755 rpcz_store.cc:269] 0709 13:08:35.557294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.564734 (+  7440us) service_pool.cc:224] Handling call
0709 13:08:37.577018 (+2012284us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54000b9ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:37.577154 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519659904}
I20260709 13:08:37.578516 30627 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:37.579254 30627 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.582870 26679 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:37.560849 30503 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:37.587952 30620 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:08:37.588434 30526 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:08:37.521984 30607 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:37.590448 30123 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:37.591219 30628 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.592533 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.592721 30584 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:37.593292 26611 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:37.593218 30584 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:37.593538 30211 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.593855 30584 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.594244 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.594491 30211 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.594951 26611 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:37.561774 30445 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.597383 26758 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:37.599692 30211 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.600669 30564 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.588485 30498 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.600344 30211 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.602238 30576 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.603319 26684 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:37.604579 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.557080 30598 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:37.605720 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.606731 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.604696 30606 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:37.557835 26756 rpcz_store.cc:276] 0709 13:08:35.463288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.481496 (+ 18208us) service_pool.cc:224] Handling call
0709 13:08:35.503399 (+ 21903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.132697 (+629298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.132744 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.147105 (+ 14361us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.506604 (+359499us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:36.506849 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.507191 (+   342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.553599 (+1046408us) raft_consensus.cc:1685] finished
0709 13:08:37.553627 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.553788 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69184,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":954588,"threads_started":2,"wal-append.queue_time_us":1080166}
I20260709 13:08:37.600698 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 382) took 2056 ms. Trace:
I20260709 13:08:37.620358 26606 rpcz_store.cc:276] 0709 13:08:35.544572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.544714 (+   142us) service_pool.cc:224] Handling call
0709 13:08:35.545101 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:36.145290 (+600189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.600469 (+1455179us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400285ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:37.600644 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374544640}
I20260709 13:08:37.594466 30584 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.615188 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.615777 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.629014 26605 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:37.633215 26686 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:37.634125 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.639904 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.577253 30560 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:37.644083 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112398us
I20260709 13:08:37.633104 30601 raft_consensus.cc:1081] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Signalling peer 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:08:37.644979 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.646610 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.648871 30627 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.649005 30211 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.650631 30584 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:37.651702 30604 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:37.654971 30575 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.657495 30575 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.658466 30629 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.658982 30564 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.660466 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:37.660701 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1435) took 1290 ms. Trace:
I20260709 13:08:37.678454 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.666301 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:37.669119 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.680374 26606 raft_consensus.cc:2368] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:37.685968 30568 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.678601 26680 rpcz_store.cc:276] 0709 13:08:36.370455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.370574 (+   119us) service_pool.cc:224] Handling call
0709 13:08:36.370881 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.382992 (+ 12111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.383041 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.402511 (+ 19470us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.504274 (+101763us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:36.504323 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.504394 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.660494 (+1156100us) raft_consensus.cc:1685] finished
0709 13:08:37.660517 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.660645 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18229,"thread_start_us":52955,"threads_started":1,"wal-append.queue_time_us":1060506}
I20260709 13:08:37.692423 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.687918 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.649195 30478 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.702946 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.708774 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:37.710005 26611 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:37.706871 30560 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.700237 30627 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.682451 30593 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:37.748296 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56549.4us
I20260709 13:08:37.720652 30622 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:37.749950 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.750496 26607 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:37.750561 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:37.750651 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.751936 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.722478 30560 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:37.752956 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 210672us
I20260709 13:08:37.752509 26684 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:37.755467 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.758929 26756 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:37.759218 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:37.761875 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:37.762604 26757 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.744194 30558 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.761821 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.766721 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.777221 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:37.759156 30633 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:37.774538 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.777460 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.782512 26757 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:37.784492 30622 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:37.753605 30589 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.790134 30622 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.790604 30622 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.792415 30563 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.794186 30515 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:37.779387 30558 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.793944 30560 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.794620 30515 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:37.797857 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:37.798133 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.798583 26756 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:37.800446 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.781023 30123 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:37.778033 30639 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:37.771385 30518 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:08:37.819541 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.805151 30575 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.826396 30575 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:37.808281 30056 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.827370 30575 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.813566 30639 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.808813 30123 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.805209 30478 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:37.823699 30518 consensus_queue.cc:1243] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:37.840399 30123 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:37.850574 30634 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:08:37.852421 30568 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:37.852782 30636 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:37.852999 30568 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:37.854329 26759 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:37.853941 30568 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.855127 30568 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.831981 30056 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.839869 30639 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.808367 30577 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:37.841140 30515 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.881155 30515 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.888355 30629 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.861857 30056 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.906728 26683 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:37.913015 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:37.899480 30518 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:37.937250 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.901639 30301 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.943990 30589 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:37.945401 30530 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:37.945943 30530 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:37.947759 30637 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:37.953647 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:37.954456 26684 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:37.918921 30426 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:37.956804 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.946923 30530 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.942153 30616 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:37.972213 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:37.941977 30558 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:37.973529 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:37.974609 27318 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:37.974963 27318 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:37.969810 30570 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.585s	user 0.009s	sys 0.001s
I20260709 13:08:37.968941 30426 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.980392 27318 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.996431 30115 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:37.997056 30115 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:37.997529 27318 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:37.998163 30646 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:08:37.997890 30115 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.998879 30426 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:37.999123 30642 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:37.977540 30616 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:38.000356 30622 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:37.967736 30632 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.999277 30115 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.002341 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:37.955940 30301 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.948537 30637 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:37.977749 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:38.007805 27321 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:37.950379 30518 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.012492 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.007189 30631 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:38.014910 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.015173 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:38.021871 27318 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:38.025267 27318 pending_rounds.cc:85] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 7
I20260709 13:08:38.025592 27318 pending_rounds.cc:107] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:38.025803 27318 raft_consensus.cc:2889] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.016680 27314 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:38.017597 30247 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:38.018586 30301 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.025084 27321 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:38.006103 30632 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.036969 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.037845 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:38.034924 30632 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.000414 30616 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.020092 30631 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:38.047104 30637 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.049005 30493 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:38.052721 30622 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:38.054594 26610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 380) took 2618 ms (client timeout 2087 ms). Trace:
W20260709 13:08:38.057318 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.060894 30518 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.061616 30627 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.082275 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 511) took 2529 ms. Trace:
I20260709 13:08:38.082682 27316 rpcz_store.cc:276] 0709 13:08:35.552542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.552730 (+   188us) service_pool.cc:224] Handling call
0709 13:08:35.556207 (+  3477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.457258 (+1901051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.082042 (+624784us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54004b78d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:38.082217 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4289525120}
I20260709 13:08:38.084323 26761 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:38.085335 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.085337 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.086709 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.061775 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2669) took 1915 ms. Trace:
I20260709 13:08:38.087327 26761 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:38.065533 30589 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.070742 30499 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.101254 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:38.073051 30599 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.074718 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:38.079980 26610 rpcz_store.cc:269] 0709 13:08:35.435855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.436018 (+   163us) service_pool.cc:224] Handling call
0709 13:08:38.054391 (+2618373us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400249854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:38.054513 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216738688}
I20260709 13:08:38.102133 26761 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:38.102488 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.102612 30622 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.110275 26682 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:38.109683 30599 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.080269 30493 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.110685 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.087477 26604 rpcz_store.cc:276] 0709 13:08:36.146339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.148490 (+  2151us) service_pool.cc:224] Handling call
0709 13:08:36.177803 (+ 29313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.233336 (+ 55533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.233366 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.233411 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:36.233439 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.061566 (+1828127us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b5400065c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:38.061608 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.061721 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127240448}
I20260709 13:08:38.100436 30637 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:38.072505 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.099193 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.113031 26760 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:38.078641 30631 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:38.100950 30269 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:38.091787 30123 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:38.115067 30417 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:08:38.127971 30573 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.745s	user 0.003s	sys 0.008s
I20260709 13:08:38.124975 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.126447 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.127302 30584 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:38.117033 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 383) took 2541 ms (client timeout 1855 ms). Trace:
I20260709 13:08:38.117352 30637 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:38.138281 26603 rpcz_store.cc:269] 0709 13:08:35.575535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.575788 (+   253us) service_pool.cc:224] Handling call
0709 13:08:38.116831 (+2541043us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:38.116965 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071205632}
I20260709 13:08:38.138329 30584 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.138895 30637 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.140750 30584 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.127869 30563 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.142681 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.142602 30563 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.144809 30563 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.121417 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:38.114516 30627 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:38.146087 30627 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.146481 30627 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.120257 30599 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.119755 30622 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.127341 26679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:08:38.157485 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.158159 26679 raft_consensus.cc:606] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:38.158356 26687 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:38.158530 26679 raft_consensus.cc:614] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.159288 30622 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.114305 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.159561 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.119046 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.102867 30589 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.137938 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.148183 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.149720 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.150734 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.162860 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.163085 26678 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:38.152060 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.155854 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.116285 30639 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.157436 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:38.169610 26576 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:38.169821 26760 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:38.170035 26576 leader_election.cc:403] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.159288 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.171653 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.171868 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.163889 26684 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.168067 26759 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:38.173514 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.174674 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.168186 26609 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:38.170686 26687 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:38.160727 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44158.8us
I20260709 13:08:38.172578 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.176654 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.177706 26679 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:38.156028 30499 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.180544 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.169247 30599 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:38.172626 30563 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.176517 30584 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.187599 30462 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.197785 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 513) took 2585 ms. Trace:
I20260709 13:08:38.188251 30498 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.185911 30417 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.200183 27320 rpcz_store.cc:276] 0709 13:08:35.611989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.612150 (+   161us) service_pool.cc:224] Handling call
0709 13:08:35.612427 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.136655 (+524228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.197514 (+2060859us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540052f8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:38.197710 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202539904}
I20260709 13:08:38.171780 30593 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:38.160678 30056 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:38.210703 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45495.4us
I20260709 13:08:38.193732 30599 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.214591 26684 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:38.215920 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2673) took 2053 ms. Trace:
I20260709 13:08:38.216555 26608 rpcz_store.cc:276] 0709 13:08:36.162059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.179880 (+ 17821us) service_pool.cc:224] Handling call
0709 13:08:36.208766 (+ 28886us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:36.229882 (+ 21116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.229914 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:36.246789 (+ 16875us) log.cc:844] Serialized 52 byte log entry
0709 13:08:38.111439 (+1864650us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b180047dd00. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1
0709 13:08:38.111593 (+   154us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:38.199802 (+ 88209us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.203388 (+  3586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.203479 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.203520 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:38.215588 (+ 12068us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.215848 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5072,"prepare.queue_time_us":100333,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":203618,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":24660,"spinlock_wait_cycles":33472384,"thread_start_us":161691,"threads_started":2,"wal-append.queue_time_us":1015177}
I20260709 13:08:38.203613 30575 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.228902 30575 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.219266 30599 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.230433 30448 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.231472 30578 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.212596 30598 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.236117 30598 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.241192 30639 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.245872 30589 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.256018 30627 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.257989 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.366364 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:38.367416 26605 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:38.372320 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:38.239426 30598 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.218945 30584 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:38.214164 30454 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.407810 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:38.405455 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 232928us
I20260709 13:08:38.258947 30498 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.407617 30559 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.441891 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.394778 30637 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.421232 30584 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.456094 30123 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.457119 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.504484 26608 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:38.459071 30056 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:38.499459 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 127237us
I20260709 13:08:38.501071 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.417757 30499 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:38.501104 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 320646us
I20260709 13:08:38.524865 26650 leader_election.cc:400] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:38.525187 26650 leader_election.cc:403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.493721 30462 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10.
I20260709 13:08:38.531755 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.532301 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:38.504335 30584 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.534119 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.517128 30459 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:38.514708 30269 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.542034 26758 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:38.541173 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:38.472429 30559 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.460283 30632 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.497957 30637 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.549567 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.535212 30498 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:38.539793 30563 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.530862 30627 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.553056 30559 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:38.541181 30459 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:38.561868 30459 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.561520 30599 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.547037 30269 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.566032 30269 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.558997 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.559248 30499 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.548904 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.574924 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.583264 26756 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:38.636590 26752 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:08:38.640282 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 65528.2us
I20260709 13:08:38.648206 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.648891 26604 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
W20260709 13:08:38.660552 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 498064us
I20260709 13:08:38.663113 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.659857 30454 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.563621 30599 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.668252 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.582152 30515 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.683579 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.581809 30664 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.693166 26604 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:38.701622 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.682842 30589 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:38.706470 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.685529 30056 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.708323 30589 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.712019 30589 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:38.714562 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.703045 30454 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.720557 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:38.726626 26607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1600) took 1351 ms (client timeout 1558 ms). Trace:
W20260709 13:08:38.727309 26607 rpcz_store.cc:269] 0709 13:08:37.375180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.444805 (+ 69625us) service_pool.cc:224] Handling call
0709 13:08:38.726425 (+1281620us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:38.726559 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563571072}
I20260709 13:08:38.731194 30568 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:38.731642 30568 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.732041 30568 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.732352 30430 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:38.735905 30056 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.736428 30056 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:38.729862 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 72598.6us
I20260709 13:08:38.739395 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.740113 26686 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:38.740175 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.740767 26687 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.739516 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.741796 26684 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:38.743064 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 200135us
I20260709 13:08:38.740834 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.739727 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.747725 26678 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:38.749209 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.750614 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:38.751356 26607 raft_consensus.cc:2368] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:38.752180 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.754856 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:38.754906 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.757522 26607 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:38.761665 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.720345 30460 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.762885 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.706297 30599 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:38.766902 27318 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:38.763124 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.764401 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.774011 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.774663 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:38.775949 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.781196 26683 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:38.728701 30664 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.715117 30667 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:38.792809 26680 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:38.797297 26687 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:38.799190 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.800460 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.801231 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.802026 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:38.810573 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:38.852692 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.813414 30430 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.755932 30606 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.802981 30560 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:38.799039 30667 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.809383 30663 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:38.839893 30499 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:38.804348 30115 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:08:38.883426 30661 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:38.882119 30632 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:38.892009 30056 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:38.906513 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 142692us
I20260709 13:08:38.870596 30430 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.871953 30640 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:38.924501 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.894481 30560 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.895802 30637 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:38.926028 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:38.933054 26686 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:38.909106 30499 consensus_queue.cc:1243] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:38.890807 30667 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:38.930944 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:38.921301 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:38.933746 30493 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260709 13:08:38.945417 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:38.949983 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.959568 30637 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.934122 30560 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.961551 26650 leader_election.cc:400] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:38.957525 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:38.944559 30056 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:38.942453 30614 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.927227 30661 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:38.963169 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 318246us
I20260709 13:08:38.979909 30578 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:38.980402 30578 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.980769 30578 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.965540 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.982074 30417 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:38.982379 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:38.982573 30417 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:38.965873 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:38.983795 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:38.956483 30629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.006s	sys 0.016s
I20260709 13:08:38.963138 30664 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:38.952714 30460 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:08:38.989845 30629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.006s	sys 0.017s
I20260709 13:08:38.945027 30579 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:38.951447 30493 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:38.911867 30663 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:38.983124 30417 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:38.968719 30056 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.956485 30459 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.001585 30627 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:39.024462 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83098.5us
I20260709 13:08:39.032470 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:39.074586 26757 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:39.008684 30678 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:39.080318 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.081383 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.082054 26612 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:39.015440 30676 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:08:39.031867 30056 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.014159 30681 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.127202 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.128276 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.077703 30515 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:39.132615 26754 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:39.136252 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.137629 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.015553 30454 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:08:39.138365 26612 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
W20260709 13:08:39.143249 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 159526us
I20260709 13:08:39.148989 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:39.145589 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 164611us
W20260709 13:08:39.152109 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.155869 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:39.156103 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.155287 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.157012 27314 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:39.156337 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.158433 27312 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:39.135860 30677 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:08:39.148413 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 116035us
I20260709 13:08:39.166620 26612 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:39.137178 30515 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.141778 30430 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.181869 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:39.144775 30627 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.182849 26612 raft_consensus.cc:2376] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9. Re-sending same reply.
I20260709 13:08:39.190416 30579 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:39.190858 30579 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:39.196750 30459 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.198503 30493 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.184533 30693 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.202078 30430 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.202836 30430 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.207911 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2772) took 1349 ms. Trace:
I20260709 13:08:39.208310 26682 rpcz_store.cc:276] 0709 13:08:37.858563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.860176 (+  1613us) service_pool.cc:224] Handling call
0709 13:08:37.860558 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.110706 (+250148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.207624 (+1096918us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400187754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:39.207846 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573712768}
I20260709 13:08:39.210331 30448 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.210440 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.210942 30448 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.211748 30627 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.212579 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.213007 30448 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.213488 30448 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.213799 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:39.213904 30448 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.214392 26606 raft_consensus.cc:2376] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10. Re-sending same reply.
I20260709 13:08:39.168416 30614 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.215185 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:39.215366 30614 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.218815 30614 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.220247 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 392) took 1329 ms. Trace:
I20260709 13:08:39.221202 30568 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.222124 30462 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.222697 26603 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:39.224717 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.226027 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.220798 26759 rpcz_store.cc:276] 0709 13:08:37.890442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.890583 (+   141us) service_pool.cc:224] Handling call
0709 13:08:37.890857 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.185489 (+294632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.219999 (+1034510us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:39.220185 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636974464}
I20260709 13:08:39.226986 30448 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:39.232563 30673 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:08:39.234696 30632 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.237951 30683 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.238653 30683 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:39.240604 30688 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:39.241498 30683 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:39.235360 30632 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.252264 30564 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.253041 30564 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.256160 30640 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.171412 30695 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.256758 30640 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.257390 30695 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.178017 30515 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.234091 30579 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:39.232724 30589 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:08:39.288123 30579 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.289093 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:39.263581 30631 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.107s	user 0.006s	sys 0.006s
I20260709 13:08:39.293818 26611 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
W20260709 13:08:39.264168 30677 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:39.324162 30664 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:39.346508 30584 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.001s
I20260709 13:08:39.343925 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.347358 30584 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.347824 26753 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:39.350077 30584 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.350389 30578 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.350701 30584 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:39.351577 30568 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.351783 30584 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:39.278399 30430 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.352392 30584 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:39.352455 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.352653 30430 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:39.353030 26558 auto_rebalancer.cc:893] Removing replace marker failed: Replica b9e8388401a74e84a2cc880930412709 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:39.353232 30430 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:39.353549 26558 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:08:39.353951 26558 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:39.353463 30584 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.354164 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.354867 26612 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:39.356161 30664 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.356859 26753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52970
I20260709 13:08:39.357427 26753 raft_consensus.cc:606] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:08:39.358449 30516 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.325692 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.355566 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.379544 26612 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:39.307559 30182 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.403067 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.324352 30460 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.416363 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.417237 26755 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:39.358872 30516 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.357419 30417 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:39.417951 30629 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.294528 30589 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.420622 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.431263 26760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52970
I20260709 13:08:39.434512 26755 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.434587 26760 raft_consensus.cc:606] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:08:39.434738 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.428524 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.324887 30631 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.412627 30695 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.446241 30578 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.446151 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.456796 30661 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.457193 27314 raft_consensus.cc:1217] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[5.6-9.8]   Dedup: 5.6->[7.7-9.8]
I20260709 13:08:39.457208 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.457772 27314 pending_rounds.cc:85] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 6
I20260709 13:08:39.458055 27314 pending_rounds.cc:107] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:08:39.458297 27314 raft_consensus.cc:2889] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.354185 30430 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:39.448998 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.458756 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
W20260709 13:08:39.449566 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 278831us
I20260709 13:08:39.459373 26612 raft_consensus.cc:606] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:39.459408 30430 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.460045 26612 raft_consensus.cc:614] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:39.461126 26612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:49434
I20260709 13:08:39.461711 26612 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.462170 26612 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:39.463783 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 327741us
I20260709 13:08:39.469172 26609 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:39.432386 30691 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:39.482261 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.480532 26575 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:39.480587 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.482870 26753 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.485455 27285 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.472401 30516 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.492585 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:39.493307 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.496691 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:39.490747 26612 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:39.491879 30667 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.536s	user 0.001s	sys 0.010s
W20260709 13:08:39.498857 30686 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:08:39.481984 30661 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.499579 30661 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.501672 30661 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.485421 30691 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.502420 26499 maintenance_manager.cc:419] P d386a230fc3e442b8633387e891e63d1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033372
I20260709 13:08:39.514171 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.477428 30703 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.431047 30629 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.514171 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.481675 30683 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:39.520037 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.525753 26758 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.519942 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.485072 30699 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.491149 30599 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:39.521762 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:39.515239 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.520434 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:39.426299 30460 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.529315 26612 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.530776 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:39.554476 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.554721 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.531220 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:39.557749 26753 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:39.558701 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.558998 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.559383 26753 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:39.560146 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49434 (request call id 2704) took 1122 ms. Trace:
I20260709 13:08:39.560509 27318 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:39.534397 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.495537 30695 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.526898 30703 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.504743 30529 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.543349 30616 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:39.544117 30599 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:39.545313 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.564232 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.564857 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.560535 26612 rpcz_store.cc:276] 0709 13:08:38.432668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.460995 (+1028327us) service_pool.cc:224] Handling call
0709 13:08:39.554516 (+ 93521us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:39.567711 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53632.4us
I20260709 13:08:39.498869 30667 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.553311 30617 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:39.537804 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.542277 30687 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.570628 26755 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:39.543020 26758 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:39.576278 27313 raft_consensus.cc:2376] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10. Re-sending same reply.
I20260709 13:08:39.575650 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.577378 30516 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.577876 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:39.578342 30708 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:39.578456 30493 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.579883 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.599080 30516 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:39.599637 30516 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:39.599773 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:39.600867 30417 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.600594 30516 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.601188 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:39.601750 30516 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:39.601950 30126 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:39.602420 30126 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.602773 30126 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.603843 30507 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.604317 30687 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.605355 30493 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:39.605736 30493 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:39.605929 30629 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.606575 30493 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.607071 30631 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.518775 30056 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.575287 30616 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:39.609020 26606 raft_consensus.cc:2368] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11.
I20260709 13:08:39.609076 30616 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.583359 30691 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:39.609472 30056 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.570076 30632 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:39.585562 30564 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.573107 30710 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.610841 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.611845 30703 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.553066 30699 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.612882 30493 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.613991 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2709) took 1089 ms. Trace:
W20260709 13:08:39.594849 30697 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:39.614346 26609 rpcz_store.cc:276] 0709 13:08:38.524772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.470748 (+945976us) service_pool.cc:224] Handling call
0709 13:08:39.471013 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.479957 (+  8944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.479987 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.485427 (+  5440us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.515512 (+ 30085us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:39.516522 (+  1010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.516614 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.613791 (+ 97177us) raft_consensus.cc:1685] finished
0709 13:08:39.613810 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.613935 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8583,"raft.queue_time_us":10834,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5554,"thread_start_us":29730,"threads_started":1,"wal-append.queue_time_us":126775}
I20260709 13:08:39.593748 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.617079 26755 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:39.617218 26609 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:39.617412 26755 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:39.574856 30454 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:39.619375 26609 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:39.620795 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:39.533668 30683 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.584551 30614 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.590029 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:39.633669 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 43804.2us
I20260709 13:08:39.598999 30515 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:39.571130 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 55968.9us
I20260709 13:08:39.635842 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:39.636924 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.638895 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:39.620033 26755 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.647300 26755 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:39.649994 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.651319 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:39.618080 30454 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.654099 30703 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.645273 30631 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:39.645025 30710 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:39.655154 26753 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:39.657090 30667 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.580983 30599 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.658221 26608 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:39.658950 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.668061 27317 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.668355 26754 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:39.614346 30699 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.658547 30564 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:39.675412 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.676652 26755 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:39.674383 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:39.686188 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:39.620134 30617 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.690399 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.691152 26755 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.695041 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.696292 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:39.684571 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 395515us
I20260709 13:08:39.667181 30589 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.703578 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:39.703687 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:39.704303 26682 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:39.705706 26755 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:39.706473 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:39.706662 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.707083 26685 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:39.685097 30703 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:39.685665 30629 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.700088 30699 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:39.699765 30564 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:39.715337 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:39.712098 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:39.713121 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:39.699602 30667 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:39.715976 26682 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.717592 30667 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.722646 30667 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:39.723503 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.724748 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.725308 26605 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:39.726086 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.727226 26605 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:39.705205 30727 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:39.732136 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1404) took 1655 ms. Trace:
I20260709 13:08:39.732708 26752 rpcz_store.cc:276] 0709 13:08:38.076774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.118422 (+ 41648us) service_pool.cc:224] Handling call
0709 13:08:38.118706 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.637164 (+518458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.731817 (+1094653us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54002dc8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:39.732063 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190337792}
I20260709 13:08:39.708496 30584 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:39.711210 30529 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.743111 26687 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:39.719414 30559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.003s	sys 0.012s
I20260709 13:08:39.748734 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:39.752182 26682 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:39.670629 30710 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:39.741609 30699 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:39.753702 30559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.003s	sys 0.012s
I20260709 13:08:39.729956 30629 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.755869 30617 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:39.772238 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:39.761842 30678 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.015s
I20260709 13:08:39.773731 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:39.771868 30560 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.005s
I20260709 13:08:39.778311 26687 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
W20260709 13:08:39.779206 26495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 179712us
W20260709 13:08:39.780390 30716 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:39.782483 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:39.783962 30454 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.787302 26607 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:39.788344 26607 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:39.790940 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.791760 26760 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:39.775996 30678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.000s	sys 0.016s
I20260709 13:08:39.798413 26610 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:39.799029 27317 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:39.799813 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:39.802760 26682 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.805028 26756 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:39.805060 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:39.806720 26760 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:39.807255 26610 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:39.796183 30707 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:39.815963 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:39.804054 30683 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:39.828194 26682 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:39.797611 30678 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:39.835754 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:39.836021 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:39.836598 26686 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:39.837376 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:39.837845 26686 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.838686 30629 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:39.839203 30629 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:39.777381 30564 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:39.841840 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.842348 30515 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:39.842545 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.813251 30614 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:39.812848 30699 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.831477 30706 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:39.854440 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.865574 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.862650 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:39.894013 26686 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:39.947713 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:39.962803 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.790745 30560 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:39.993013 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 113082us
I20260709 13:08:39.876900 26678 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:39.796032 30616 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:39.839532 30629 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.990036 30584 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.002298 30126 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.082262 30667 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.030238 30631 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.080462 30530 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.031452 30629 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:40.089967 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.079743 30710 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:40.091046 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 218409us
W20260709 13:08:40.092589 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.110203 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:40.110935 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.091181 30493 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.116937 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:40.121606 26756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52970
I20260709 13:08:40.122534 26756 raft_consensus.cc:606] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:40.122901 26756 raft_consensus.cc:614] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:40.091046 30694 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:40.107277 30710 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.130476 26752 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:40.076406 30584 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.103756 30631 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.126211 30617 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.127576 30493 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.106693 30678 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.145569 30667 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.128998 30694 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.198185 30575 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.203696 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:40.214771 27315 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:40.134243 30710 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.157686 30617 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.252004 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 136256us
I20260709 13:08:40.256973 30710 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.278182 30694 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:40.278837 30691 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.253126 30575 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.280203 30575 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.281649 30691 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:40.282198 30575 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.251627 30617 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.272105 30560 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:40.289497 30710 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:40.390895 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:40.372570 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.379989 30616 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.399302 30710 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.380091 30694 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:40.400619 30694 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:40.401593 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.401435 30694 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.402319 30710 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.390647 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:40.555389 26752 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.555771 27315 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:40.404647 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.556770 26758 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:40.557559 26755 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.552323 30454 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.372376 30738 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:40.593168 30663 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:40.588967 26650 leader_election.cc:336] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.517s (SENT)
I20260709 13:08:40.601222 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:40.387444 30599 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.701s	user 0.003s	sys 0.003s
I20260709 13:08:40.597998 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.617311 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:40.603579 26650 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.558s (SENT)
I20260709 13:08:40.620048 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:40.615507 26752 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:40.622133 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.623178 26752 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:40.393858 30493 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:40.624500 30430 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:40.624843 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.624619 30493 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:40.625043 30430 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.627425 30430 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:40.627960 30430 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.628388 30430 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.630473 30430 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.398594 30631 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:40.386664 30724 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.693s	user 0.000s	sys 0.017s
I20260709 13:08:40.375140 30584 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.380067 30126 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:40.376245 30732 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:08:40.622901 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.606462 27286 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:40.559194 30461 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.640470 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:40.600041 30530 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.643843 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:40.648916 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.654907 27315 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:40.594676 30710 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:40.658396 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.610102 30417 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.665601 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.667054 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:40.667590 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.668081 26758 raft_consensus.cc:2368] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:40.662042 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:40.672216 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:40.638249 30430 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:40.657761 30668 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.679926 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.680912 26755 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:40.647266 30740 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:40.609491 30454 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.664161 30126 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:40.688688 26755 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:40.690312 27315 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:40.694324 30606 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.634508 30599 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.699285 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:40.700805 26685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.108s	sys 0.171s
W20260709 13:08:40.701604 26685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.109s	sys 0.171s
I20260709 13:08:40.654085 30461 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.663594 30530 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.702083 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.684177 30740 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:40.708578 26755 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:40.668622 30710 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.687986 30668 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.711835 30740 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.713445 30668 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.719355 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.720167 26755 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:40.727694 26607 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:40.698690 30306 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.737576 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.738740 26755 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:40.702234 30126 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:40.747777 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.752240 30126 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.754719 26755 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.760102 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2718) took 1177 ms. Trace:
I20260709 13:08:40.760681 26605 rpcz_store.cc:276] 0709 13:08:39.582879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.734709 (+151830us) service_pool.cc:224] Handling call
0709 13:08:39.735136 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.755327 (+ 20191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.755403 (+    76us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.760998 (+  5595us) log.cc:844] Serialized 52 byte log entry
0709 13:08:40.088764 (+327766us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:40.109300 (+ 20536us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.112136 (+  2836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.112198 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.759788 (+647590us) raft_consensus.cc:1685] finished
0709 13:08:40.759817 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.760022 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22159,"prepare.queue_time_us":19145,"prepare.run_wall_time_us":41,"raft.queue_time_us":25434,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":16133,"spinlock_wait_cycles":4450688,"thread_start_us":302866,"threads_started":1,"wal-append.queue_time_us":375205}
I20260709 13:08:40.765785 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:40.766571 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2710) took 1988 ms. Trace:
I20260709 13:08:40.767163 26651 leader_election.cc:400] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:40.767527 26651 leader_election.cc:403] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.767081 26608 rpcz_store.cc:276] 0709 13:08:38.778398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.604974 (+826576us) service_pool.cc:224] Handling call
0709 13:08:39.605275 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.669783 (+ 64508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.766255 (+1096472us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b54001f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:40.766498 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121345792}
W20260709 13:08:40.775063 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 132642us
I20260709 13:08:40.776012 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:40.777231 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.778240 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:40.779161 27318 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:40.780911 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.784493 26755 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:40.794195 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 120972us
I20260709 13:08:40.776561 30430 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:40.775344 30454 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:40.791709 30742 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:40.785838 30417 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:40.789793 30631 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.806581 30417 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.813714 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.789350 30744 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:08:40.809589 30678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.015s	sys 0.025s
I20260709 13:08:40.809998 30631 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.812383 30417 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:40.819110 30678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.015s	sys 0.025s
I20260709 13:08:40.837888 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:40.822278 30631 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.841348 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:40.833868 30430 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:40.830431 30502 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:40.818588 30740 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.846854 30627 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:40.848097 30599 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:40.843390 30710 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.851451 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:40.852432 30717 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.161s	user 0.000s	sys 0.013s
I20260709 13:08:40.852872 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.853824 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1408) took 1441 ms. Trace:
I20260709 13:08:40.854506 30460 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.854180 26759 rpcz_store.cc:276] 0709 13:08:39.412074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.412218 (+   144us) service_pool.cc:224] Handling call
0709 13:08:39.412645 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.429483 (+ 16838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.429527 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.432386 (+  2859us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.684377 (+251991us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.684431 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.684535 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.851730 (+1167195us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:40.853554 (+  1824us) raft_consensus.cc:1685] finished
0709 13:08:40.853576 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.853764 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49516,"raft.queue_time_us":41736,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4645,"spinlock_wait_cycles":21355136,"thread_start_us":197283,"threads_started":1,"wal-append.queue_time_us":214040}
I20260709 13:08:40.855625 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1623) took 2813 ms. Trace:
I20260709 13:08:40.847318 30740 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:40.856204 30629 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.002s
I20260709 13:08:40.856021 26757 rpcz_store.cc:276] 0709 13:08:38.042389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.118414 (+ 76025us) service_pool.cc:224] Handling call
0709 13:08:38.118658 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.075178 (+956520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.855402 (+1780224us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540014ebd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:40.855549 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197836032}
I20260709 13:08:40.856846 30629 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.829953 30530 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:40.859107 30629 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.864141 30426 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:40.864562 30426 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:40.864373 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:40.865540 27318 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:40.865449 30426 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.873347 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.874169 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.874938 26752 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:40.875211 30579 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:40.877125 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 487) took 1358 ms. Trace:
I20260709 13:08:40.877447 27317 rpcz_store.cc:276] 0709 13:08:39.518369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.518517 (+   148us) service_pool.cc:224] Handling call
0709 13:08:40.876970 (+1358453us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001b26d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:40.877073 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252851456}
I20260709 13:08:40.878018 30617 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.879648 26761 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:40.883109 30617 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:40.883812 30627 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:40.884135 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.885668 26685 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:40.886096 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:40.891494 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.892483 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:40.893468 26759 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:40.887782 27313 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:40.897675 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56404.4us
I20260709 13:08:40.898414 26687 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:40.899711 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.901628 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:40.860045 30417 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.904578 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:40.897816 30579 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:40.917951 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.897976 30426 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.918254 30579 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.916366 30748 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.924096 30640 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.903146 30749 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:40.925086 30749 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:40.926148 30749 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:40.907096 30454 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:40.929368 30719 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.238s	user 0.015s	sys 0.003s
I20260709 13:08:40.931977 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.904839 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:40.906551 26681 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:40.905848 30499 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:40.934559 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:40.915752 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:40.940579 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 528) took 1485 ms. Trace:
I20260709 13:08:40.944083 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.945714 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.947366 26679 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:40.949759 30727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.000s	sys 0.023s
I20260709 13:08:40.941740 27312 rpcz_store.cc:276] 0709 13:08:39.455436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.456021 (+   585us) service_pool.cc:224] Handling call
0709 13:08:39.456356 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.473546 (+ 17190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.473583 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.479030 (+  5447us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.709259 (+230229us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:39.709315 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.709389 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.928712 (+1219323us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:40.931408 (+  2696us) raft_consensus.cc:1685] finished
0709 13:08:40.931438 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.940493 (+  9055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21526,"raft.queue_time_us":16975,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4684,"spinlock_wait_cycles":29594496,"thread_start_us":204689,"threads_started":1,"wal-append.queue_time_us":203865}
I20260709 13:08:40.884500 30627 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:40.954427 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.957999 30727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.000s	sys 0.024s
I20260709 13:08:40.963598 30499 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:08:40.962484 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60976.1us
I20260709 13:08:40.960594 30693 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.967805 30693 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:40.968209 30499 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:40.968771 30499 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:40.965859 30115 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:40.971704 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.971844 30575 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:40.972361 30575 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:40.969458 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:40.973683 27312 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:40.974428 30575 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:40.975504 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:40.940028 30744 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:40.977996 26678 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 7.
I20260709 13:08:40.971444 30115 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:40.979215 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:40.978770 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.938512 30629 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:40.937184 30668 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:40.981542 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:40.952315 30454 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:40.970952 30693 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:40.979024 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.982491 30115 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:40.983695 30617 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.960708 30678 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:40.994783 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:40.996909 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.985240 30575 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.998991 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:40.999384 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:40.999687 26678 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:40.999585 26679 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.987031 30727 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:41.002099 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.003876 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.007702 26686 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:41.006816 26684 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:41.009917 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:40.980406 30640 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:40.993963 30126 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:41.013433 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.018493 26679 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:41.007161 30727 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.078802 30727 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.999914 30575 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.081346 30575 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.977409 30499 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.007385 30426 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:41.017717 30502 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:41.018442 30126 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:41.014317 30740 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:41.019920 30454 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.014775 30617 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.997736 30579 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:41.126971 27319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 525) took 1972 ms (client timeout 2035 ms). Trace:
I20260709 13:08:41.127388 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.127156 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:41.139186 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.143592 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1410) took 1728 ms (client timeout 1610 ms). Trace:
I20260709 13:08:41.054409 30710 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:41.150400 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:41.175967 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 119319us
W20260709 13:08:41.175161 27319 rpcz_store.cc:269] 0709 13:08:39.154791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.154941 (+   150us) service_pool.cc:224] Handling call
0709 13:08:41.038330 (+1883389us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:41.126904 (+ 88574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3871709440}
I20260709 13:08:41.151192 30617 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.180518 30617 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:41.181273 30758 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:08:41.182477 30526 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:41.175727 26754 rpcz_store.cc:269] 0709 13:08:39.415282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.415422 (+   140us) service_pool.cc:224] Handling call
0709 13:08:41.032293 (+1616871us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54002dbed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:41.143518 (+111225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534916864}
I20260709 13:08:41.190212 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.126973 30616 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.192233 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.193378 26759 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:41.198112 26761 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:41.197690 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.145464 30126 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.179178 30226 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:41.202148 30741 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.208734 30730 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.208846 30226 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.208992 30741 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.211061 30759 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:41.203548 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.198635 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.207624 30751 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:08:41.196790 30521 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.186488 30727 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.178965 30668 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.208113 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.177122 30729 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:41.211879 26756 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.215487 26682 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:41.232956 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.217314 27319 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.234022 27319 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:41.175276 30710 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:41.178996 30499 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:41.208145 30755 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:41.178843 30507 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:41.223003 26758 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.151695 30739 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:41.150247 30115 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.224736 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:41.238440 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89245.9us
I20260709 13:08:41.145098 30757 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:08:41.263221 27319 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.218667 30640 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:41.290067 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.211615 30226 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.179131 30579 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.283154 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.283730 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.287035 27319 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.259773 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.229772 30668 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.230032 30729 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:41.303894 27319 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:41.211596 30741 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.239799 30599 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:41.293495 26682 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:41.308818 26605 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 6.
I20260709 13:08:41.281776 26678 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:41.294693 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.236943 30521 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.296766 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:41.300994 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2716) took 1725 ms. Trace:
I20260709 13:08:41.301374 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2698) took 3042 ms. Trace:
I20260709 13:08:41.303922 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:41.286921 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 95484.1us
I20260709 13:08:41.219905 30661 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:08:41.291026 26680 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:41.262207 30753 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.216454 30616 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.316705 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.319443 26610 raft_consensus.cc:2368] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:41.317010 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.282460 30568 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:41.331365 26758 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:08:41.319593 26609 rpcz_store.cc:276] 0709 13:08:39.576038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.643710 (+ 67672us) service_pool.cc:224] Handling call
0709 13:08:39.644028 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.644253 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:41.026908 (+1382655us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b180047d5e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf
0709 13:08:41.130923 (+104015us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.295760 (+164837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.300726 (+  4966us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.300778 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.300840 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.300941 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9604,"prepare.queue_time_us":25337,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":9677696,"thread_start_us":208303,"threads_started":2}
I20260709 13:08:41.332080 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.320413 26686 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:41.345818 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.346412 26609 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:41.320629 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.351001 26608 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:41.332597 30226 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.316133 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 333766us
I20260709 13:08:41.317499 26684 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:41.315116 26756 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:41.319911 26604 rpcz_store.cc:276] 0709 13:08:38.259195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.694230 (+435035us) service_pool.cc:224] Handling call
0709 13:08:38.694505 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.722336 (+ 27831us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:38.945087 (+222751us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.142877 (+197790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.142928 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.142969 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.301169 (+2158200us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b540035f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:41.301216 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.301322 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298917,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":94927,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":48014,"spinlock_wait_cycles":63502720,"thread_start_us":419727,"threads_started":3,"wal-append.queue_time_us":226459,"wal-append.run_cpu_time_us":2040,"wal-append.run_wall_time_us":1374755}
I20260709 13:08:41.354494 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.355302 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.304353 30640 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.342294 26682 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:41.342818 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.360726 26610 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:41.344959 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:41.341183 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 151870us
I20260709 13:08:41.357982 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:41.363831 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.341202 30768 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.363826 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2715) took 1788 ms. Trace:
I20260709 13:08:41.350451 30751 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:41.365427 30760 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:41.365535 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:41.373390 26605 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:41.366601 30568 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.342916 30753 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.367875 30693 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:41.361624 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.364570 26608 raft_consensus.cc:2368] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:41.357033 26604 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:41.391152 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.392160 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.369024 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1427) took 1798 ms. Trace:
I20260709 13:08:41.392738 26753 rpcz_store.cc:276] 0709 13:08:39.570203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.662828 (+ 92625us) service_pool.cc:224] Handling call
0709 13:08:39.685313 (+ 22485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.710334 (+ 25021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.710379 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.710438 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:39.710483 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.368811 (+1658328us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400081954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:41.368857 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.368972 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57014528}
I20260709 13:08:41.346400 30507 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:41.320225 30631 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.371994 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.368865 26612 rpcz_store.cc:276] 0709 13:08:39.575778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.642209 (+ 66431us) service_pool.cc:224] Handling call
0709 13:08:39.642514 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.642730 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:39.647846 (+  5116us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.030742 (+1382896us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b180008cda0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:08:41.363159 (+332417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.363218 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.363280 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.363351 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.363769 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29869,"prepare.queue_time_us":2672,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":70268,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":14191,"spinlock_wait_cycles":8161664,"thread_start_us":273413,"threads_started":2,"wal-append.queue_time_us":50687,"wal-append.run_cpu_time_us":1288,"wal-append.run_wall_time_us":1029665}
I20260709 13:08:41.320426 30599 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.396174 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.376490 30727 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.336531 30710 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.396618 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.374284 30639 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.403434 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.395099 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:41.398603 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.400997 26612 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:08:41.405584 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.405807 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.405972 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.406360 26612 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:41.374887 30493 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:41.388245 30751 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.413506 30493 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:41.414852 30753 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.415164 30751 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.416301 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.417095 26608 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:41.418144 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:41.353448 30668 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.396993 30770 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:41.420006 30611 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:41.420624 30616 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.421159 30631 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.421828 26685 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:41.422039 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.422874 30115 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.419399 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.402387 30779 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:41.361557 30226 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.378159 30568 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.368294 30729 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.407581 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.408119 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.411644 26605 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:41.372843 30768 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.432260 26610 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:41.478514 26612 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:41.413532 30521 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.480273 30768 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.479940 30568 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.481127 30568 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.401072 30744 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:41.483490 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.398924 30693 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:41.427954 30710 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.389422 30617 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.487079 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.491775 26756 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:41.434213 30779 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:41.486300 30770 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.488044 30767 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.428865 30769 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:08:41.492242 30744 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.486583 30575 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.520357 30579 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.498884 30729 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.533896 30770 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.529032 30744 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.540728 30778 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:41.520905 30767 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.533494 30693 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.545037 30767 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.534420 30779 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.549713 30779 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:41.581327 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 220694us
W20260709 13:08:41.583079 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 250962us
I20260709 13:08:41.584616 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.586099 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.587652 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.596870 26608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:41.598286 26608 raft_consensus.cc:606] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:08:41.604278 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.613224 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.614748 26679 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:41.616580 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.617745 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.618943 26682 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:41.625269 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.626852 30768 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.535386 30640 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.498114 30507 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.630198 26754 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:41.634721 26753 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:41.635934 30499 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:41.636765 26756 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:41.639030 30762 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:41.638942 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1615) took 2911 ms (client timeout 2125 ms). Trace:
I20260709 13:08:41.626893 30710 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.640061 30767 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:41.640825 30454 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.642191 30575 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.642999 30769 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.644222 30599 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.644991 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2711) took 2865 ms. Trace:
I20260709 13:08:41.645361 30770 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.645674 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.642995 30768 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.669981 30770 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.671751 30767 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.672220 30767 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.673420 30767 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.647082 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2706) took 3169 ms (client timeout 1830 ms). Trace:
I20260709 13:08:41.651970 30744 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.653764 30226 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.668957 26606 rpcz_store.cc:276] 0709 13:08:38.779074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.611324 (+832250us) service_pool.cc:224] Handling call
0709 13:08:39.611620 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.624117 (+ 12497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.624160 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.624214 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.624264 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.644324 (+2020060us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400162e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:41.644399 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.644720 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28204288}
I20260709 13:08:41.680724 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.684202 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.685274 26753 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:41.654394 26759 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:41.654852 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.656832 26761 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:41.665333 26603 rpcz_store.cc:269] 0709 13:08:38.727658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.225744 (+498086us) service_pool.cc:224] Handling call
0709 13:08:41.638235 (+2412491us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002855d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:41.638643 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695383936}
I20260709 13:08:41.622265 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.636799 30579 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:41.667773 30710 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.692442 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 101115us
I20260709 13:08:41.694362 30710 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.691977 30579 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:41.677762 26611 rpcz_store.cc:269] 0709 13:08:38.477909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.517366 (+ 39457us) service_pool.cc:224] Handling call
0709 13:08:41.646709 (+3129343us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:41.646886 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586964736}
I20260709 13:08:41.672725 30768 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.697652 30115 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.698382 30115 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:41.699990 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75220.6us
I20260709 13:08:41.701227 30768 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:41.701880 30768 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:41.701531 30461 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.704531 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:41.705585 26606 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:41.668157 30769 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.715360 30770 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.715683 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.716106 30676 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:41.716495 30769 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.716873 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.717506 26754 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.718214 26757 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:41.718403 30115 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.719309 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.720093 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.720920 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.716523 26759 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:41.723209 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:41.723865 26759 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.723973 30767 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.741132 30461 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.741397 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.741807 30461 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.742770 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.744277 30461 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.744736 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.760581 30617 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.761857 30575 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.764851 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2732) took 1677 ms. Trace:
I20260709 13:08:41.765251 26607 rpcz_store.cc:276] 0709 13:08:40.087637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.116691 (+ 29054us) service_pool.cc:224] Handling call
0709 13:08:41.764459 (+1647768us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400249854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:41.764676 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394358656}
I20260709 13:08:41.766739 26759 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:41.768185 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.769766 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.770433 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.771451 30629 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.771960 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.772104 30629 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.774508 30629 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.775333 30629 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:41.775728 30629 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.776319 30629 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.748692 30768 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.776473 30526 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:41.768224 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.777223 30526 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.784448 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:41.785360 27316 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:41.786240 30461 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:41.786695 30461 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.787030 30461 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.755393 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.795189 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.795989 30676 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:41.796319 30575 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:41.796494 30568 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:41.797829 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.020s	sys 0.019s
W20260709 13:08:41.798265 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.020s	sys 0.019s
W20260709 13:08:41.798597 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.53098e+06us
I20260709 13:08:41.787802 30526 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.804687 26754 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:41.804988 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.797251 30676 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.822115 30668 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.804266 30575 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.828441 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:41.824623 30757 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:41.829547 30757 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.829862 30710 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.830492 30710 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:41.831907 30430 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.831611 30710 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.832578 30430 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.824875 26758 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:41.802467 30115 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:08:41.827742 30676 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:41.843489 27316 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:41.830920 30757 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.846215 30575 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.847612 30575 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.848507 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:41.854008 30575 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.850237 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:41.857193 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.856666 30459 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:41.862088 27318 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:41.862021 30768 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:41.862874 30768 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.863821 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:41.863247 30430 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.865430 30768 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:41.869191 30663 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.869858 30663 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:41.871167 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.865494 30772 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.517s	user 0.003s	sys 0.000s
W20260709 13:08:41.872658 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 117445us
I20260709 13:08:41.872937 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.873742 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.877303 26682 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:41.878777 30739 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:41.879384 30739 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.879774 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:41.880467 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.880934 30676 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.885902 30676 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.887023 26755 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:41.889662 30126 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.659s	user 0.014s	sys 0.002s
I20260709 13:08:41.890174 30126 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.892204 26681 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.895963 30663 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.900074 26683 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:41.901301 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:41.902098 26753 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:41.902630 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.903628 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.904093 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.904146 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.905416 30768 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:41.906102 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.906517 30768 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:41.906988 30768 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:41.907025 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.924908 26678 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:41.912308 30461 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.924245 30493 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:41.952925 30461 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:41.953142 30493 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:41.920151 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.902102 26679 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.910557 30430 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:41.910051 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.911916 30720 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.907562 30768 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:41.923190 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.938355 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:41.921492 30694 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.939528 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.912312 30629 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:41.940481 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.941241 30769 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:41.941380 30575 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:41.942026 30056 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:41.942502 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:41.932578 30126 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:41.927124 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:41.944447 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:41.944989 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:41.972575 30627 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:41.972748 30459 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:41.973373 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 108081us
I20260709 13:08:41.979174 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 489) took 2460 ms. Trace:
I20260709 13:08:41.998911 26687 raft_consensus.cc:2410] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:41.980186 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:41.980835 30663 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:41.981962 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81067.8us
I20260709 13:08:41.983271 27312 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:41.999930 26685 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:41.984591 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 71647.3us
I20260709 13:08:41.991555 26681 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:41.958875 30430 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:41.997414 26679 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:41.998658 27321 rpcz_store.cc:276] 0709 13:08:39.518854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.518989 (+   135us) service_pool.cc:224] Handling call
0709 13:08:39.519254 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.580954 (+ 61700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.581000 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.581061 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.581108 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.978679 (+2397571us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54008516d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:41.978764 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.978979 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141335936}
I20260709 13:08:42.004179 26686 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:42.008374 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:42.008569 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66236.1us
I20260709 13:08:42.016811 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.009702 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.017638 26609 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.010663 27317 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:42.011246 30629 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.012785 27315 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:41.998420 30459 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:42.013720 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.014350 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.007323 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:42.020218 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:42.020961 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.022464 27317 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:42.009135 30765 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:42.028394 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.029747 30663 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:42.030543 30663 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:42.031962 30507 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:42.032564 30507 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:42.032107 30663 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.033654 30507 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.037617 26610 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.039937 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:42.041157 26755 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:42.042376 30660 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:08:42.042763 30769 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:42.043301 30660 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:42.043450 30417 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:42.043744 30660 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:42.043818 30769 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:42.027465 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.045168 30668 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.044974 30660 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.045576 30668 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:42.046052 30668 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.046409 30660 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.044379 30769 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:42.048614 30769 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.050477 30769 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.054564 30668 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.004204 30056 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:42.055874 30764 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.766s	user 0.000s	sys 0.005s
I20260709 13:08:42.055938 30056 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:42.057140 30056 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.058318 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 529) took 2602 ms. Trace:
W20260709 13:08:42.058367 30771 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.711s	user 0.001s	sys 0.000s
W20260709 13:08:42.059052 30798 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 13:08:42.046419 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.060134 30430 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:42.060825 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53633us
I20260709 13:08:42.061654 30430 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.054586 30516 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:42.063931 30699 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.064054 30516 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:42.065033 30516 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.066005 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 531) took 2469 ms. Trace:
I20260709 13:08:42.061681 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:08:42.078269 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51987.4us
W20260709 13:08:42.066385 30795 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
I20260709 13:08:42.066442 27313 rpcz_store.cc:276] 0709 13:08:39.596288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.746707 (+150419us) service_pool.cc:224] Handling call
0709 13:08:40.887599 (+1140892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.898186 (+ 10587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.065553 (+1167367us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b26d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:42.065796 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602252032}
I20260709 13:08:42.022598 30575 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.003191 30720 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.100142 30575 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.101999 30720 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.102375 30575 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.079932 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.085354 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.086542 30741 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:42.058772 27314 rpcz_store.cc:276] 0709 13:08:39.455866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.456643 (+   777us) service_pool.cc:224] Handling call
0709 13:08:39.457003 (+   360us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:39.474434 (+ 17431us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:40.867324 (+1392890us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800460ae0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf 00007f40f32aa038
0709 13:08:40.981489 (+114165us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.144914 (+163425us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:41.148076 (+  3162us) log.cc:844] Serialized 52 byte log entry
0709 13:08:41.148229 (+   153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.148268 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.148351 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.007294 (+858943us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:42.057883 (+ 50589us) raft_consensus.cc:1685] finished
0709 13:08:42.057914 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.058116 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18876,"prepare.queue_time_us":219258,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":15973,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":30761,"spinlock_wait_cycles":42886272,"thread_start_us":277081,"threads_started":2,"wal-append.queue_time_us":224004}
I20260709 13:08:42.095093 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:42.067480 30765 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:42.104852 26609 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:42.066367 30516 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.108577 26755 raft_consensus.cc:2368] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11.
I20260709 13:08:42.072574 30668 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.026446 30710 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.117225 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:42.112790 30765 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.133229 26760 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:42.135710 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:42.139947 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54709.2us
I20260709 13:08:42.142349 26610 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:42.138907 30728 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:42.145231 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:42.145419 26758 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:42.151908 26576 leader_election.cc:400] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11.
I20260709 13:08:42.152411 26576 leader_election.cc:403] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.138806 30701 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:42.156680 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:42.158183 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 201615us
I20260709 13:08:42.159968 30306 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.160488 30306 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.160908 30306 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:42.169524 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.170380 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.176123 30526 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.176600 30526 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.176977 30526 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.181882 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.182341 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.182938 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.183763 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.184603 26608 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:42.185389 30720 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:42.186014 30720 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:42.188177 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55409.8us
W20260709 13:08:42.188948 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.189833 30668 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.156342 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:42.140060 30575 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.187026 30720 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.200492 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.207841 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:42.201951 30575 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.222968 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.215384 30426 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.224982 30530 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:42.234308 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:42.258033 26685 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.144649 30739 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.218448 30701 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:42.238826 30575 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.277562 26575 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:42.289309 26753 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.274477 30530 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:42.289501 26650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.960s (SENT) [suppressed 26 similar messages]
I20260709 13:08:42.300457 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.304206 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:42.304335 30667 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:42.307078 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 162725us
I20260709 13:08:42.306659 30667 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.312250 30729 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.312733 30667 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:42.313556 30802 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:08:42.315285 30800 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:08:42.317158 30801 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:08:42.327394 30668 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11.
I20260709 13:08:42.330574 30701 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.302304 30699 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.340178 30530 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.341161 30056 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.346206 30739 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:42.297132 30768 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.348515 30676 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.350113 30768 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.350917 26682 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:42.352276 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 151882us
W20260709 13:08:42.353685 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64220.7us
I20260709 13:08:42.351293 30769 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:42.368005 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:42.372093 30796 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.456s	user 0.006s	sys 0.000s
I20260709 13:08:42.384282 26753 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:42.397554 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.398111 30426 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:42.401680 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.401906 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.407503 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:42.407775 30794 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:08:42.408215 26681 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.410725 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.411619 30459 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.412343 30757 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:42.413038 26684 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:42.413722 26611 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:08:42.413650 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.416478 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.420473 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:42.420632 26683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1474) took 1476 ms (client timeout 1828 ms). Trace:
I20260709 13:08:42.421006 30737 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:42.448462 26683 rpcz_store.cc:269] 0709 13:08:40.943738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.943841 (+   103us) service_pool.cc:224] Handling call
0709 13:08:42.420439 (+1476598us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400013bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:42.420558 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237896448}
I20260709 13:08:42.450181 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:42.450977 26683 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.422377 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.452185 26606 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:42.453584 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.454382 26606 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:42.455960 30757 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.457237 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:42.424914 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 384402us
I20260709 13:08:42.458856 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.425688 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.462426 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.463089 26605 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:42.464048 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:42.433655 30797 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.501s	user 0.000s	sys 0.003s
I20260709 13:08:42.434239 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.438247 27315 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:42.469204 26604 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:42.411302 26680 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:42.402130 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.470544 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:42.447188 26684 pending_rounds.cc:85] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 5
I20260709 13:08:42.471514 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.442083 26612 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:42.458510 30710 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.446126 26681 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:42.455484 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.474356 26606 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:42.475436 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.475811 30768 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:42.476039 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.476521 30737 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.477972 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.478693 26609 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:42.479818 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.479900 27318 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:42.476182 26604 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:42.480844 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.481081 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.481612 26604 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:42.481926 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.482376 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.482671 26609 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:42.482188 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:42.478791 26607 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.495623 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:42.496593 27317 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:42.496795 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:42.497464 26686 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:42.499282 26686 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.499975 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:42.462451 30575 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.500640 30763 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:42.471858 26684 pending_rounds.cc:107] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:42.504230 26684 raft_consensus.cc:2889] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.448283 30739 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:42.505072 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.510527 26680 raft_consensus.cc:2368] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11.
I20260709 13:08:42.513944 26608 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.476254 30768 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.517043 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:42.529029 27318 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:42.491933 30417 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:42.537797 26610 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:42.535679 26603 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.538659 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.539788 26609 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.533517 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.510012 30306 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.543537 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.544131 30559 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.544683 30559 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.546173 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.547093 26755 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:42.549836 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.557081 26686 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:42.548030 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.560424 26683 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:42.528149 30768 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.564461 26606 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.488317 30526 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.521785 30710 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:42.557688 26686 pending_rounds.cc:85] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 6
I20260709 13:08:42.580112 26686 pending_rounds.cc:107] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:42.580476 26686 raft_consensus.cc:2889] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:42.578663 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.582621 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.584515 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:42.585269 27319 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:42.593814 26680 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:42.595082 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:42.596969 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.540565 30739 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:42.601466 30559 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:42.562218 30430 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.602037 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:42.602522 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.541438 30417 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:42.603533 26761 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:42.616103 26681 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.624771 26683 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:42.572189 30763 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:42.581267 30629 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:42.626086 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 138457us
I20260709 13:08:42.626690 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.627992 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:42.644148 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 100699us
I20260709 13:08:42.629041 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.625867 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.644740 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.645591 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.648175 30486 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:42.648916 30486 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:42.648257 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.661445 26604 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:42.624255 30417 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.633116 30729 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:42.666700 26611 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:42.664211 26610 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7. Re-sending same reply.
I20260709 13:08:42.668972 30728 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.674927 26606 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:42.676205 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.611584 30710 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.680255 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.650091 30486 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.683380 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.632954 30430 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.684451 26687 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.688704 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:42.633833 30056 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:42.664160 30769 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.610452 30765 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:42.678925 27318 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:08:42.694921 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65979.8us
W20260709 13:08:42.701838 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50114.7us
I20260709 13:08:42.699977 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.698604 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512480111cea40cebe7a32ae9439af70"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:42.670233 30306 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:42.703557 26610 raft_consensus.cc:606] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.706223 26761 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.702989 26611 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:42.702639 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:42.638739 30667 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.675810 30729 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:42.709740 26606 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:42.674160 30493 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:42.718912 26612 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:42.694216 30757 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.674654 30763 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.734831 26609 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:42.735461 30629 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.743036 26605 raft_consensus.cc:2368] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
W20260709 13:08:42.744104 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69639.3us
I20260709 13:08:42.745911 30683 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:08:42.749177 30516 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:42.749593 30516 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:42.750417 30516 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:42.753252 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50664.7us
I20260709 13:08:42.687991 30728 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.773034 30676 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.773762 26603 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:42.736892 30737 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:42.776242 30729 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.777355 30710 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.760224 30694 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.757283 30575 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.779465 30526 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:42.751562 30516 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.795023 26606 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:42.786537 26610 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:08:42.801184 26610 pending_rounds.cc:85] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 5
I20260709 13:08:42.801416 26610 pending_rounds.cc:107] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:08:42.801637 26610 raft_consensus.cc:2889] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.803733 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:42.808888 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:42.795717 26685 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.004s
I20260709 13:08:42.811214 26685 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:42.806627 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:42.821251 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 198529us
I20260709 13:08:42.827346 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:42.828441 30306 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.828675 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:42.802723 30757 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.836658 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.839193 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:42.842176 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.839624 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:42.742372 30739 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.848546 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.820804 30575 raft_consensus.cc:2764] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:08:42.829051 30559 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.828876 30306 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:42.840610 30710 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:42.862445 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.871172 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 102451us
I20260709 13:08:42.849417 30765 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:42.859555 30611 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:42.864348 30306 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.894342 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.864648 30710 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:42.841980 30757 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.899715 26760 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:42.900105 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:42.869951 30526 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.908390 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79855.5us
I20260709 13:08:42.909761 26757 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:08:42.910310 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 107859us
I20260709 13:08:42.910871 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.911222 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:42.911811 30502 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.911876 30676 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.916224 26758 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:42.864068 30768 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:42.925221 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:42.926609 26757 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.881455 30575 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:42.904292 30710 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.921411 30676 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.937738 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:43.045533 27315 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:43.051348 26607 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 13:08:42.927181 30667 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.052280 26607 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
W20260709 13:08:43.053614 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 142483us
W20260709 13:08:43.059609 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 159598us
I20260709 13:08:42.924242 30729 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:08:43.049831 30676 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.063568 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.050907 30683 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.066676 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 151367us
I20260709 13:08:42.928762 30526 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.062000 30611 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.093357 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.086776 26650 leader_election.cc:400] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
W20260709 13:08:43.087474 30817 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:08:43.088291 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 418) took 3542 ms. Trace:
I20260709 13:08:43.056883 30056 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.063982 30763 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.110194 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.112190 26757 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:43.100091 27320 rpcz_store.cc:276] 0709 13:08:39.521624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.521815 (+   191us) service_pool.cc:224] Handling call
0709 13:08:39.522164 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.522578 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:39.689062 (+166484us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.819286 (+130224us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.829710 (+ 10424us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.829885 (+   175us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:39.830164 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.830386 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.830479 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.490078 (+1659599us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b180042ffa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:41.718781 (+228703us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b180042ffa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1
0709 13:08:41.719375 (+   594us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b180042ffa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:42.286065 (+566690us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b180042ffa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1
0709 13:08:42.909793 (+623728us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b180042ffa0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:43.053674 (+143881us) raft_consensus.cc:1685] finished
0709 13:08:43.053703 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.063598 (+  9895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34809,"prepare.queue_time_us":166518,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":11498,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":27687,"spinlock_wait_cycles":182001664,"thread_start_us":243446,"threads_started":2,"wal-append.queue_time_us":132369}
I20260709 13:08:43.132438 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:43.136219 30819 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:08:43.133988 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:43.118314 30838 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:43.119526 30575 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:43.149118 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74775.7us
I20260709 13:08:43.084450 30683 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.160624 26577 leader_election.cc:400] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11.
I20260709 13:08:43.145816 30763 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.101131 30611 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.120700 30056 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.168947 30833 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.138872 30834 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.172433 26604 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:43.149679 30728 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.173926 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:43.174340 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.179942 30683 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.181447 30834 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.176122 30836 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:43.186002 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.186740 26757 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:43.157542 30840 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.204439 26607 raft_consensus.cc:606] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.204908 26607 raft_consensus.cc:614] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.205498 27315 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:43.168082 30837 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.211027 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.166026 30667 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:43.191244 30826 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.197624 30838 raft_consensus.cc:2764] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:43.221771 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:43.211702 30837 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.214576 30768 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.241300 30710 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.242717 30526 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:43.246869 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80576.6us
I20260709 13:08:43.223882 30834 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.250869 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.225044 30826 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.189195 30833 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.256359 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.207991 30840 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.237006 30714 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:43.237259 30837 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.263198 30768 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:43.263943 30768 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:43.266165 30417 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:08:43.267243 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.272215 30847 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:43.277040 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.270574 30417 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.279111 26761 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:43.279585 30417 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.280086 30126 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:43.277882 30848 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:43.284250 26682 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:43.285012 30763 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:43.285300 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.285650 30575 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:43.288781 30836 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:43.290383 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.293049 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.296862 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.297734 26686 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:43.299374 30838 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:43.299604 27320 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:43.302177 30056 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.304589 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.309881 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.266333 30768 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.312873 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.314653 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.314985 30516 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:43.315253 27320 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:43.316975 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:43.322685 30502 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.323195 30502 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.325579 30502 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:43.326069 30056 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.326496 30056 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.326826 30056 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.326855 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.330138 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.332049 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.333369 30691 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:43.331382 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.334681 26754 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:08:43.333866 30691 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:43.339272 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81260.4us
I20260709 13:08:43.337626 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:43.337852 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 70684.3us
I20260709 13:08:43.319192 30516 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.351007 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.339952 30502 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.322244 30710 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:43.354259 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.354379 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.355077 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.356652 26684 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.358415 26685 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:43.362047 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:43.369647 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.359176 30182 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.322011 30676 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.373977 26678 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:43.380553 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.381444 30837 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.383747 30837 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.356873 30768 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:43.374863 30182 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.388474 30833 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.353506 30854 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:43.390669 30769 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:43.391175 30769 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:43.392148 30769 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.359760 30502 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.395265 30502 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.396682 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.397331 27320 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:43.388851 30182 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.400060 30826 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.355408 30516 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.403347 30516 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.407024 30840 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.408939 30306 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.410264 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.410951 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.411563 30676 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.414816 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.410264 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.387085 30691 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.420464 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.421252 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.421764 30493 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.428414 26686 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:43.430428 26759 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:43.394994 30056 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.432883 26678 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:43.435173 27320 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 6.
W20260709 13:08:43.437690 26558 auto_rebalancer.cc:893] Removing replace marker failed: Replica e09ea9b455894a0189912a7b9b6b2f84 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:43.429875 30668 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.441546 26558 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:08:43.441531 26756 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:43.445657 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.445626 26558 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:43.450987 30306 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.452530 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.453696 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:43.454221 27320 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.436081 30853 raft_consensus.cc:2764] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:43.457453 30182 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.459758 30056 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.465287 30668 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.441141 30516 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.461488 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.468137 30516 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.468358 26760 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.468678 30516 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.469698 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1664) took 1044 ms. Trace:
I20260709 13:08:43.470075 26603 rpcz_store.cc:276] 0709 13:08:42.425357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.563823 (+138466us) service_pool.cc:224] Handling call
0709 13:08:43.469540 (+905717us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54003796d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:43.469642 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373123840}
I20260709 13:08:43.461615 30836 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.472463 30836 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:43.441736 30855 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:08:43.479199 27315 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:43.479351 27320 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:43.480630 27318 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:43.480691 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:43.460000 30182 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.483052 26678 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:43.484998 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:43.485019 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:43.488574 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.489410 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 137430us
I20260709 13:08:43.492985 26684 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:43.497030 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1668) took 1070 ms. Trace:
I20260709 13:08:43.497409 26605 rpcz_store.cc:276] 0709 13:08:42.426405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.463772 (+ 37367us) service_pool.cc:224] Handling call
0709 13:08:43.496867 (+1033095us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540035f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:43.496979 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629554944}
I20260709 13:08:43.504405 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.492198 30493 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:43.504176 30694 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.507609 30507 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:43.508630 30765 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:43.535233 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.536087 26758 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:43.544060 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.545109 26760 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:08:43.545238 26684 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:43.547462 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.547864 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:43.548175 26610 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:43.548612 26609 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:43.549875 26604 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:43.550223 26604 pending_rounds.cc:85] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 6
I20260709 13:08:43.550417 26604 pending_rounds.cc:107] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:43.550627 26604 raft_consensus.cc:2889] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.552357 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.553337 26603 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:43.555977 26608 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:43.556085 30629 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:43.556207 30430 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.556548 30629 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.535262 30502 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:43.535784 30668 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.554612 30459 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.567397 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.549302 30493 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.534869 30126 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:43.573176 26603 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:43.558990 30182 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.572280 30765 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:43.584935 30696 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:43.585299 30757 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.585111 30765 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.585582 30696 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.586231 30685 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:43.586802 30685 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.588784 30696 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.592338 30836 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.575131 30568 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:43.581611 30486 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.593353 30568 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.572654 30502 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:43.596856 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.597043 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.589239 30685 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.576758 30493 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.580821 30182 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:43.591045 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.591698 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:43.591912 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.562898 30769 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:43.608134 26605 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.618512 30182 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.626188 30611 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:43.635048 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 68659.2us
I20260709 13:08:43.606177 30568 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:43.739470 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 166248us
I20260709 13:08:43.617077 30769 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:43.597774 30502 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.752560 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.753911 26605 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:43.758841 30568 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:43.763029 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.763325 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.764102 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:43.763021 30568 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.766382 30769 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:43.767236 30714 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.767479 30568 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.763763 26684 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:43.767767 30714 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.770480 30714 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:43.774768 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.775372 26603 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:43.775952 30836 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.776104 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:43.776520 30836 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.763083 30663 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.777936 30663 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.778751 30836 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.780175 30663 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:43.780545 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.783859 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.784247 30426 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:43.784720 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:43.786196 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.787374 26758 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:43.789875 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.790766 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:43.791402 26604 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.797465 30493 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:43.798424 26680 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:43.799685 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47163.4us
I20260709 13:08:43.800493 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.806742 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:43.808743 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.809540 26758 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:43.809916 26604 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:08:43.810422 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.813524 26604 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:43.817740 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:43.818691 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44844.7us
I20260709 13:08:43.821897 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.826869 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.832443 30417 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.832894 30417 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.833237 30417 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.836189 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.836340 30640 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:43.837105 26608 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:43.820603 30663 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:43.845321 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.817806 30768 raft_consensus.cc:2764] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:43.838347 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:43.846690 30459 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:43.847155 30459 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.839144 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.847590 30459 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.814641 30530 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:43.839710 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.842832 26611 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:43.841706 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.845431 30663 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:43.839838 30720 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:43.844002 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:43.847636 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:43.847892 26680 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:43.860140 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 427) took 1372 ms. Trace:
I20260709 13:08:43.860612 26612 rpcz_store.cc:276] 0709 13:08:42.488153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.719565 (+231412us) service_pool.cc:224] Handling call
0709 13:08:42.756126 (+ 36561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.778301 (+ 22175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.778331 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:42.778768 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.868279 (+ 89511us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:42.887328 (+ 19049us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.894083 (+  6755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.272510 (+378427us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b54002850d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:43.272561 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.463636 (+191075us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18002be6a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:43.781538 (+317902us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b18002be6a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1
0709 13:08:43.782413 (+   875us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18002be6a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:43.859881 (+ 77468us) raft_consensus.cc:1685] finished
0709 13:08:43.859909 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.860072 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6497,"prepare.queue_time_us":18853,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":11405,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":15467,"spinlock_wait_cycles":40816896,"thread_start_us":89151,"threads_started":1,"wal-append.queue_time_us":116673}
I20260709 13:08:43.848482 30866 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:08:43.863526 30617 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:43.854687 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:43.850397 26603 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:43.849810 30714 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:43.866135 26603 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:43.850996 26609 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:43.852130 26606 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:43.851495 26608 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:43.864400 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.879407 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.880193 26678 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:43.891127 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:43.892429 26685 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.882627 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.864027 30617 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:43.849074 30864 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:08:43.904615 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.848570 30530 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:43.881882 30493 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:43.852525 30720 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:43.895597 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.913300 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:43.849208 30559 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:08:43.928002 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.929669 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.906375 30866 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:43.930595 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.936885 26679 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
W20260709 13:08:43.933193 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69060.9us
I20260709 13:08:43.938470 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:43.954788 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:43.917102 30720 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:43.920126 30768 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:43.959990 26679 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:43.934490 30306 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.852654 30663 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.955153 30838 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.972606 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.955533 30660 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:43.967548 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.976663 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:43.954097 26685 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:43.907202 30617 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:43.979008 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:43.964110 30306 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.944449 30866 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.031518 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:44.047943 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69001.1us
I20260709 13:08:44.049316 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:44.046069 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57085.7us
I20260709 13:08:44.048820 30834 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.048609 30728 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:44.053766 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:44.053747 30728 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.054659 30568 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.055415 30611 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.057070 26679 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:44.057415 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:44.059230 30837 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.060896 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:44.062757 30837 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:44.063138 30837 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.063452 30837 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.070911 26608 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:43.975564 30838 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:43.980114 30486 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.979846 30769 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:43.986596 30768 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:44.045703 30306 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.073432 30617 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.926441 26498 maintenance_manager.cc:643] P d386a230fc3e442b8633387e891e63d1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.349s	user 0.144s	sys 0.088s Metrics: {"bytes_written":29710,"cfile_init":1,"dirs.queue_time_us":263835,"dirs.run_cpu_time_us":439,"dirs.run_wall_time_us":16047,"drs_written":1,"lbm_read_time_us":414,"lbm_reads_lt_1ms":4,"lbm_write_time_us":129127,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":63,"thread_start_us":182258,"threads_started":2,"wal-append.queue_time_us":151527}
I20260709 13:08:44.073750 30056 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:44.103031 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54913.8us
I20260709 13:08:44.079155 30838 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.108142 26606 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:44.080437 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:43.964360 30516 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.089082 26608 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:44.090313 26607 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:44.113277 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:44.084491 30461 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:44.091367 30526 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:44.093048 30827 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:44.093699 30714 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:44.094436 30848 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:44.096933 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124400us
I20260709 13:08:44.129806 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:44.130824 26680 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:44.131902 30430 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:44.132412 30430 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:44.132843 30430 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.118199 30526 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:44.049505 30660 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.138960 30660 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.097609 30768 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:44.139736 30768 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.144771 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:44.126451 30461 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.152871 30584 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:44.153294 30584 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:44.153679 30584 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.154304 30461 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:44.087052 30493 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:44.114308 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 188448us
I20260709 13:08:44.121558 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:44.050216 30530 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.157037 26612 raft_consensus.cc:606] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:44.157508 26612 raft_consensus.cc:614] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:44.157646 30493 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.159561 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:44.162534 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:44.162879 30871 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:08:44.095985 30741 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:44.156706 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:44.178229 26752 raft_consensus.cc:2368] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:44.180939 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:44.126922 30836 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:44.192382 26499 maintenance_manager.cc:419] P d386a230fc3e442b8633387e891e63d1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7792 bytes on disk
I20260709 13:08:44.174809 30701 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:44.195950 30701 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:44.098696 30720 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.181670 30714 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:44.119352 30056 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:44.177620 30660 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:08:44.185880 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56235.8us
I20260709 13:08:44.231336 27315 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:44.185349 30853 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:44.222566 30629 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 13:08:44.236156 30676 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.180354 30837 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.279153 30676 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.280774 30837 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.281138 30676 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.286204 30866 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:44.289682 30459 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.220976 30836 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:44.237478 30701 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.292582 30836 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.293267 30701 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.186466 30430 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.297848 30430 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.181416 30768 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.225208 30714 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.300019 30714 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.301229 30768 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.303807 30629 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.305198 26683 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:44.306440 30629 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.309613 30584 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.312433 30584 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.315312 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:44.320652 30516 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.322613 26682 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:44.330260 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 237566us
I20260709 13:08:44.331223 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:44.224406 30056 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.242007 30696 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:08:44.339457 30617 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:44.356387 30765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.034s
W20260709 13:08:44.358752 30765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.013s	sys 0.034s
I20260709 13:08:44.332439 30417 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.344007 30685 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:44.355801 30696 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:44.340350 30056 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.370563 30459 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:44.389662 30696 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.412108 30417 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.411504 30696 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.457186 30838 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.439139 30714 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.462409 30838 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.465233 30306 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.468698 30056 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.463387 30714 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.472078 30056 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.467504 30306 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.557629 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 507) took 1081 ms. Trace:
I20260709 13:08:44.557967 27318 rpcz_store.cc:276] 0709 13:08:43.475875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.475998 (+   123us) service_pool.cc:224] Handling call
0709 13:08:43.480381 (+  4383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.481952 (+  1571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.557408 (+1075456us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b54001b26d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:44.557560 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4519296}
I20260709 13:08:44.590523 30526 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.592242 30526 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.622812 30126 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:44.623345 30126 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:44.624357 30126 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.625546 30126 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.672114 30826 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:44.672696 30826 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.674582 30826 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.716590 26604 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:44.718598 26686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.006s	sys 0.010s
W20260709 13:08:44.719003 26686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.006s	sys 0.010s
W20260709 13:08:44.734292 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.028s	sys 0.067s
W20260709 13:08:44.734700 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.028s	sys 0.067s
W20260709 13:08:44.734961 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 571198us
W20260709 13:08:44.754828 26605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.012s	sys 0.029s
W20260709 13:08:44.755235 26605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.012s	sys 0.029s
I20260709 13:08:44.888444 30765 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.888986 30765 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.891079 30765 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:44.893689 30685 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.894194 30685 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:44.896973 30685 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.899405 30765 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.899955 30765 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.904022 30765 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:44.914505 26678 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:44.922174 30694 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:44.925587 30694 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:44.932446 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:44.932551 30694 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.934175 30694 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.938472 26508 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 8, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:44.940191 26508 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:44.941903 26508 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 3 to 8, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.943451 26508 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.951319 30720 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.998224 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 438) took 1210 ms. Trace:
I20260709 13:08:44.998667 26609 rpcz_store.cc:276] 0709 13:08:43.787707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.789994 (+  2287us) service_pool.cc:224] Handling call
0709 13:08:43.790300 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.868220 (+ 77920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.997963 (+1129743us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b5400285ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:44.998162 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138908928}
I20260709 13:08:45.000998 30663 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.001581 30663 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:44.977602 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2865) took 1353 ms. Trace:
I20260709 13:08:45.004025 26683 rpcz_store.cc:276] 0709 13:08:43.624199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.624317 (+   118us) service_pool.cc:224] Handling call
0709 13:08:43.627971 (+  3654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.305559 (+677588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.977324 (+671765us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54001da954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:44.977501 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519581568}
I20260709 13:08:45.011034 30663 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:45.024966 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.005s	sys 0.007s
W20260709 13:08:45.025784 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.006s	sys 0.008s
W20260709 13:08:45.026664 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 869981us
I20260709 13:08:45.028116 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.028891 30640 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.030771 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.031675 30640 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.032482 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.033968 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.035312 30685 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:45.035713 30685 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.036057 30685 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.038982 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.039533 26498 maintenance_manager.cc:643] P d386a230fc3e442b8633387e891e63d1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.842s	user 0.003s	sys 0.002s Metrics: {"cfile_init":1,"lbm_read_time_us":471,"lbm_reads_lt_1ms":4}
I20260709 13:08:45.040697 30640 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:45.041280 30629 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.076296 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1526) took 1216 ms. Trace:
I20260709 13:08:45.076768 26681 rpcz_store.cc:276] 0709 13:08:43.859730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.864937 (+  5207us) service_pool.cc:224] Handling call
0709 13:08:43.881409 (+ 16472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.896753 (+ 15344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.896797 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.911130 (+ 14333us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.000434 (+1089304us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:45.000472 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.000540 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.074367 (+ 73827us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b18004848a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:45.075982 (+  1615us) raft_consensus.cc:1685] finished
0709 13:08:45.076004 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.076234 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6662,"raft.queue_time_us":15479,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7900,"spinlock_wait_cycles":1460305152,"thread_start_us":304482,"threads_started":1,"wal-append.queue_time_us":444103}
I20260709 13:08:45.075359 30696 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.085770 30629 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.086088 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1676) took 1303 ms. Trace:
I20260709 13:08:45.086639 26752 rpcz_store.cc:276] 0709 13:08:43.782990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.783610 (+   620us) service_pool.cc:224] Handling call
0709 13:08:45.085823 (+1302213us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:45.085995 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900724992}
W20260709 13:08:45.088233 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 749775us
W20260709 13:08:45.052937 26687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.009s	sys 0.005s
W20260709 13:08:45.089344 26687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.010s	sys 0.006s
I20260709 13:08:45.090301 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1524) took 1231 ms. Trace:
I20260709 13:08:45.054162 30578 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.092658 30578 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:45.054189 27316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.006s	sys 0.011s
W20260709 13:08:45.095109 27316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.006s	sys 0.011s
I20260709 13:08:45.066144 30728 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.096386 30834 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.096927 30834 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.097777 26508 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 6, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:45.068555 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:45.096944 26510 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 217) took 40122 ms (client timeout 15000 ms). Trace:
I20260709 13:08:45.104957 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.105643 26681 raft_consensus.cc:2368] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11.
I20260709 13:08:45.099224 26508 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:45.104323 26510 rpcz_store.cc:269] 0709 13:08:04.974558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.974755 (+   197us) service_pool.cc:224] Handling call
0709 13:08:45.096751 (+40121996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:34.706248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:34.760349 (+ 54101us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:34.760423 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:08:34.760443 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:34.761694 (+  1251us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:34.761770 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:34.761804 (+    34us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:08:34.762955 (+  1151us) tablet.cc:701] Row locks acquired
0709 13:08:34.763015 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:08:34.763203 (+   188us) write_op.cc:270] Start()
0709 13:08:34.763346 (+   143us) write_op.cc:276] Timestamp: P: 1783602514763135 usec, L: 0
0709 13:08:34.763368 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:34.900857 (+137489us) log.cc:844] Serialized 4495 byte log entry
0709 13:08:35.230524 (+329667us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:08:36.490207 (+1259683us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.015991 (+525784us) write_op.cc:301] APPLY: starting
0709 13:08:37.016107 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:37.016456 (+   349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:37.016505 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:37.429519 (+413014us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:37.505939 (+ 76420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:08:37.517525 (+ 11586us) write_op.cc:312] APPLY: finished
0709 13:08:37.559955 (+ 42430us) log.cc:844] Serialized 83 byte log entry
0709 13:08:37.755477 (+195522us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.771450 (+ 15973us) write_op.cc:454] Released schema lock
0709 13:08:37.785591 (+ 14141us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.793688 (+  8097us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.793720 (+    32us) write_op.cc:454] Released schema lock
0709 13:08:37.997621 (+203901us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328d32a 00007f40f3212f14 00007f40f3212ec3 00007f40f3212e38 00007f40f3212df3 00007f40f32120dc 00007f40f323be16 00007f40f3223cbb 00007f40f320e39d 00007f40f3211d75
Metrics: {"mutex_wait_us":890429,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":525424,"apply.run_cpu_time_us":21891,"apply.run_wall_time_us":777696,"num_ops":11,"prepare.queue_time_us":222688,"prepare.run_cpu_time_us":56717,"prepare.run_wall_time_us":740284,"raft.queue_time_us":515785,"raft.run_cpu_time_us":22062,"raft.run_wall_time_us":1536936,"replication_time_us":1718402,"spinlock_wait_cycles":13978240,"thread_start_us":1151842,"threads_started":5,"wal-append.queue_time_us":884751,"wal-append.run_cpu_time_us":98685,"wal-append.run_wall_time_us":2954814}]]}
I20260709 13:08:45.090642 26687 rpcz_store.cc:276] 0709 13:08:43.859075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.875715 (+ 16640us) service_pool.cc:224] Handling call
0709 13:08:43.876107 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.876515 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.876568 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.877081 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.237131 (+360050us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:45.089719 (+852588us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.089984 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.090067 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.090110 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:45.090124 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.090248 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12923,"prepare.queue_time_us":196499,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":898,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15186,"thread_start_us":1119177,"threads_started":2,"wal-append.queue_time_us":451074}
I20260709 13:08:45.115026 26508 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 7 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:45.116549 26508 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.045135 30685 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.102559 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.117885 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2771) took 1293 ms. Trace:
W20260709 13:08:45.121395 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52930us
I20260709 13:08:45.126266 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.075832 30720 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.123782 26604 rpcz_store.cc:276] 0709 13:08:43.824378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.871223 (+ 46845us) service_pool.cc:224] Handling call
0709 13:08:43.871541 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.716981 (+845440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.117616 (+400635us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400324954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:45.117825 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943008640}
I20260709 13:08:45.283090 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.285763 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.289353 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.290230 26685 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:45.298357 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:45.299306 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:45.299993 26681 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.303045 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:45.312342 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 212836us
I20260709 13:08:45.304668 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.303761 26687 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:45.312076 30578 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.120193 30660 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.318073 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.337302 26680 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:45.113328 30728 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 13:08:45.319383 26508 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.129669 30430 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.281483 30836 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.352813 30836 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.353480 30056 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:45.354043 30056 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.354463 30056 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.356142 26508 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 8, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:08:45.340961 27316 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:08:45.341992 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 307054us
I20260709 13:08:45.359097 26508 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.357064 30728 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:45.316618 30640 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.384750 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:45.395200 26681 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:45.337606 30629 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:45.339272 30578 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:45.398103 26508 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 7, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.292369 30720 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.383545 30768 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.383834 30728 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:45.342195 30660 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.477670 26508 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 8, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:45.397790 30417 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.398371 30640 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.522475 26508 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:45.504951 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 311664us
I20260709 13:08:45.421773 30126 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:08:45.417697 30578 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.550020 26508 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 7, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:45.558951 30430 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.574193 30769 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.574790 30769 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.484958 30768 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:45.572486 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 212212us
I20260709 13:08:45.538940 30056 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.572789 27286 leader_election.cc:400] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11.
I20260709 13:08:45.579211 27286 leader_election.cc:403] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.579370 30056 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.579952 30056 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.586409 30056 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.598170 26682 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.595721 30056 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:45.600533 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 474341us
I20260709 13:08:45.408987 30629 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.601501 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.598359 26508 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 6, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:45.605400 30640 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.605809 30834 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.608121 30578 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:45.593046 30417 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:45.609833 30417 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:45.612169 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 307593us
I20260709 13:08:45.485728 30720 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.617133 26682 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:45.594198 30837 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.621098 30769 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:45.622313 30826 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.622617 30909 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:45.580184 30900 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:45.618434 26508 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 2 to 5, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.637053 30617 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:45.638190 30617 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.617733 30870 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.650568 26508 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.624925 30640 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:45.651273 30629 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.652619 26508 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.654629 30417 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.654981 30910 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:45.655793 30768 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.656086 30660 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.640225 30826 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.656819 26508 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 7, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 7 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.658584 30826 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.662421 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.668382 26678 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.668864 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.669476 26681 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
W20260709 13:08:45.663546 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62107.6us
I20260709 13:08:45.663849 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:45.670630 26687 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.664531 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.669175 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.672070 26683 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.665155 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.673552 26685 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.674274 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.629066 30837 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.669271 26508 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 9, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.721792 26508 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 8, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.723397 26508 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 1 to 5, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 5 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.725312 30837 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.725425 30826 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:45.726061 30826 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.728310 30826 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:45.729197 30584 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:45.729467 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55249.5us
I20260709 13:08:45.729858 30584 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.730436 30584 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.730571 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.732199 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.733053 30640 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:45.733520 30640 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:45.738972 26687 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:45.734390 30640 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:45.742092 30768 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:45.742565 30768 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.742651 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.743017 30768 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.744104 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.745000 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.745499 30578 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:45.746006 30826 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:45.746568 30826 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.746825 30837 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:45.746973 30826 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.747249 30837 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.747650 30837 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.748350 30660 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:45.748865 30660 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:45.749693 30660 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:45.692226 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08002daea0 after lost signal to thread 25510
I20260709 13:08:45.752254 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:45.752651 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08002de1a0 after lost signal to thread 26544
W20260709 13:08:45.754062 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2ee0 after lost signal to thread 26636
W20260709 13:08:45.755362 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800344f00 after lost signal to thread 26711
I20260709 13:08:45.746074 30578 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.833073 26681 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:45.834437 30578 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:45.836270 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08003cfe00 after lost signal to thread 26785
W20260709 13:08:45.836694 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800316900 after lost signal to thread 26786
I20260709 13:08:45.714351 26679 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.754925 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.785686 30417 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:45.838307 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83429.9us
I20260709 13:08:45.807436 30584 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.809682 30826 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.839958 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.840757 30826 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.841053 30584 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:45.811856 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59692.1us
I20260709 13:08:45.842569 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:45.843926 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.844501 26650 leader_election.cc:400] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9.
I20260709 13:08:45.844765 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.845072 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:45.845835 26685 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.846283 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.846868 26679 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:45.847538 30417 raft_consensus.cc:2764] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:45.848389 30417 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:45.824273 30908 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.825021 30629 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:45.850296 27318 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:45.850682 30629 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:45.826745 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:45.852322 26687 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.850340 30908 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.854446 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.854753 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.855005 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.855046 26603 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:45.855762 26604 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:45.856233 26604 pending_rounds.cc:85] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 7
I20260709 13:08:45.856501 26604 pending_rounds.cc:107] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:45.856863 30908 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.857203 26606 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:45.857321 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.858069 26603 raft_consensus.cc:2368] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:45.858000 30629 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:45.856767 26604 raft_consensus.cc:2889] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.841370 30826 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:45.863889 30826 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:45.865084 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:45.865888 27320 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:45.865394 30826 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.810976 30837 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.855363 26681 raft_consensus.cc:2410] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:45.863040 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:45.868667 27318 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.869441 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:45.869845 30837 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:45.838815 30578 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:45.871162 30578 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.873523 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.874740 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.875439 26604 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.876029 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.877522 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:45.878417 26687 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:45.878762 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:45.879773 30578 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.904688 30870 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11.
I20260709 13:08:45.905613 27319 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:45.905714 30056 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:45.906183 30056 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:45.906523 30056 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.907513 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:45.909992 30768 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.913890 26685 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:45.918864 30056 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.962111 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:45.919906 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.920189 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.920459 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.921005 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.921100 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.964402 26605 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.921643 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.965286 26612 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.965629 26603 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.921887 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.922246 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.967432 26607 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:45.922699 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.968194 26610 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.924937 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:45.925268 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:45.933957 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.972648 30837 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:45.972532 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.973321 30837 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:45.974135 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.963759 26609 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:45.974187 30837 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:45.975726 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.976378 26609 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:45.976297 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:45.977598 26607 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:45.977465 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.987742 27320 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:46.006373 30056 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.008036 26604 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:46.009569 26604 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:45.941228 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800389e80 after lost signal to thread 27345
W20260709 13:08:46.010833 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800379b40 after lost signal to thread 27346
W20260709 13:08:46.011186 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800216040 after lost signal to thread 30306
W20260709 13:08:46.011590 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4320 after lost signal to thread 30459
W20260709 13:08:46.012151 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1e20 after lost signal to thread 30701
W20260709 13:08:46.012486 27342 debug-util.cc:398] Leaking SignalData structure 0x7b08003d73c0 after lost signal to thread 30714
I20260709 13:08:45.934808 27318 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:46.014637 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:46.020766 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72043us
I20260709 13:08:46.023276 30912 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.024101 30912 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.028878 30912 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.029539 30912 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.030121 30912 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.033003 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.034067 26607 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:46.041272 26604 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:46.044072 30660 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.044801 30660 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.047842 30660 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.040323 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:46.052183 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.052635 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.062268 26605 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:46.062381 26612 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:46.063767 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.064059 26610 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:46.064751 26605 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:46.053150 26609 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:46.066069 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:45.994468 30584 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:46.068172 26607 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:46.069581 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:46.071324 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49658us
I20260709 13:08:46.075383 30927 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:46.065711 30908 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:46.106060 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.066134 30640 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.067268 30417 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:46.071990 30826 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.040207 30629 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:08:46.080955 30908 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:46.116233 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50192us
I20260709 13:08:46.118091 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.107074 30903 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.097657 30912 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.120493 30768 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.080329 30584 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.115492 30417 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:46.124289 30921 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
I20260709 13:08:46.118019 30826 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:46.118899 30908 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:46.125944 30430 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:46.134559 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:46.137297 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63460.8us
I20260709 13:08:46.143615 30417 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.151037 26603 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:46.157450 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.140776 30430 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:46.213400 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56284.7us
I20260709 13:08:46.156167 30629 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:46.225412 30911 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.563s	user 0.012s	sys 0.003s
W20260709 13:08:46.271880 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 137397us
I20260709 13:08:46.272784 26650 leader_election.cc:400] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:46.273088 26650 leader_election.cc:403] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.274719 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.190176 30430 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.279683 30056 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:46.300166 30056 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.301432 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.301756 26684 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.302137 30056 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.281000 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.302922 26603 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:46.282351 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.303277 30930 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:46.303719 26609 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.288755 30826 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.289088 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.277872 30768 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:08:46.291538 30765 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:46.305557 30765 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.284346 26607 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.277724 30903 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:46.293120 30867 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.185563 30578 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.294715 30584 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.307518 30765 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.320245 30903 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:46.320519 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45865.9us
I20260709 13:08:46.315135 26609 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:46.321988 30867 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.324151 30867 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.324679 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.325062 26606 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:46.325562 30912 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.330346 30908 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.331606 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.332497 30912 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.332877 30908 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.335148 30578 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.336104 30912 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:46.341133 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.342034 27321 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:46.344831 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.342610 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.342900 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.345994 27315 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:46.346419 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.341207 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:46.349375 30685 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.354485 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.355151 27315 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:46.355058 30430 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.357026 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.357625 26684 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:46.358804 27342 debug-util.cc:398] Leaking SignalData structure 0x7b080035dbc0 after lost signal to thread 30827
W20260709 13:08:46.359483 27342 debug-util.cc:398] Leaking SignalData structure 0x7b0800247aa0 after lost signal to thread 30877
I20260709 13:08:46.359947 30430 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.359516 30908 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:46.364529 30908 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:46.364943 30908 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.365381 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:46.368366 26609 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:46.356276 30629 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.382660 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.385936 30056 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.386694 30056 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.387130 30056 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.389442 30056 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:46.385972 30826 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:46.390439 30516 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.390957 30516 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.391827 30878 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.392107 30502 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:46.392525 30878 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.392881 30502 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.395123 30559 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.369899 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:46.395336 30306 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:46.434284 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.434840 30306 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:46.442619 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 72783.3us
W20260709 13:08:46.395709 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.30668e+06us
I20260709 13:08:46.445034 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:46.379207 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.446745 26608 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.356020 30836 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:46.387367 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.65124e+06us
I20260709 13:08:46.447738 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.458741 26681 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:46.460299 26687 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:46.373642 26684 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:46.466250 27319 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 6 LEARNER]: Advancing to term 7
I20260709 13:08:46.468420 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.469578 26684 raft_consensus.cc:2368] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
W20260709 13:08:46.476516 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.476989 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104017us
I20260709 13:08:46.474713 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.478310 26606 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.481706 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.481966 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.482847 26754 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:08:46.484592 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.484692 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.486164 26761 raft_consensus.cc:2368] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
I20260709 13:08:46.487339 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.493621 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.495368 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.496490 26683 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:46.500701 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.502279 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.503521 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.504223 26686 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:46.505172 26755 raft_consensus.cc:2410] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:46.396013 30123 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.506392 26679 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:46.507107 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.512714 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:46.509693 26685 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:46.514099 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.515780 30867 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.505466 30694 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:46.543366 30694 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.545608 30694 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.546144 30694 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:46.546850 30691 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:46.547760 30691 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:46.548100 30691 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:46.548278 30123 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.549777 30507 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:46.550246 30507 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.550577 30507 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.559190 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.559887 26686 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.560122 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1539) took 1277 ms. Trace:
I20260709 13:08:46.560480 26682 rpcz_store.cc:276] 0709 13:08:45.282459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.284010 (+  1551us) service_pool.cc:224] Handling call
0709 13:08:46.559970 (+1275960us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400160dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:46.560071 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687847808}
W20260709 13:08:46.567405 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 56979.3us
I20260709 13:08:46.568275 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.568275 26686 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:46.548956 30691 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.470584 30629 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:46.576277 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:46.595860 30056 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.596921 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.540467 30126 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:46.581080 30765 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:46.502617 30617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.023s	sys 0.053s
I20260709 13:08:46.584249 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.584614 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.609122 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.609520 26685 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:46.609915 26755 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:46.586153 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.610795 26758 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:46.586915 26759 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:46.515900 30701 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.503975 30885 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.589955 30516 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.475322 30559 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.593371 27286 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:46.650197 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56907.6us
I20260709 13:08:46.594590 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.595206 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.658329 26681 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:46.579883 26684 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:46.598299 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.601123 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.605475 26687 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:46.663173 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.664002 26687 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:46.666603 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65572.4us
I20260709 13:08:46.669190 26752 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:46.602818 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:46.585523 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.615233 26575 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.616874 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.515772 30827 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.675207 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.620520 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.680542 26684 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:46.681816 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:46.614151 30769 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.625533 26756 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:46.540719 30530 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:46.630460 30701 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:46.608831 30617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.024s	sys 0.054s
I20260709 13:08:46.632632 30306 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.599498 30123 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.635860 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.727312 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.728096 26755 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:46.636106 30728 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.638062 30507 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.730500 30507 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.640043 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.641605 30889 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.731559 30889 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.734014 30889 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.643824 30691 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:46.645346 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124853us
I20260709 13:08:46.646363 26606 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:46.648317 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:46.670928 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68386.9us
I20260709 13:08:46.600021 30914 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:08:46.595969 30629 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:46.672719 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.747318 26678 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:46.678124 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 63015us
I20260709 13:08:46.675561 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:46.672776 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87347.4us
I20260709 13:08:46.679113 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.676002 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.750844 26681 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:46.752460 30701 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.752750 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.730540 30559 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.672513 30430 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.754025 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.679512 30056 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.618552 30417 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:46.679929 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:46.763248 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.684161 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.624809 26608 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:46.687518 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.625314 30878 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.688354 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:46.717304 26726 leader_election.cc:400] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:08:46.720407 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.721449 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.741285 26606 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:46.741923 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.746166 26759 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:46.756691 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:46.761307 26612 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:08:46.677647 30578 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:46.677786 30909 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:46.677886 30938 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.684562 30827 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.650812 30908 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.850633 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.793949 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.862406 26684 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.864126 26605 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.763566 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.764364 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:46.814395 26603 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:46.864923 26607 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.815918 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:46.848378 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.865330 26726 leader_election.cc:403] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.862027 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:46.862584 27315 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.794396 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.717798 30530 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.848338 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.897019 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.897873 26756 raft_consensus.cc:2368] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
I20260709 13:08:46.685937 30903 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.872021 26679 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:46.881924 26683 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:46.796778 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.874044 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.908855 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:46.909981 26607 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:46.744966 30584 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.897605 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:46.920732 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 203557us
I20260709 13:08:46.921288 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.921681 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:46.914666 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.919463 26605 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:46.756605 30629 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.971997 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.973260 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.973948 30430 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:46.974325 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.974606 30430 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.794628 30461 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.181s
I20260709 13:08:46.976346 30461 consensus_queue.cc:1243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:46.976833 30461 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:46.977128 30461 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:46.977936 30461 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.979118 30461 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.748335 30714 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.232s
I20260709 13:08:46.980484 30714 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:46.980825 30714 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:46.981611 30714 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.982882 30714 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.688585 30768 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.221s
I20260709 13:08:46.924644 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.925928 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:46.897238 30530 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.927387 26678 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:46.927768 30885 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:46.927943 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.924799 30909 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:46.928973 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:46.929418 30877 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:46.931885 30701 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:46.933166 30123 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.039263 27314 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:46.936362 26607 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.936442 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.936728 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.936972 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.937062 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.054051 30827 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:46.939043 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:46.942008 30617 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.048652 30701 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.055022 26606 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 7.
I20260709 13:08:47.055773 30617 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.056159 30617 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.056811 30701 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:47.057075 30617 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.057740 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:46.808396 30728 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:47.060516 30909 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:46.809383 30640 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.062481 30640 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:47.063328 30640 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.796013 30417 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.067590 26759 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:47.067817 26686 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:47.068866 30417 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:46.945415 30516 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.946703 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.046833 30765 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.070459 30765 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:46.956041 26758 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:08:47.070425 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123843us
I20260709 13:08:47.072959 30765 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:47.048751 30578 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:47.073374 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:47.074194 30741 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.074247 30578 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.074908 30741 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:47.076102 30889 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:46.944407 30306 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:47.032037 27319 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.565s	user 0.002s	sys 0.008s
I20260709 13:08:47.035509 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:47.038064 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 287649us
I20260709 13:08:47.081833 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.038440 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:47.084065 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45697us
I20260709 13:08:46.935195 26684 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:47.086910 26576 leader_election.cc:400] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
I20260709 13:08:47.087545 26576 leader_election.cc:403] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.975410 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.043396 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.086050 27319 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 7 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:47.088526 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.084257 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.092877 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.046226 27315 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:47.049612 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.095885 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.100415 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.100721 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.101837 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:47.102283 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 422398us
I20260709 13:08:47.102859 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.102939 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.049747 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.051240 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.105752 26754 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:47.103885 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:47.036657 30885 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.118448 30885 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:47.032856 30877 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.120714 30877 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:47.120976 26683 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.033924 30559 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:08:47.122830 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.123539 26757 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:47.124306 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.124679 30629 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.126118 30937 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:47.126286 30676 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:47.104481 30900 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:47.128489 30908 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:47.129608 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.130786 26608 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.115908 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.132272 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:47.132371 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.132973 26685 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 8: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:46.990978 26687 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.118332 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:47.133852 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49680.2us
I20260709 13:08:47.134583 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.136451 26609 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.136271 30056 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:47.152944 26678 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:47.159051 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 115737us
I20260709 13:08:47.050429 30903 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:47.127532 30937 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:47.161381 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.165202 26609 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.163215 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.167187 26678 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:47.158289 30660 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
W20260709 13:08:47.168583 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64774.8us
I20260709 13:08:47.179123 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:47.091275 30878 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:47.137850 30417 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:47.173909 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.160071 30930 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.174998 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.135166 30826 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:47.158538 30889 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.181216 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.144572 30928 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.176566 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45196.1us
I20260709 13:08:47.196558 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.174338 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.188110 26754 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:47.173578 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.163952 30870 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.167706 30946 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.169661 30937 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.202976 30937 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:47.192118 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 105334us
I20260709 13:08:47.224300 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.180377 30878 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.178545 30908 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:47.238282 30908 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:47.238421 30878 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.239600 30878 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.239289 30908 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.240279 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.241091 26759 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:47.199210 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:47.241887 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.242054 26609 raft_consensus.cc:606] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.242430 26609 raft_consensus.cc:614] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:47.176573 30903 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.193183 30629 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:47.209607 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.212153 30502 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:47.024428 30507 consensus_queue.cc:1175] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "77c617823f2e4a938ef247a8924e299b" responder_term: 11 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.10-10.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:47.213102 30928 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.214012 30530 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.211576 30937 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.250486 30530 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:47.250988 30937 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:47.215425 30430 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.253618 30430 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:47.194278 30765 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.198086 30714 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:47.256024 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.158605 30938 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:47.257241 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.257714 30938 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.258060 26758 raft_consensus.cc:2410] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:08:47.258148 30938 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:47.258630 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.258903 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.259253 26682 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:47.260484 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.260744 30696 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:47.261138 30696 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:47.259061 30938 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.261831 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:47.262439 26680 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.262547 30938 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.264384 30056 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:47.264253 30937 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:47.264863 30056 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:47.265690 30056 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.203387 30889 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.268319 30836 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:47.259590 26758 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:47.219909 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.220862 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.198662 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.192950 30826 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:47.195271 30417 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:47.226814 30867 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.230584 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.276392 26760 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 7: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:47.229796 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:47.277855 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48144.3us
I20260709 13:08:47.274696 30530 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:47.278796 30530 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.226716 30952 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:47.279457 30952 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:47.279569 30530 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.280064 30952 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.280239 30867 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.274565 30826 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.284237 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.242878 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.288064 26759 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:47.272133 26754 raft_consensus.cc:2376] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12. Re-sending same reply.
I20260709 13:08:47.227118 26651 leader_election.cc:400] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10.
W20260709 13:08:47.291605 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 91678.4us
I20260709 13:08:47.279183 30417 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:47.272117 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51348.3us
I20260709 13:08:47.295260 26680 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:47.295508 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.295970 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.273217 26761 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:47.296876 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.293493 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.262001 30696 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.299105 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.296525 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.300295 26758 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:47.295542 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.301801 26753 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 8: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:47.289223 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.293696 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:47.303117 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124744us
I20260709 13:08:47.303879 30834 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.300388 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.274662 30430 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:47.303227 26754 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:47.305962 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.306553 26759 raft_consensus.cc:2368] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11.
I20260709 13:08:47.307680 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.310695 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:47.312983 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:47.325124 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63877.7us
I20260709 13:08:47.318003 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.343436 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:47.304858 30912 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.345340 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:47.346841 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:47.348122 26612 raft_consensus.cc:606] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.305466 30629 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:47.305665 30949 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.318746 30768 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:47.399891 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56567.9us
I20260709 13:08:47.415652 26752 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:47.415196 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 136250us
I20260709 13:08:47.324783 30908 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:47.313215 30430 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.318487 30640 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.321985 30502 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.349645 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:47.398268 30958 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:47.312752 30951 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.321964 30126 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:47.419853 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66334.2us
I20260709 13:08:47.418468 30430 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.425165 26755 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:08:47.425757 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76231us
I20260709 13:08:47.426347 30962 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:47.427191 30769 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:47.350868 30629 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.353431 30968 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:47.428318 30584 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.349169 30964 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:47.431344 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.413945 30885 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:08:47.440428 30617 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.442489 26753 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:47.477219 26753 pending_rounds.cc:85] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:47.477499 26753 pending_rounds.cc:107] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:47.477758 26753 raft_consensus.cc:2889] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.479395 26753 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:47.446063 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:47.447422 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.448513 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:47.457664 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.483480 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.414398 30927 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:47.424453 30877 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.429692 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.465457 26611 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.465333 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.401655 30459 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.469833 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 153758us
I20260709 13:08:47.507841 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:47.471082 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 163503us
I20260709 13:08:47.476052 26609 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:47.508965 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.445042 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:47.462584 30629 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.428649 30306 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:47.520368 30459 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.522701 30459 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:47.480422 30691 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.507506 30927 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.467655 30968 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.498134 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:47.505168 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75571.6us
I20260709 13:08:47.533615 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.534783 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.468252 30964 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.457110 30461 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:47.511269 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.513449 30975 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.514645 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.528823 27318 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:47.496893 30123 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:08:47.481352 30903 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:47.538616 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.553869 26603 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:47.553849 30056 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:47.526073 30927 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:47.561415 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46825.5us
I20260709 13:08:47.562456 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.564713 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.561528 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:47.566548 26609 raft_consensus.cc:606] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.567018 26609 raft_consensus.cc:614] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:47.568807 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57612.9us
I20260709 13:08:47.569641 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.528083 30584 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.539527 30968 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.583284 26678 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:47.584075 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.581734 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:47.592130 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94077.8us
I20260709 13:08:47.603053 27285 leader_election.cc:400] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11.
I20260709 13:08:47.544741 30964 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.611728 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.545397 30694 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:08:47.574004 30903 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.539980 30741 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:47.566543 30962 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.586843 30951 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.589999 30768 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:47.637172 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:47.657377 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 92709.5us
I20260709 13:08:47.658270 26680 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.590137 30971 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.649570 26683 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:47.659607 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:47.640200 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 156710us
I20260709 13:08:47.661577 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.662670 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.665899 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.668563 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:47.617020 30123 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.635552 30963 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.671986 30963 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.673329 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.546361 30952 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.587878 30982 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.603654 30691 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.657806 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1693) took 1075 ms. Trace:
I20260709 13:08:47.652649 30056 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.655179 30459 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:47.677317 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.699506 30982 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:47.700567 30967 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:47.701339 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:47.701939 26685 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.650700 30987 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.706773 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.675083 30768 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:47.709827 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.715602 30056 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.697875 30963 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.696204 30459 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.749331 26756 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:47.708477 30691 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.712575 30741 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:47.754778 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.697378 30826 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.701073 30982 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.758078 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:47.709393 30769 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:47.767531 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57731.2us
I20260709 13:08:47.780297 26685 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:47.781903 30996 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:47.789073 26686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2886) took 1199 ms (client timeout 1548 ms). Trace:
W20260709 13:08:47.789579 26686 rpcz_store.cc:269] 0709 13:08:46.589375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.639743 (+ 50368us) service_pool.cc:224] Handling call
0709 13:08:47.788865 (+1149122us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003c64d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:47.789007 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773758848}
I20260709 13:08:47.793187 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 452) took 1179 ms. Trace:
I20260709 13:08:47.793625 26687 rpcz_store.cc:276] 0709 13:08:46.614009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.688445 (+ 74436us) service_pool.cc:224] Handling call
0709 13:08:46.688735 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.135502 (+446767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.792939 (+657437us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000c53d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:47.793126 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546688896}
W20260709 13:08:47.795971 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.797145 30903 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:47.797958 30969 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:08:47.798326 30966 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:08:47.804044 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:47.805151 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:47.766537 30984 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.785398 30987 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:47.812492 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:47.825709 26606 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:47.835367 26606 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:47.780009 30963 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.847235 26755 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:47.812266 30827 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.810786 30584 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:47.814271 30417 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:47.813035 30461 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:47.847862 26755 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.860630 26755 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.869096 26755 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:47.869246 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 169886us
I20260709 13:08:47.814225 30908 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:47.819916 30768 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.810011 30990 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:08:47.877492 26612 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:47.855799 30584 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:47.821465 30769 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.884167 30584 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.887493 26609 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.830961 30459 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:47.875986 30977 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:08:47.895722 26760 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:47.898175 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1525) took 1254 ms. Trace:
I20260709 13:08:47.898658 26760 rpcz_store.cc:276] 0709 13:08:46.643236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.277181 (+633945us) service_pool.cc:224] Handling call
0709 13:08:47.897931 (+620750us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400225454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:47.898095 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404416384}
W20260709 13:08:47.894464 30878 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.002s
I20260709 13:08:47.879132 30968 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:47.917060 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 144244us
I20260709 13:08:47.918030 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.922178 30986 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.932699 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1694) took 1349 ms. Trace:
I20260709 13:08:47.941164 31013 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:47.933374 26759 rpcz_store.cc:276] 0709 13:08:46.582803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.323497 (+740694us) service_pool.cc:224] Handling call
0709 13:08:47.323868 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.324102 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:47.543142 (+219040us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.932067 (+388925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:47.932278 (+   211us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:47.932339 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.932429 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.932629 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3805,"prepare.queue_time_us":199973,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":92380,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":17398,"spinlock_wait_cycles":12720896,"thread_start_us":582141,"threads_started":3,"wal-append.queue_time_us":260626}
I20260709 13:08:47.945250 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.894539 30694 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:47.949781 30694 consensus_queue.cc:1243] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:47.916599 30660 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.950444 30660 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.951170 26759 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:47.953703 30996 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:47.954428 30714 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:47.954934 30430 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.955535 30996 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.955906 30996 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.957144 30430 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:47.958465 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:47.958576 30878 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.959647 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:47.959374 30878 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:47.960752 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:47.960523 30878 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.962220 30990 consensus_queue.cc:1243] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:47.962744 30990 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.962903 30701 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.856902 30559 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:08:47.963697 30701 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:47.963850 30990 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:47.964819 30990 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:47.965706 31000 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:47.965178 30701 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:47.967552 30981 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:08:47.968075 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:47.968706 26753 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.970093 26683 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.971357 26611 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:47.956735 30996 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.972671 26680 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.972785 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:47.942128 31013 consensus_queue.cc:1243] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:47.977667 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:47.980432 26759 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:47.981770 26610 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:47.922892 30986 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:47.965281 30990 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:47.988412 26576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 2.087s (SENT) [suppressed 13 similar messages]
W20260709 13:08:47.968575 30977 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:47.937708 30461 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.892481 30691 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:47.982674 26759 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.968358 30878 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:47.998838 26759 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.001435 26678 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:48.002523 30826 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.003335 30461 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.005622 30461 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:47.976567 30660 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.001821 26759 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.016306 26759 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.984498 30417 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:48.014618 30996 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:48.012292 30826 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:48.041180 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 206767us
W20260709 13:08:48.025063 30640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.025s
I20260709 13:08:48.052084 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:48.055845 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67478us
I20260709 13:08:48.061615 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1539) took 1114 ms. Trace:
I20260709 13:08:48.035055 30741 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:48.053869 30640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.026s
I20260709 13:08:48.062199 26757 rpcz_store.cc:276] 0709 13:08:46.947353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.124077 (+176724us) service_pool.cc:224] Handling call
0709 13:08:48.061354 (+937277us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540011cbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.061535 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881311488}
I20260709 13:08:48.059949 30836 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:48.068409 31006 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:48.068868 30973 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:08:48.044013 30826 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.079633 30826 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.080204 30904 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:48.080968 30904 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.082940 30741 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.069253 30978 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:48.083777 30417 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.073109 30836 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:48.085415 30903 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.086607 30903 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.088279 30968 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.075644 31006 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:48.088909 30983 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:08:48.090248 31006 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.084090 30978 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:48.088588 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:48.081435 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:48.091922 30978 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:48.093638 30978 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.088584 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.075038 31008 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:48.065814 26605 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:48.058037 30975 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:48.097589 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.107050 26759 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:48.105834 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:48.097218 30640 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:48.111153 26759 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 6
I20260709 13:08:48.112391 26759 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:48.113373 26759 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.115542 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.125342 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.125473 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.098924 30660 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.132194 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.114711 30968 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.104046 30904 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.120857 31006 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:48.133781 31009 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.152150 26760 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:48.154923 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1514) took 1511 ms. Trace:
I20260709 13:08:48.163445 26756 rpcz_store.cc:276] 0709 13:08:46.640704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.035203 (+394499us) service_pool.cc:224] Handling call
0709 13:08:48.151512 (+1116309us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400138654. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.151644 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235270912}
I20260709 13:08:48.166205 26756 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:48.166524 26756 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.153137 26755 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:48.168000 26755 pending_rounds.cc:85] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 6
I20260709 13:08:48.168354 26755 pending_rounds.cc:107] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:48.168658 26755 raft_consensus.cc:2889] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.130894 31008 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:48.150015 30629 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.008s
W20260709 13:08:48.173192 30960 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:48.126536 30640 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.134796 30908 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:48.149693 31006 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.184984 30903 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.172320 31009 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.206949 30928 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.207517 31009 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.209154 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.209301 26608 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:48.209816 26606 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:48.210325 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.211066 30584 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.173576 31015 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.167222 26756 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.197153 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.229184 26758 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:48.198944 26757 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:48.202693 26753 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:48.231424 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.232223 26753 raft_consensus.cc:2376] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12. Re-sending same reply.
I20260709 13:08:48.184015 31010 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.244644 31010 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.141834 30660 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.197176 31008 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.247120 31010 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.204411 31006 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.248000 31008 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.249083 26756 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.193315 30986 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.192574 30990 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.249934 30584 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.266155 26756 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:48.202884 30908 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:48.297971 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.299054 26756 pending_rounds.cc:85] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 6
I20260709 13:08:48.299436 26756 pending_rounds.cc:107] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:48.299783 26756 raft_consensus.cc:2889] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.303053 26758 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:48.255326 30837 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:48.201004 30629 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.256971 31008 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.250995 30701 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:08:48.304716 31002 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:48.321079 30990 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.332185 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.255493 31015 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.348771 31015 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.344134 31008 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.344973 30908 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.343340 30836 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:48.353091 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.355618 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:48.306540 30877 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:48.314231 30837 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.368814 30836 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.369594 30837 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.371434 31008 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.374580 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.360773 31015 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.391186 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:48.392354 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.377712 30908 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:48.405989 30964 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.003s
I20260709 13:08:48.406507 30964 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.408123 26753 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:48.411262 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512480111cea40cebe7a32ae9439af70"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:48.411880 26612 raft_consensus.cc:606] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.417541 26612 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:08:47.693598 26754 rpcz_store.cc:276] 0709 13:08:46.582524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.323031 (+740507us) service_pool.cc:224] Handling call
0709 13:08:47.348478 (+ 25447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.348714 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:47.542313 (+193599us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.657216 (+114903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:47.657315 (+    99us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:47.657380 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.657472 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.657732 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5231,"prepare.queue_time_us":175543,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":41235,"thread_start_us":247282,"threads_started":2,"wal-append.queue_time_us":107919}
I20260709 13:08:48.420369 30964 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.421614 30696 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.423373 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.428401 26754 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:48.429143 26612 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:48.433990 26754 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:48.441083 30629 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.442921 31006 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.445138 31006 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.458652 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1512) took 1818 ms. Trace:
I20260709 13:08:48.467238 30952 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.459295 26752 rpcz_store.cc:276] 0709 13:08:46.640046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.419588 (+779542us) service_pool.cc:224] Handling call
0709 13:08:47.825203 (+405615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.833777 (+  8574us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:47.833829 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:47.833900 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:47.833951 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.834048 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.458365 (+624317us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54000dc0d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.458561 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8069,"raft.queue_time_us":10350,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":917993344}
I20260709 13:08:48.479238 30867 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.495208 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.490036 30952 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:48.495832 26612 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.490588 30930 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.488271 30867 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.513477 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.514605 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2810) took 1066 ms. Trace:
I20260709 13:08:48.515005 26603 rpcz_store.cc:276] 0709 13:08:47.448369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.448670 (+   301us) service_pool.cc:224] Handling call
0709 13:08:47.448949 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.554685 (+105736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.514379 (+959694us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540003e8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:48.514548 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240621952}
I20260709 13:08:48.515794 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 456) took 1759 ms. Trace:
I20260709 13:08:48.516275 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.516180 26681 rpcz_store.cc:276] 0709 13:08:46.756383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.757110 (+   727us) service_pool.cc:224] Handling call
0709 13:08:47.790725 (+1033615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.790970 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.791017 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:47.791068 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:47.791116 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.791184 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.515605 (+724421us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003c64d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.515736 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376423680}
I20260709 13:08:48.506305 30660 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.517635 30306 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:48.518117 30306 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.499184 30930 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.519477 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2799) took 1581 ms. Trace:
I20260709 13:08:48.521793 26607 rpcz_store.cc:276] 0709 13:08:46.937935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.057477 (+119542us) service_pool.cc:224] Handling call
0709 13:08:48.519295 (+1461818us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b5400065c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.519423 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033075968}
I20260709 13:08:48.523366 30930 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.525998 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.519016 30306 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.527050 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.527313 26610 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:48.532799 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.528687 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.528920 26605 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:48.527927 26612 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:48.529479 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.530483 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:48.525767 30629 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:48.526265 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.535115 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:48.497967 30952 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.536922 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.531323 30126 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:48.538394 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:48.538362 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:48.539191 26607 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.539724 26607 raft_consensus.cc:614] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:48.538022 30126 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.541503 31004 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:48.542001 30126 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.543226 30126 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.542448 30952 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.528234 30908 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:08:48.538949 31035 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:48.560487 26606 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:48.565562 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.567497 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:48.568253 26681 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:48.570892 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:48.571266 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.535724 31015 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:48.571986 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:48.572566 26681 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:48.573395 26682 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:48.574178 26686 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:48.574321 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.538782 30995 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:48.564961 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.575241 26678 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:48.566643 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.542026 31004 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.582954 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.578213 30952 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.578570 30834 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:48.600363 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.562235 31010 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:48.604770 30837 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:48.606237 30834 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.608495 30834 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:48.602051 30952 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.620066 31004 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.626693 30459 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:48.630023 30867 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.632128 30530 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.636041 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:48.636915 27318 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:48.639967 30949 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:48.640391 30949 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.641204 30949 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.642227 30949 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:48.645546 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.646243 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.647756 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:48.656044 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54661.7us
I20260709 13:08:48.659596 30826 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:48.661913 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.663002 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:48.705179 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.693833 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.758472 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.694696 31010 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:08:48.722530 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 76300.5us
I20260709 13:08:48.760763 30995 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:48.761416 30995 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:48.762589 30978 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.762972 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.764008 30982 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:48.762403 30995 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.765280 30995 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:48.766620 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.663750 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.768404 26651 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.739148 30837 raft_consensus.cc:993] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:08:48.778028 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.791558 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.792639 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:48.795213 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.796331 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.778283 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.779932 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.800479 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:48.811082 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.786226 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.789490 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2907) took 1124 ms. Trace:
I20260709 13:08:48.833268 26683 rpcz_store.cc:276] 0709 13:08:47.666155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.666359 (+   204us) service_pool.cc:224] Handling call
0709 13:08:47.969928 (+303569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.970477 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.789247 (+818770us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54000b6150. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:48.789423 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697495936}
I20260709 13:08:48.834816 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:48.839079 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.843329 26761 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:48.843581 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:48.843376 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:48.735488 30904 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.842983 30584 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.854241 30908 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:48.859126 30584 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.797726 30640 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.860080 30640 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.861263 30584 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.862030 30640 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.775271 31015 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:48.862907 30867 raft_consensus.cc:1081] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:08:48.862823 31015 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.864670 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.864920 31015 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:48.865263 26612 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:48.855773 30691 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:48.865906 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:48.865906 30691 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.858680 30904 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.869076 26685 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:48.869513 30904 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:48.871922 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:48.872532 26605 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:48.854553 26758 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:48.859485 26679 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:48.856561 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 45576.7us
W20260709 13:08:48.762431 31033 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:08:48.880604 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:48.881407 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.881965 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:48.664240 30975 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:48.911201 26682 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:48.787477 30126 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.926218 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.854547 30885 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.935483 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 149354us
I20260709 13:08:48.928858 30904 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:48.936286 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:48.858831 30728 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:48.936934 26756 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:48.937438 30986 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:48.937827 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:48.938691 30837 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.936424 30904 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.937819 30986 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.941890 30986 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:48.941828 30951 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:48.943734 26682 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:48.914544 30826 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.959105 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.793627 30928 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:08:48.883621 31006 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:48.968209 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.969466 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:48.970914 26755 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:48.972093 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.972692 26683 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
W20260709 13:08:48.978894 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.871518 30836 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:08:48.972930 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.984145 26682 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:48.947090 30826 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.987102 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:48.920688 30516 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.927600 31008 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:48.990154 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146536us
I20260709 13:08:48.969056 31013 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.991596 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:48.992760 26679 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:48.963800 30502 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.965130 31021 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:48.931493 30676 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:49.026188 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:48.980000 30908 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.028445 26682 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:48.982810 31006 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:48.932042 30126 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:48.990038 30978 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:49.038919 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 226867us
I20260709 13:08:48.968273 30975 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.049378 30741 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.052528 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1541) took 1176 ms. Trace:
I20260709 13:08:49.082561 26760 rpcz_store.cc:276] 0709 13:08:47.859601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.904389 (+ 44788us) service_pool.cc:224] Handling call
0709 13:08:48.151702 (+247313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.163362 (+ 11660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.035727 (+872365us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400138650. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:49.035863 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566601984}
W20260709 13:08:49.056471 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.001099 30691 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.023909 30640 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.964743 30885 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:48.991117 31008 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:49.080111 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:49.087637 27318 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:08:49.088405 26680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512480111cea40cebe7a32ae9439af70"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
W20260709 13:08:49.088776 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.089051 26680 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.089452 26680 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:49.076416 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:49.090847 30968 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:49.091291 30968 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.091650 30968 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:49.095973 31036 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 13:08:49.034991 30502 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.049770 31006 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:49.133700 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 251167us
I20260709 13:08:49.001513 30516 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.034951 31021 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:49.151288 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 156002us
I20260709 13:08:49.119794 30908 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.122668 30951 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.128654 30629 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.167227 31053 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.175308 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:49.181182 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 314833us
I20260709 13:08:49.095990 30928 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:49.112627 30741 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.224097 30640 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.189123 31021 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.170791 31008 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.253460 31008 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.254712 30516 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.154168 30660 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:08:49.192840 31049 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:49.167737 26680 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.204608 30502 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.172500 30908 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.171958 30885 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.177119 30951 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.183164 30971 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:49.221246 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 131419us
I20260709 13:08:49.172256 31052 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:49.232100 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.233804 30836 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:49.283265 26680 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.285012 30741 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.286217 30952 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:49.288103 31046 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.353s	user 0.000s	sys 0.003s
I20260709 13:08:49.295046 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1720) took 1196 ms. Trace:
I20260709 13:08:49.294530 31006 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.295468 26756 rpcz_store.cc:276] 0709 13:08:48.098618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.301387 (+202769us) service_pool.cc:224] Handling call
0709 13:08:48.301665 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.937287 (+635622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.294784 (+357497us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400225954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:49.294983 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460134272}
I20260709 13:08:49.297804 31006 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.300660 26686 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:49.302774 30908 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.303850 30306 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.306506 30951 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.153851 30930 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:49.228802 30978 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.177412 30629 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.248524 31060 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.248353 31057 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:49.180496 31053 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.262934 26684 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:49.257702 30640 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.280471 30126 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.280735 30968 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.281737 30928 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:49.283422 30826 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:49.232199 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 245156us
W20260709 13:08:49.237278 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 240203us
I20260709 13:08:49.376658 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.377470 26756 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:49.238159 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.330185 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.341857 26604 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:49.271230 31052 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.383509 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.384519 26756 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:49.387449 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:49.360108 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 193102us
I20260709 13:08:49.388906 26756 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:49.389462 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.392102 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:49.392830 26754 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:49.395224 26752 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:49.399154 26761 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:49.401784 26761 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:08:49.402571 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.372813 31006 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:49.410867 31006 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.403611 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.415228 26760 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:49.370082 30741 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.406435 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.337997 30930 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.341444 30975 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.417609 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.418076 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.404304 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.420992 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.426169 26607 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:08:49.389356 31052 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.426759 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.423651 26758 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:49.424703 26680 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:49.427342 26608 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:49.425087 26604 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:49.425766 26606 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:49.431434 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.433017 26606 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:49.431433 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.342309 30978 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.436522 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.437366 26680 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:49.425801 26756 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:08:49.371490 31060 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:49.446702 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 248315us
I20260709 13:08:49.447755 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.449353 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.449841 31057 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:49.450350 31057 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:49.450472 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.451231 31057 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.443190 26754 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:49.451555 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.457837 30836 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.458858 30836 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.459723 30836 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:49.437448 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.424240 30126 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.429400 30984 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.465206 26678 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:49.471240 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:49.500195 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.501811 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55283us
I20260709 13:08:49.518632 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.425313 30741 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.522477 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:49.528919 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.504585 31062 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:49.524509 30986 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.007s
I20260709 13:08:49.464818 30516 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:08:49.513856 30928 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:49.503914 31061 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:49.525385 31004 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:49.501150 30126 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.523077 30728 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.503850 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 271438us
I20260709 13:08:49.529753 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.543056 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.531678 30691 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:49.528538 31065 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.547425 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.531069 31062 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:49.549531 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:49.569777 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:49.570006 26687 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.570441 27315 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.571225 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:49.553007 31059 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:08:49.554198 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.575624 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.555600 30694 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.556381 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.584667 26606 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:49.554241 30676 raft_consensus.cc:993] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:08:49.559798 31021 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.539412 30430 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:49.539414 30908 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:49.592687 30908 consensus_queue.cc:1243] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:49.593031 30741 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.593199 30908 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:49.593642 30908 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:49.563076 30126 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.563638 31053 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.564275 30968 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:49.564373 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.596364 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.565512 30978 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.546988 30952 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:49.536681 31058 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:49.505472 30984 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.550741 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.619880 26607 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:49.620764 27315 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:49.574770 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.540602 31004 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.542445 31070 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.586556 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.588889 30996 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:49.597651 30126 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.566952 30691 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.539619 30975 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:49.600421 26610 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:49.589656 31021 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:49.575904 31062 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.615272 31006 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:49.633363 26786 heartbeater.cc:646] Failed to heartbeat to 127.24.232.254:38345 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.232.254:38345 timed out after 15.000s (SENT)
I20260709 13:08:49.535588 30986 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.618983 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.541070 30928 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:49.589129 30694 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.576496 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 187144us
I20260709 13:08:49.623006 30126 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.625006 26607 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:49.622113 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:49.626652 26606 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:49.600536 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:49.660105 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59670.8us
I20260709 13:08:49.661183 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.661959 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:49.627607 31070 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.626016 31004 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.602743 30676 raft_consensus.cc:1081] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Signalling peer e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:08:49.568065 30728 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:49.618471 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 380375us
I20260709 13:08:49.614745 31058 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.599268 30640 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.633248 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.632503 26687 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:49.614041 30885 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.630321 30502 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.645829 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.646420 26684 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:49.649487 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.652652 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.653293 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.697331 26680 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:49.654712 30986 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:49.627839 30691 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:49.665829 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.669533 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.663435 30694 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.634133 31021 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.677615 31074 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:49.657984 31061 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:49.686633 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:49.687363 31070 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.687938 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.688997 30928 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.664840 30908 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.659700 31006 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:49.627765 30996 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.692909 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.678334 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:49.726349 26606 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:49.726701 26606 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:49.684275 30126 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:49.728117 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 276607us
I20260709 13:08:49.728340 30126 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:49.729283 30126 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:49.729457 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.702153 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.669871 30930 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.673311 30516 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.674410 30430 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.713533 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 175982us
I20260709 13:08:49.677748 30306 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.692231 31058 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.721520 26683 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:08:49.729724 30126 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.740586 26683 pending_rounds.cc:85] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:08:49.740837 26683 pending_rounds.cc:107] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:08:49.741093 26683 raft_consensus.cc:2889] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:49.709960 30741 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:49.737886 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.705654 31067 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:49.742364 30126 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.742987 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.718490 30640 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.727483 26606 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.751242 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.751922 26606 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:49.726034 31061 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:49.701563 30502 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.762881 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:49.763056 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.717427 31076 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:49.747854 30867 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:49.749318 30126 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:49.726919 31006 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.732018 31066 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:08:49.761303 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:49.772831 26759 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:49.721432 31010 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:08:49.762040 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.763468 26757 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.763657 26752 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:49.748170 30836 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:49.727934 30885 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:49.749269 30908 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:49.785898 30996 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.786629 30996 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.744871 30306 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:49.789078 30306 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:49.789975 30306 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.791168 30306 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:49.762370 30995 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.997s	user 0.013s	sys 0.000s
I20260709 13:08:49.781953 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:49.757673 31056 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:49.787111 30996 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.779695 31010 consensus_queue.cc:1243] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:08:49.794010 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 243370us
W20260709 13:08:49.752458 30765 consensus_queue.cc:1175] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9e8388401a74e84a2cc880930412709" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:49.773743 31006 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.798421 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.800693 26606 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:49.741935 30430 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.786075 30834 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:49.807698 26609 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:49.818593 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
W20260709 13:08:49.820884 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 129941us
I20260709 13:08:49.821714 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:49.810352 26610 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
W20260709 13:08:49.826598 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 109521us
I20260709 13:08:49.781769 30741 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:49.807192 30837 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.832002 26757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:35540
I20260709 13:08:49.841850 26757 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.838836 26685 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:49.763139 30640 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:49.842727 26757 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.792603 30984 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:49.831282 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 102372us
I20260709 13:08:49.824657 30834 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:49.853596 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:49.853988 27315 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:49.848927 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:49.857245 26679 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.874063 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:49.875762 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.876591 26687 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:49.876988 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.881052 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.825067 31056 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:49.885834 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:49.846203 31072 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:08:49.888276 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 62014.8us
I20260709 13:08:49.889845 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.886194 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:49.895648 27315 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.884714 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.832082 31010 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:49.905932 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.908595 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.909276 26680 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:08:49.909149 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.911705 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:49.911778 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.928396 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:49.933002 26679 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:49.937817 27315 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:49.931905 26757 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.892020 30728 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:49.841312 30741 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:49.943071 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61679.5us
I20260709 13:08:49.960543 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:49.961423 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:49.910257 30975 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.882339 30951 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:08:49.980598 26757 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:49.848559 30837 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.935983 31074 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:49.935062 30676 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:49.934831 30584 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:49.984052 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:49.894381 30982 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:08:49.957984 31053 raft_consensus.cc:2764] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:49.849845 31061 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:49.987345 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.991605 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.994596 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:49.974876 31013 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:50.000375 26610 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:50.000985 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:50.006255 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:50.018131 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.036063 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:50.028786 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.030982 26612 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:49.914451 31010 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.045344 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:50.046208 26684 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:49.983770 31075 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:08:50.029536 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:50.032902 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48981.8us
I20260709 13:08:50.058404 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:50.023379 30995 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:50.061926 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:50.063688 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.001554 30676 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:50.066094 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 244435us
I20260709 13:08:50.068298 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:50.070684 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:50.071493 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:50.076627 26757 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:50.078233 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:50.081003 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:50.086764 26684 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:50.091482 26757 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:50.094368 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:50.026057 31062 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.037883 31090 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:08:50.099504 30930 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:50.100055 31080 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:08:50.099972 30930 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.100914 30930 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.101177 31087 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:50.102118 31087 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.102483 31087 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:50.103057 31060 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.103739 31053 raft_consensus.cc:2764] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:50.103987 31054 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.060892 30578 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.099334 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:50.067852 30676 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.099957 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:49.983186 30834 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.137398 26752 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:50.143474 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 85133.1us
I20260709 13:08:50.125360 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:50.145169 26612 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.145625 26612 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:50.153491 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.087219 31097 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:50.104424 31054 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:50.155215 26752 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:50.045333 31056 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.137655 30984 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:50.178375 26612 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.140795 30502 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.160986 30995 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:50.191205 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:50.175645 31008 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.004s
I20260709 13:08:50.192124 27319 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:50.114495 31095 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:08:50.161892 31097 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:50.183486 31094 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:08:50.121721 30578 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.103392 31087 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:50.222612 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123398us
W20260709 13:08:50.248061 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.185756 31085 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.186074 30984 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.184507 30430 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:50.224081 30691 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:08:50.217252 31084 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.275527 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.227788 31100 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:50.223685 30995 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:50.286481 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:50.223253 31097 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.288637 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:50.113592 31074 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.290858 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.302805 26684 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:50.291600 26678 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:08:50.293316 26605 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:50.294759 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:50.305363 26606 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:50.305567 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:50.290210 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.298652 27321 raft_consensus.cc:2376] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8. Re-sending same reply.
I20260709 13:08:50.275460 30984 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:50.306824 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.293851 31084 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.271364 31077 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:50.325620 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.284935 30741 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:50.289528 30837 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:50.336530 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.326012 31093 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:08:50.283758 30691 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.371551 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:50.275978 31085 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.373665 27320 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:50.319281 30963 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.326022 31008 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.374892 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69409us
I20260709 13:08:50.398933 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:50.397439 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.403517 27316 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:50.401607 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.406558 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:50.301226 31105 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:08:50.336293 31113 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.409530 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.411547 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.337086 31010 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:50.385877 31092 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:08:50.406275 31021 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.684s	user 0.003s	sys 0.008s
I20260709 13:08:50.384603 30741 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.297430 31100 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.418251 30995 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.435705 31021 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.434698 31113 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.465370 31021 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.435137 31062 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.405004 30963 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.469138 30963 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.469901 31100 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:50.447249 31096 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:08:50.471475 30741 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:50.475847 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 70000us
I20260709 13:08:50.478029 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:50.479924 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:50.481501 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:50.483093 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:50.479229 30741 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.486260 26684 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:50.488945 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.492709 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:50.296145 31054 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.403051 31008 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:50.490249 31098 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:08:50.505479 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.511983 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.512701 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.447774 31109 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:50.513718 31109 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.514531 31109 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:50.516582 30306 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
W20260709 13:08:50.516892 31052 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.081s	user 0.013s	sys 0.000s
I20260709 13:08:50.517382 31052 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.519870 27317 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:50.520051 30306 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.520525 30996 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.520603 30306 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.521896 30885 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.522372 30885 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:50.522964 30578 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.523615 30306 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.525359 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.507069 31113 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:50.527748 31106 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:08:50.527935 30978 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.528394 30978 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:50.529186 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.532238 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:50.501416 31004 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
I20260709 13:08:50.552089 26684 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 8: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:50.505239 31103 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 13:08:50.515516 31111 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:50.556075 30430 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.560065 30676 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:50.526288 30694 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.000s
W20260709 13:08:50.572424 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 89463.9us
I20260709 13:08:50.563587 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.510099 31021 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.589201 26684 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:50.591176 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:50.555959 31118 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:50.523304 30885 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.613591 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:50.643805 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1742) took 1040 ms. Trace:
I20260709 13:08:50.576704 31054 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.558145 31004 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.587044 31052 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.529242 30978 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.689963 26760 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:50.689258 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 98166.8us
W20260709 13:08:50.635406 31107 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:08:50.698861 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:50.591495 30694 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.686950 26608 rpcz_store.cc:276] 0709 13:08:49.603238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.616218 (+ 12980us) service_pool.cc:224] Handling call
0709 13:08:49.616661 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.620817 (+  4156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.620845 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.631743 (+ 10898us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.854310 (+222567us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b1800168ca0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:08:49.974027 (+119717us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:49.974065 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.974130 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.643461 (+669331us) raft_consensus.cc:1685] finished
0709 13:08:50.643482 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.643731 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3692,"raft.queue_time_us":5709,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":14321,"spinlock_wait_cycles":11188480,"thread_start_us":119530,"threads_started":1,"wal-append.queue_time_us":421533}
I20260709 13:08:50.706187 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:50.641005 31122 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.574057 30430 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.695602 30885 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.610977 31021 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.774633 26755 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:50.737994 31141 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.800063 26761 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:50.740448 31125 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.739426 31120 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.708251 31084 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.774067 31122 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:50.808004 31124 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:08:50.810032 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.810356 27318 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:50.811401 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:50.811828 31123 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.812072 26686 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:50.799322 30978 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.820668 26680 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:50.791227 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.799216 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.739977 31130 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:50.743963 30691 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:50.802543 26760 pending_rounds.cc:85] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 9
I20260709 13:08:50.823863 26760 pending_rounds.cc:107] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:50.824323 26760 raft_consensus.cc:2889] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:50.816852 31006 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.001s
I20260709 13:08:50.811436 31121 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:50.864859 31125 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:50.819873 30951 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:50.820061 31008 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:50.907681 30908 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.002s
I20260709 13:08:50.910377 30629 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:50.908777 31006 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.920109 31137 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:50.932821 31138 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:08:50.944171 26687 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:50.944832 26687 pending_rounds.cc:85] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:08:50.945165 26687 pending_rounds.cc:107] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:50.945508 26687 raft_consensus.cc:2889] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:50.948220 31013 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.909s	user 0.005s	sys 0.007s
I20260709 13:08:50.948734 31013 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:50.815361 31120 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.954069 31120 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:50.954975 31134 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:08:50.955821 31127 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.956431 31127 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.958897 31127 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:50.960075 31132 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:08:50.914077 31121 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.918200 30676 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.927101 31130 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:50.963568 26756 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:50.817373 31141 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.961511 31123 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.969589 31061 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:50.985937 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:50.972792 31121 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:50.982924 30836 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:50.989027 30836 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:50.991185 30836 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:50.992583 30904 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:50.993337 31068 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.367s	user 0.010s	sys 0.005s
I20260709 13:08:50.993137 30904 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:50.994926 31097 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.005s
I20260709 13:08:50.995366 31097 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:50.995375 30904 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:50.975502 31130 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.999303 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.006197 26603 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.981899 31004 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:50.980610 31137 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:51.017620 26608 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:51.005118 30694 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.023331 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:51.008999 31130 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.030135 26603 raft_consensus.cc:2410] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:51.040067 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 458) took 1080 ms. Trace:
I20260709 13:08:51.040483 27314 rpcz_store.cc:276] 0709 13:08:49.944163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.944316 (+   153us) service_pool.cc:224] Handling call
0709 13:08:51.023169 (+1078853us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:51.024527 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36763008}
I20260709 13:08:50.985343 31109 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:51.041646 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 335499us
I20260709 13:08:51.044412 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:51.019137 31058 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.266s	user 0.004s	sys 0.010s
I20260709 13:08:51.045107 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:51.046008 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.046725 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.047783 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.018342 30676 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.006812 31061 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.017700 31144 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.068324 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:51.035017 30930 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.934s	user 0.011s	sys 0.000s
I20260709 13:08:51.136643 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.137724 26605 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:08:50.985229 31123 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:51.034224 30975 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.059s	user 0.009s	sys 0.002s
I20260709 13:08:51.031605 31065 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:51.037019 31006 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.028836 31126 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.127056 31141 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.068061 30908 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:51.240114 31128 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:08:51.242285 31061 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:51.244149 30984 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.917s	user 0.008s	sys 0.004s
I20260709 13:08:51.243961 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.065477 31122 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.139456 31127 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.219076 31004 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.218971 31060 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.221532 30975 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.220961 31065 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:51.221243 31144 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.103811 31058 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.281795 26607 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:51.138569 30676 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.311293 31058 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.317883 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.298916 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.301859 26682 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:51.319201 26605 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.261445 31126 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.250768 30908 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.323762 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.303489 31004 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.305809 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1752) took 1428 ms. Trace:
I20260709 13:08:51.306025 31123 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.311985 27315 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:51.312996 27321 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:51.296048 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.327380 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.328084 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2852) took 1335 ms. Trace:
I20260709 13:08:51.243916 31137 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.316411 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.222929 30930 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.317488 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:51.332373 26752 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.335031 30430 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.327765 26681 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:51.314865 31109 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.311897 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1749) took 1553 ms. Trace:
I20260709 13:08:51.339820 26753 rpcz_store.cc:276] 0709 13:08:49.758158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.758270 (+   112us) service_pool.cc:224] Handling call
0709 13:08:49.776521 (+ 18251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.777656 (+  1135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.777693 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.780618 (+  2925us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.937989 (+157371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:49.938051 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.938158 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.473712 (+535554us) raft_consensus.cc:1685] finished
0709 13:08:50.473739 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.311616 (+837877us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5400081e50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:51.311835 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11030,"raft.queue_time_us":30738,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":13904,"spinlock_wait_cycles":27591552,"thread_start_us":106587,"threads_started":1,"wal-append.queue_time_us":256038}
I20260709 13:08:51.343386 26605 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:51.343861 31126 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:51.345742 31021 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:51.346184 31004 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.348271 30834 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.349025 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.350220 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.350419 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.351047 26681 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:51.315873 31127 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.351857 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.352252 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.325793 26609 rpcz_store.cc:276] 0709 13:08:49.876980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.880165 (+  3185us) service_pool.cc:224] Handling call
0709 13:08:49.883320 (+  3155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.193515 (+310195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.193556 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.193673 (+   117us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:50.193721 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.305528 (+1111807us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400379bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:51.305587 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.305748 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3228,"raft.queue_time_us":48398,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":24770,"spinlock_wait_cycles":370575232,"thread_start_us":148586,"threads_started":1}
I20260709 13:08:51.328545 26611 rpcz_store.cc:276] 0709 13:08:49.993104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.993220 (+   116us) service_pool.cc:224] Handling call
0709 13:08:49.993504 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.993862 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.993903 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.026675 (+ 32772us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.502461 (+475786us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:50.502600 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.502718 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.327849 (+825131us) raft_consensus.cc:1685] finished
0709 13:08:51.327870 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.328029 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23130,"raft.queue_time_us":67395,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12338,"thread_start_us":436439,"threads_started":1,"wal-append.queue_time_us":862124}
I20260709 13:08:51.355983 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:51.356791 27320 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:51.352432 26681 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:51.359828 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:51.351452 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.252588 30984 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.282644 31085 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.378271 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:51.363641 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.399477 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:51.378672 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:51.380297 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:51.400321 26682 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:51.376629 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.379360 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.381810 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1570) took 1627 ms. Trace:
I20260709 13:08:51.398924 27320 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:51.372397 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.403431 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.403569 26680 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.403787 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.404677 26611 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:51.404739 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.405855 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.406391 26605 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:51.406745 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.408245 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.392506 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:51.380041 27312 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:51.419987 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61057us
I20260709 13:08:51.421617 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:51.415232 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:51.371637 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1568) took 1618 ms. Trace:
I20260709 13:08:51.423915 26754 rpcz_store.cc:276] 0709 13:08:49.753050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.753348 (+   298us) service_pool.cc:224] Handling call
0709 13:08:49.753625 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.753956 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.753981 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.754372 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.238902 (+484530us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:50.536025 (+297123us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.536337 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.536435 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.339438 (+803003us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18004562e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:51.371311 (+ 31873us) raft_consensus.cc:1685] finished
0709 13:08:51.371423 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.371563 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8854,"prepare.queue_time_us":146319,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3543,"raft.queue_time_us":21480,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":22872,"spinlock_wait_cycles":30248704,"thread_start_us":741837,"threads_started":2,"wal-append.queue_time_us":632054}
I20260709 13:08:51.427392 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:51.428365 26754 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:51.430150 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:51.431334 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.401803 27313 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
W20260709 13:08:51.435814 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58497.2us
I20260709 13:08:51.437279 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:51.438823 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:51.330838 30885 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 13:08:51.306044 31144 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.458015 30430 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:51.401714 26758 rpcz_store.cc:276] 0709 13:08:49.754520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.754680 (+   160us) service_pool.cc:224] Handling call
0709 13:08:49.755038 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.781852 (+ 26814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.781880 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.782317 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.897246 (+114929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:50.111366 (+214120us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.186734 (+ 75368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.381359 (+1194625us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400083254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:51.381415 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.381468 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:51.381572 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.381736 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16293,"prepare.queue_time_us":397337,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":78289,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":22224,"spinlock_wait_cycles":58280704,"thread_start_us":376136,"threads_started":3,"wal-append.queue_time_us":218773,"wal-append.run_cpu_time_us":11072,"wal-append.run_wall_time_us":1290209}
W20260709 13:08:51.440302 26724 connection.cc:256] RPC call timeout handler was delayed by -1.3347189360000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:08:51.371146 31073 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.772s	user 0.000s	sys 0.003s
I20260709 13:08:51.445374 31057 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:51.445911 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.486635 26686 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:51.442108 30694 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.454154 26604 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:51.377677 30930 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.380897 31006 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:51.366691 31004 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.364432 30908 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.456336 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.383430 31097 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:51.382930 31127 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.322942 31060 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.458681 27319 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:51.457219 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:51.453094 31085 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:51.386826 31121 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:51.441596 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61426.4us
I20260709 13:08:51.494469 31006 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.525357 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.525767 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.476940 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:51.508968 26611 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:51.532917 26753 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:51.488296 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:51.489452 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:51.432955 31065 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.492079 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:51.600958 26603 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.494148 26754 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:51.495934 26686 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:51.482426 26679 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:51.474885 26752 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:51.477332 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.467756 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:51.605577 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 137964us
I20260709 13:08:51.498003 31057 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:51.484087 26724 connection.cc:256] RPC call timeout handler was delayed by -1.2187892639999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2764s for a response
W20260709 13:08:51.607998 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.608400 26724 connection.cc:256] RPC call timeout handler was delayed by -1.0328484610000714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 13:08:51.482832 26681 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:51.610260 31074 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:51.610707 31074 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:51.611114 31074 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.587486 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:51.590679 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.595144 26758 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:51.595723 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 107492us
I20260709 13:08:51.483703 30430 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.527338 30984 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.525239 31087 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.529834 31006 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.492707 30694 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.514671 30885 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:51.614207 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:51.591516 31090 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.496325 31004 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.628837 31126 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:51.629354 31137 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.642643 31137 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.643700 31060 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:51.630520 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.589864 30971 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:51.613083 31127 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:51.525908 31130 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:51.587127 31085 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.596818 30660 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:51.647385 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:51.620427 30430 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.635069 31006 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.618182 31123 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:51.660171 30971 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:51.649150 26603 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:51.649534 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:51.644814 31137 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.655002 26758 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:08:51.655114 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.653264 31126 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:51.645516 31090 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.650405 30952 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:51.640239 30885 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.651973 31127 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.676589 31060 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.691850 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 155467us
W20260709 13:08:51.740748 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.740657 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:51.741576 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.742127 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:51.694959 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.699769 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1745) took 1952 ms. Trace:
W20260709 13:08:51.702240 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 2933) took 2051 ms (client timeout 2137 ms). Trace:
I20260709 13:08:51.676926 31015 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:51.744720 26755 rpcz_store.cc:276] 0709 13:08:49.750267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.750424 (+   157us) service_pool.cc:224] Handling call
0709 13:08:49.753158 (+  2734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.797563 (+1044405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.699464 (+901901us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400200b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:51.699705 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345964288}
W20260709 13:08:51.745662 26685 rpcz_store.cc:269] 0709 13:08:49.650400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.650565 (+   165us) service_pool.cc:224] Handling call
0709 13:08:51.702029 (+2051464us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001261d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:51.702165 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326647168}
I20260709 13:08:51.686913 31062 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:51.679994 31006 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.676352 30971 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:51.788205 31137 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.805538 31137 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.806241 31090 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:51.701519 30930 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:51.755012 31097 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.809796 31097 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.751616 31127 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:51.860057 31158 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:08:51.867110 30908 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:51.867805 30908 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.755636 31015 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:51.882016 31015 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.807451 30930 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.782968 31060 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.890646 31060 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.863790 31126 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:51.865216 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 80936.3us
I20260709 13:08:51.865574 30975 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:51.933820 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.938084 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:51.939077 26685 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:51.709024 31057 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:51.938247 31130 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.887267 30930 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:51.806897 31090 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.816529 31062 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:51.945050 30584 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:51.997936 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 383504us
I20260709 13:08:52.001063 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.999779 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1757) took 1707 ms. Trace:
I20260709 13:08:52.005667 26604 rpcz_store.cc:276] 0709 13:08:50.291885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.291997 (+   112us) service_pool.cc:224] Handling call
0709 13:08:50.292268 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.490112 (+1197844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.999361 (+509249us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400162e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:51.999690 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669409536}
I20260709 13:08:51.972715 31163 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:52.025807 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 281537us
I20260709 13:08:52.033351 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 461) took 1970 ms. Trace:
I20260709 13:08:52.004226 30584 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.033962 27315 rpcz_store.cc:276] 0709 13:08:50.063238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.063436 (+   198us) service_pool.cc:224] Handling call
0709 13:08:52.033075 (+1969639us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400647154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:52.033269 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2861237504}
I20260709 13:08:52.013391 31137 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.026306 30694 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.031656 31004 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.003914 31090 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.055399 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:52.056376 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 356746us
I20260709 13:08:51.992415 30971 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.025256 31163 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.058790 31004 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:52.063617 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.064021 31163 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.064388 26685 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:52.064276 31004 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.064450 31074 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.065869 30971 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.071746 31004 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.072391 31004 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.072891 31004 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.074096 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.075106 31004 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.075809 30885 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.075974 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.076933 26682 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:52.077190 31062 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.078147 31006 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.079038 30971 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.079893 31090 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.055375 30694 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.080626 30694 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.082270 30694 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.083405 31015 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.083865 31085 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.085668 31015 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.085997 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2939) took 2199 ms. Trace:
I20260709 13:08:52.086458 26687 rpcz_store.cc:276] 0709 13:08:49.886791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.912678 (+ 25887us) service_pool.cc:224] Handling call
0709 13:08:49.912995 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.946136 (+1033141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.085712 (+1139576us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001252d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:52.085900 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355590528}
I20260709 13:08:52.066888 31074 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:52.091492 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.091982 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.093042 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:52.098817 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.099251 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:52.099709 30430 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.104420 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.107630 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.107890 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.108421 26755 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:52.108610 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.108438 26758 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:08:52.106777 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:52.111294 27317 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:52.115121 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:52.115989 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.116667 27314 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:52.116775 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:52.116818 26650 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 2.095s (SENT)
I20260709 13:08:52.117389 27317 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.117487 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:52.117736 27318 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:52.117986 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:52.118140 27314 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.122833 30430 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.097662 31085 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:52.124966 31085 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.128935 31085 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.128952 31165 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:52.130913 31085 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:52.131893 27317 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:52.132130 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.091115 30930 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:52.099251 30694 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.136458 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.136600 30694 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.137225 31163 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.098933 31006 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.134058 30430 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:52.127350 30584 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.136082 31086 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:52.102386 31090 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:52.139842 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:52.142288 27314 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:52.143366 30584 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:52.144472 31087 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:08:52.144500 30885 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:52.145509 30885 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:52.138859 31163 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:52.145937 30885 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.122243 31062 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:52.147768 30834 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.149938 31127 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.150133 30834 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.145521 30640 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.140441 30930 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.148082 31006 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.133378 31173 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.142072 31086 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.160841 31086 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.149042 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:52.168653 26782 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
W20260709 13:08:52.170686 31147 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.162s	user 0.011s	sys 0.000s
I20260709 13:08:52.174819 30930 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.175984 30694 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.179872 31006 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.139761 31165 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:52.152724 31127 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.181239 31122 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:52.181854 31122 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.182345 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1583) took 2093 ms. Trace:
I20260709 13:08:52.182758 26759 rpcz_store.cc:276] 0709 13:08:50.089277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.644665 (+555388us) service_pool.cc:224] Handling call
0709 13:08:50.697060 (+ 52395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.697420 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.697449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.708918 (+ 11469us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.909510 (+200592us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:50.918783 (+  9273us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.919076 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.919172 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.169924 (+1250752us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:52.182030 (+ 12106us) raft_consensus.cc:1685] finished
0709 13:08:52.182136 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.182279 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1435,"prepare.queue_time_us":17914,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":8083,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":18552,"spinlock_wait_cycles":8824064,"thread_start_us":86291,"threads_started":1,"wal-append.queue_time_us":222419}
I20260709 13:08:52.182758 31122 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.187134 31122 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.196344 30908 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.199625 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1645) took 1709 ms. Trace:
W20260709 13:08:52.200773 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 85725.4us
W20260709 13:08:52.201102 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52161.2us
I20260709 13:08:52.203198 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.202535 26684 rpcz_store.cc:276] 0709 13:08:50.490668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.590015 (+ 99347us) service_pool.cc:224] Handling call
0709 13:08:50.590254 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.952800 (+362546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.952830 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.952869 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:50.952906 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.199339 (+1246433us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540025ce54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:52.199390 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.199546 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833332992}
I20260709 13:08:52.204833 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.204984 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:52.206275 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1585) took 2116 ms. Trace:
W20260709 13:08:52.206589 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.206624 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:52.207284 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.193984 30885 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.208060 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.209226 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.204169 31006 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:52.220108 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.208135 31165 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.206046 31163 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:52.233254 31006 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.211083 31090 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:52.213341 31004 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:52.210461 30694 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:52.237241 31004 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:52.243518 31004 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.249516 31086 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.252933 31086 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.261322 31004 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.263813 30885 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.134179 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:52.300621 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 166237us
I20260709 13:08:52.304865 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:52.306705 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:52.207864 26760 rpcz_store.cc:276] 0709 13:08:50.089891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.790714 (+700823us) service_pool.cc:224] Handling call
0709 13:08:50.802374 (+ 11660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.825213 (+ 22839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.825266 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.825873 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.003003 (+177130us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:51.015251 (+ 12248us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.017131 (+  1880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.017202 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.190942 (+1173740us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b1800456460. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:08:52.201691 (+ 10749us) raft_consensus.cc:1685] finished
0709 13:08:52.205989 (+  4298us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.206191 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1624,"prepare.queue_time_us":5169,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":1738,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2923,"spinlock_wait_cycles":21341056,"thread_start_us":176793,"threads_started":1,"wal-append.queue_time_us":203682}
I20260709 13:08:52.320598 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.321031 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:52.323930 27316 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:52.332598 30768 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:52.333334 30768 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.333379 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:52.333895 30768 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.334342 30952 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:52.335316 30952 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:52.335479 27312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 527) took 1961 ms (client timeout 2317 ms). Trace:
W20260709 13:08:52.336156 27312 rpcz_store.cc:269] 0709 13:08:50.373927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.374028 (+   101us) service_pool.cc:224] Handling call
0709 13:08:52.334958 (+1960930us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400600754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:52.335280 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194738048}
I20260709 13:08:52.334414 26760 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.337283 30952 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.338835 30908 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.339512 30908 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.341078 30908 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.344307 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:52.344954 31004 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.345078 30982 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.346292 30982 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.346983 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:52.347743 31061 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:52.348670 30640 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.359069 30982 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.360224 30982 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:52.360723 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.367484 27312 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:52.382352 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 173002us
I20260709 13:08:52.387833 26760 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:52.397609 30768 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.407239 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:52.409230 30885 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:52.409713 30885 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.410096 30885 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.420950 30885 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.423089 30768 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.428452 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:52.429375 27312 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.430526 30885 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:52.443813 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1748) took 2686 ms. Trace:
I20260709 13:08:52.444403 26756 rpcz_store.cc:276] 0709 13:08:49.757729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.757846 (+   117us) service_pool.cc:224] Handling call
0709 13:08:49.774971 (+ 17125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.975787 (+1200816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.443126 (+1467339us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400225954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:52.443563 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732906880}
W20260709 13:08:52.456355 27321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 468) took 2119 ms (client timeout 2245 ms). Trace:
W20260709 13:08:52.456996 27321 rpcz_store.cc:269] 0709 13:08:50.337298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.337456 (+   158us) service_pool.cc:224] Handling call
0709 13:08:52.455831 (+2118375us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54005a4bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:52.456110 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443262848}
I20260709 13:08:52.459297 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:52.462659 30768 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.464828 30768 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.466917 27312 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:52.468082 30768 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.470479 30676 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.472117 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:52.472800 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:52.474364 30951 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.474998 30951 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.476784 30951 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.484129 30885 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:52.485353 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.484894 30885 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:52.487576 30885 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.503389 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.506860 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.507746 27312 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:08:52.509197 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.515055 27312 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:52.526362 31121 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:52.544996 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.002s
W20260709 13:08:52.545485 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.007s	sys 0.002s
I20260709 13:08:52.560883 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.561750 27312 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:52.563154 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 551080us
I20260709 13:08:52.567467 30768 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:52.573395 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:52.574218 30768 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.576876 30768 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.576931 31077 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:52.577559 31077 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:52.579406 31077 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:52.581732 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.009s
W20260709 13:08:52.582193 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.006s	sys 0.010s
I20260709 13:08:52.582464 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.589781 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.590474 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:52.591733 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:52.597296 27319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 467) took 2293 ms (client timeout 2095 ms). Trace:
W20260709 13:08:52.597824 27319 rpcz_store.cc:269] 0709 13:08:50.304061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.304616 (+   555us) service_pool.cc:224] Handling call
0709 13:08:52.596833 (+2292217us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54005a3554. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:52.597084 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602135936}
I20260709 13:08:52.599879 31116 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:52.600531 31116 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:52.601027 31116 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.604772 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:52.605543 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.606541 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.607532 26604 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:08:52.608080 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 459) took 2358 ms (client timeout 1596 ms). Trace:
W20260709 13:08:52.608579 26761 rpcz_store.cc:269] 0709 13:08:50.249529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.502606 (+253077us) service_pool.cc:224] Handling call
0709 13:08:52.595421 (+2092815us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400138154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:52.607844 (+ 12423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424475520}
I20260709 13:08:52.611814 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.612012 31173 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:52.612886 26683 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:52.613373 31004 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:52.613840 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.614740 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.613824 31004 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:52.618260 31004 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.620157 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.620970 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.622937 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.616003 26683 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.624781 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.625568 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.627555 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.621984 26679 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.599328 30885 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:52.622150 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.621044 26681 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.627224 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.632555 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:52.632279 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.641603 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.642962 26604 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.643378 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.643872 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.644177 26687 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.644662 26683 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:52.645112 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.645732 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:52.641808 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.652031 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.653976 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.654801 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:52.655349 26684 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.656483 30963 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:52.658178 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.658948 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.646904 31004 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:52.664306 26686 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:52.658223 30963 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:52.638098 30885 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.664600 26610 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:52.668067 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.670320 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:52.671700 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.672072 27319 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:52.672171 30963 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.672636 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.675130 26603 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:52.676868 26604 raft_consensus.cc:2410] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:52.680200 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.682397 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.683220 26756 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:52.688560 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:52.689211 26756 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:52.689689 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.695464 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:52.699787 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.700196 30885 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:52.700703 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.701581 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:52.699044 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.704633 26610 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:52.705622 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:52.709566 27313 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:52.710459 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.710232 26603 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:52.711349 26606 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:52.719599 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:52.723242 30928 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.750558 30951 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:52.751220 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.751358 30951 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.753813 30951 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.754037 30834 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.759948 27319 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:52.760915 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:52.759755 27313 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:52.767978 31150 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:52.768569 31150 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:52.771121 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:52.772089 26603 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.777326 31150 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.778849 31150 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.779438 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 480) took 1782 ms. Trace:
I20260709 13:08:52.780191 26608 rpcz_store.cc:276] 0709 13:08:50.996866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.996976 (+   110us) service_pool.cc:224] Handling call
0709 13:08:50.997248 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.018147 (+ 20899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.778841 (+1760694us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5400249354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:52.779145 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46319360}
I20260709 13:08:52.783579 26603 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:52.783960 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.785003 26685 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:52.793236 31144 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:52.794013 31144 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.795871 31121 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:52.796646 31121 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.798800 26684 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:52.799203 31121 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.801210 31144 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:52.802982 31121 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.803552 31144 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:52.804455 31144 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:52.809360 31144 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:52.806852 31065 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.814761 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.810197 31116 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:53.088927 27286 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.539s (SENT) [suppressed 23 similar messages]
I20260709 13:08:52.806769 31121 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.829326 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.096720 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.097873 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.838373 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.100126 26609 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.103987 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:52.838526 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.107515 26610 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.109197 30694 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:53.110168 30694 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:53.110509 30694 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:53.110877 30694 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.842031 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.843220 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:52.845399 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:52.852152 30867 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:52.852237 31180 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.119951 30867 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:52.853392 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:52.868088 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:52.874461 31175 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:52.928886 31015 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.939472 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:52.944092 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:52.944983 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:52.947939 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:52.950492 30952 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.964278 30696 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:52.974005 26752 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:52.979349 26575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.012s	sys 0.003s
W20260709 13:08:52.989086 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.133564 26575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.012s	sys 0.004s
I20260709 13:08:53.009981 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.132838 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.134766 26760 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:53.134917 26753 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:53.018671 26612 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:53.019860 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.135871 26758 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.136193 30696 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:53.136577 30696 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:08:53.136739 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.137132 30952 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.021431 26756 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:53.137524 30696 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.138671 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.139994 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.028060 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:53.033946 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.014s	sys 0.025s
W20260709 13:08:53.040993 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.084846 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.086970 31077 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.120311 31085 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:52.920027 30584 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.143864 26759 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:53.143954 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 276142us
I20260709 13:08:53.105736 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.145218 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.145411 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.146392 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.147066 30885 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.147161 26679 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:53.147598 26679 pending_rounds.cc:85] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:08:53.147892 26679 pending_rounds.cc:107] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:53.148419 26679 raft_consensus.cc:2889] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.148658 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:53.149448 31090 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.150172 31090 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.150491 31090 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:53.150836 31090 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.151844 31085 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:53.152002 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.152648 26686 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:53.152966 31077 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.155117 31116 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.143361 31150 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.147482 30885 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:53.156569 30885 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.158188 31175 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:53.130115 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 276896us
I20260709 13:08:53.160233 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.160372 31175 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.133090 26754 raft_consensus.cc:2368] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12.
I20260709 13:08:53.141844 26604 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.131464 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.143594 30584 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.120326 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.147843 31173 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.130910 30867 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.136775 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.166688 26758 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.140609 26756 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:53.147478 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:53.139448 30952 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:53.164345 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.165169 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.166817 26682 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:53.170989 26607 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:53.171607 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.172276 26760 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:53.173051 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.175729 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.177052 31162 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.177101 30584 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.177911 31162 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.174077 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.181427 26752 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:53.182408 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.166498 31173 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.182978 26752 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:53.183238 31173 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.183900 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.184415 26752 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:53.184514 26756 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:53.185652 26752 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:53.186457 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.164772 31004 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.175824 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.176994 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.190672 31088 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:53.191093 31088 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:53.192001 31088 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.193238 31088 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.194216 26610 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:53.195211 31121 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.188902 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:53.200747 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.016s	sys 0.026s
I20260709 13:08:53.202261 26758 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.204330 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.209899 26760 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.212604 31065 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.213344 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.214015 26682 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:53.215934 31060 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:53.217345 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50000.5us
I20260709 13:08:53.217576 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.224007 30971 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:53.226148 30885 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.228739 31071 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.230762 31082 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.232471 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99814.9us
I20260709 13:08:53.234550 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.235437 30928 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:53.235747 31116 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.235920 30928 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:53.231305 31082 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.236426 30928 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:53.236649 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72409.4us
I20260709 13:08:53.237450 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.152683 31085 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.237913 31082 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.238830 31085 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.236442 31116 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.241570 31077 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.241827 31116 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.200315 31180 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.243633 31180 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.245644 31162 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:53.247879 30928 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.203759 31004 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:53.250464 30928 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.250614 31004 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.251282 31004 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.252580 31148 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.253204 31148 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.255353 31148 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:53.203922 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 1.45633e+06us
I20260709 13:08:53.257452 30696 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.259093 30885 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.259325 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.256131 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.259554 31004 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.260607 31180 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:53.261049 31180 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.261133 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.261487 31180 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.262275 31004 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.263098 31004 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.215484 26576 leader_election.cc:400] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12.
I20260709 13:08:53.263979 26576 leader_election.cc:403] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:08:53.264489 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49316us
I20260709 13:08:53.266306 30768 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:53.266867 30768 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:53.268707 31110 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12.
I20260709 13:08:53.268967 26757 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:53.270700 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.270450 30768 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.272064 30768 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.271438 26755 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.275857 31077 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.257463 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.280315 26680 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:08:53.281148 30885 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:53.281586 30885 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.281728 30867 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.281966 30885 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.283169 31114 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:53.272014 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.298357 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.299090 26753 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:53.311270 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:53.316838 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 154548us
I20260709 13:08:53.308158 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:53.324436 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.327199 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55276.4us
W20260709 13:08:53.330334 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.329099 26755 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:08:53.339550 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 122149us
I20260709 13:08:53.322522 30928 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.319977 31077 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.343006 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.349514 26612 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
W20260709 13:08:53.352020 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 163179us
W20260709 13:08:53.353235 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 97210.2us
I20260709 13:08:53.353399 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:53.354025 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2857) took 3230 ms (client timeout 1526 ms). Trace:
W20260709 13:08:53.354310 26612 rpcz_store.cc:269] 0709 13:08:50.119528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.125024 (+  5496us) service_pool.cc:224] Handling call
0709 13:08:51.309437 (+1184413us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b1800215880. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32cb646 00007f40f320558e 00007f40f3286f9e 00007f40f32887de 00007f40f329427c 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c
0709 13:08:53.018158 (+1708721us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b58004742d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f329427c 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c
0709 13:08:53.349991 (+331833us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6510162688}
I20260709 13:08:53.356091 26608 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:53.329531 31004 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:53.361095 31200 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.362080 31097 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:53.368214 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.370293 31071 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:53.341967 31150 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:53.335474 31090 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.372609 26507 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 8, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.392431 31090 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.393133 26507 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.396528 31173 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.397687 26761 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.398594 31173 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.380936 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.399996 26753 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.400086 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.401362 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.401875 26761 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.380491 26760 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:53.403887 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.404747 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.405457 26760 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:53.405999 31148 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.407238 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:53.373265 31200 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.407793 31148 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:53.377928 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.385330 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.386412 31180 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.378312 31176 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.408100 31200 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.384732 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.384078 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.412168 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:53.431064 26756 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.426477 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:53.373920 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.427235 31176 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.427762 31202 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.435186 31202 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.435601 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.437044 26756 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:53.437340 31202 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.373150 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:53.438071 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 85212.9us
I20260709 13:08:53.438143 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:53.438709 27313 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:53.438972 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.412827 26759 raft_consensus.cc:2410] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:53.394945 26507 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.434531 26753 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:53.440555 26760 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:53.445726 31148 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.445432 26507 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 8, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 8 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:53.446308 31148 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.447002 26507 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:53.447858 31202 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.448308 31202 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.448640 31202 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.448776 26758 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.448894 26507 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 9 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:53.450774 26507 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 9 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:08:53.451465 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83450.1us
I20260709 13:08:53.451743 31004 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.451892 31148 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.383225 31071 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:53.452598 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.462476 31071 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.456818 26507 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:53.464588 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.464986 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.464968 26507 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.457372 31004 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.466200 31004 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.466981 26754 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:53.470568 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.461385 27319 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:53.471910 31150 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:53.463173 31173 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.472062 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.472489 31150 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:53.473557 31150 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.476424 26680 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.477327 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.430423 31090 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.465737 26759 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:08:53.464123 31071 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.486555 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.476019 26507 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 4 to 9, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:53.489837 26755 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:53.494248 26754 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:53.497484 31176 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.500998 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.501425 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:53.459236 26752 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:53.505090 31173 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:53.505551 31208 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:53.505986 31208 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.506400 31208 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.506108 31173 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.507206 31122 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:53.511121 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48350.3us
I20260709 13:08:53.512667 31144 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:53.513566 31144 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.513893 31144 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:53.512838 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48350.3us
I20260709 13:08:53.517168 27319 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:53.517086 31144 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:53.517742 26508 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 213) took 31311 ms (client timeout 15000 ms). Trace:
I20260709 13:08:53.518345 31144 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.520522 27313 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:53.522688 26507 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 8, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.524296 26761 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
W20260709 13:08:53.532107 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.532835 26753 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:53.543907 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:53.552189 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 107358us
I20260709 13:08:53.554188 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:53.554916 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.557010 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.486877 30694 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.559115 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.559861 26607 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:53.560773 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.565196 27313 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:53.565392 30885 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.567521 26758 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:53.567802 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86500.4us
I20260709 13:08:53.569180 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:53.518222 26508 rpcz_store.cc:269] 0709 13:08:22.205953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.206250 (+   297us) service_pool.cc:224] Handling call
0709 13:08:22.294328 (+ 88078us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:53.517489 (+31223161us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.821336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.822106 (+   770us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.822165 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:08:45.822193 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:45.824462 (+  2269us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.824572 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.824611 (+    39us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:08:45.826487 (+  1876us) tablet.cc:701] Row locks acquired
0709 13:08:45.826532 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:08:45.826739 (+   207us) write_op.cc:270] Start()
0709 13:08:45.826866 (+   127us) write_op.cc:276] Timestamp: P: 1783602525826668 usec, L: 0
0709 13:08:45.826886 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.827620 (+   734us) log.cc:844] Serialized 9178 byte log entry
0709 13:08:46.111647 (+284027us) op_driver.cc:464] REPLICATION: finished
0709 13:08:46.296207 (+184560us) write_op.cc:301] APPLY: starting
0709 13:08:46.296327 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:46.558692 (+262365us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:46.558857 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:47.526122 (+967265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:47.824144 (+298022us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 13:08:47.831387 (+  7243us) write_op.cc:312] APPLY: finished
0709 13:08:47.968209 (+136822us) log.cc:844] Serialized 204 byte log entry
0709 13:08:48.131185 (+162976us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.149842 (+ 18657us) write_op.cc:454] Released schema lock
0709 13:08:48.177051 (+ 27209us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.257130 (+ 80079us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.259947 (+  2817us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1700333,"reported_tablets":52,"spinlock_wait_cycles":110874112,"child_traces":[["op",{"apply.queue_time_us":179463,"apply.run_cpu_time_us":66204,"apply.run_wall_time_us":1907541,"cfile_cache_hit":90,"cfile_cache_hit_bytes":94005,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":1,"lbm_read_time_us":1083,"lbm_reads_lt_1ms":8,"num_ops":23,"prepare.queue_time_us":1904,"prepare.run_cpu_time_us":16442,"prepare.run_wall_time_us":93789,"raft.queue_time_us":102671,"raft.run_cpu_time_us":17483,"raft.run_wall_time_us":117530,"replication_time_us":244663,"spinlock_wait_cycles":20736,"thread_start_us":436372,"threads_started":5,"wal-append.queue_time_us":288244,"wal-append.run_cpu_time_us":39099,"wal-append.run_wall_time_us":2141329}]]}
I20260709 13:08:53.569751 26686 raft_consensus.cc:2376] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9. Re-sending same reply.
I20260709 13:08:53.570624 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.570724 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.570904 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.571417 26682 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:08:53.572393 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:53.572804 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.573467 26684 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:53.531452 31176 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:53.567879 26507 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.582407 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:53.583134 26684 raft_consensus.cc:2368] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12.
W20260709 13:08:53.576236 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54244us
I20260709 13:08:53.591867 26757 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:53.593802 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:53.596128 30928 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.596505 30928 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.596540 31180 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.596930 30928 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.597467 31175 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.594808 26507 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 9, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.608278 31121 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.608682 31121 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.587903 30768 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.587694 30885 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.608989 31004 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.590207 31060 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:53.614457 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57540.7us
W20260709 13:08:53.616072 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.617444 31060 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.589176 30951 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:53.619807 31213 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.619982 31060 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.609051 31121 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.625818 31004 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.593582 30696 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.628258 30696 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.631803 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.633749 30694 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.601764 30982 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:53.634902 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.635177 26682 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:53.589916 31122 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:53.635540 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:53.636224 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:53.620378 31213 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.638134 26679 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:53.612130 30768 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.638168 31213 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.640115 30768 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.642186 31097 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:53.642705 31097 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.644841 31097 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:53.648216 27313 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.649293 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:53.649760 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 78991.4us
I20260709 13:08:53.650786 27315 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:53.651186 27315 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 8
I20260709 13:08:53.649978 27312 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:53.651345 26507 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.651418 27315 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:53.653275 27315 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.650681 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:53.653225 26507 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.649935 30768 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.671784 30768 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:53.631153 31208 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.681072 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.681751 26679 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:53.682518 26678 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:53.609112 31202 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.683574 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.683689 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.685248 31202 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.685379 26686 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:53.686404 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:53.686990 26679 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:53.687399 31175 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.638806 30696 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:53.688160 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 98272.6us
I20260709 13:08:53.675055 30928 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.702404 30928 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.698956 31121 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.702641 31200 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.704051 26684 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.707206 31208 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.710143 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.710289 31144 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:53.711054 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.711711 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.712368 27319 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:53.712738 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.712396 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.751966 26612 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.715752 31180 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:53.694633 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.716200 26606 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:53.716799 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.721573 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:53.722384 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.724949 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.757129 27313 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.727823 26604 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:08:53.728621 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 73573.8us
I20260709 13:08:53.714905 31213 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:53.752979 26607 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.758131 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:53.753458 26610 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.760088 31088 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:53.722391 31202 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:53.720129 31176 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.768074 31176 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:08:53.768637 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 165435us
I20260709 13:08:53.773579 26610 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:53.775974 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.776942 26604 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:08:53.777990 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.780066 26507 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 8, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.780694 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.780910 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.781630 26610 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.782104 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.786455 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.789105 26507 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.791286 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.793453 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.751945 31173 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.756999 31144 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.794780 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.794934 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.794113 26609 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.798543 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.798604 26606 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.781363 30963 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:53.804267 26507 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.799708 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.798964 26604 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:53.804643 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 110113us
I20260709 13:08:53.806533 26507 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 8, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.810459 26757 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:53.824877 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.825932 26753 raft_consensus.cc:2368] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9.
I20260709 13:08:53.769699 31175 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:53.828095 26612 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:53.796761 30982 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.853762 26604 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:08:53.858013 31201 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:53.858534 31201 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:53.859371 31213 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:53.835088 31215 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.859522 31201 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.860486 31215 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:53.860906 31201 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.861423 31215 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:53.838152 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08001b26a0 after lost signal to thread 25510
I20260709 13:08:53.800098 31144 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:53.864589 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08003af360 after lost signal to thread 26544
I20260709 13:08:53.793848 30694 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:08:53.847939 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65959.4us
I20260709 13:08:53.793274 31097 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:08:53.823437 31090 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.894764 26606 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:08:53.866315 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:53.877068 26610 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:53.879343 26609 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:53.888113 27313 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:53.823122 31208 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.834844 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:53.890296 26753 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:53.890796 26607 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:08:53.892500 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7020 after lost signal to thread 26636
I20260709 13:08:53.888903 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:53.896778 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.797897 31122 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:08:53.880121 26507 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:53.936676 31208 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.936944 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:53.939110 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54589.6us
I20260709 13:08:53.943867 26612 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:53.946077 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.938756 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.947876 26606 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.949335 26755 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:53.939785 26507 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 8, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.951697 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.809526 31173 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:53.951370 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:53.954348 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08002f06e0 after lost signal to thread 26637
I20260709 13:08:53.954609 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.956993 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.938726 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.937956 31060 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.956465 26753 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:53.958899 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08001ff820 after lost signal to thread 26711
I20260709 13:08:53.961900 30885 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:53.962664 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:53.963721 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.992412 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:53.992646 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:53.948770 31208 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.994544 30885 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:53.999269 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:53.999707 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.000041 26755 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:54.000289 26758 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.971817 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:08:53.993554 31218 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:53.967506 31176 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:53.958076 31225 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:53.983992 31060 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:53.965340 30971 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:53.993182 26607 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:53.956862 31150 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.996536 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:53.953542 31213 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.997339 26604 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:54.007073 30696 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.971159 26576 leader_election.cc:400] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9.
I20260709 13:08:54.028471 26576 leader_election.cc:403] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.976907 30963 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.001590 31090 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.983939 31004 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:54.032028 30951 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.032155 31004 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.033432 26607 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:54.034250 31004 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.034840 31090 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:54.019490 30971 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:08:53.984555 26708 debug-util.cc:398] Leaking SignalData structure 0x7b080038cb60 after lost signal to thread 26712
I20260709 13:08:54.035808 31090 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.036194 30971 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.037352 30971 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:54.038947 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.005884 26507 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 4 to 5, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 5 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:53.984506 30982 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:54.014787 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.020244 26603 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:54.026039 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:53.995223 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:54.042402 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47253us
I20260709 13:08:54.043824 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.044526 30696 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:54.044763 31004 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.045606 31004 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:54.045572 30696 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.046325 30885 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.046691 31004 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.047891 26507 catalog_manager.cc:5697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 3 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.049576 26507 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 4 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.051718 26507 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 2 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.053282 26507 catalog_manager.cc:5697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 7 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.054874 26507 catalog_manager.cc:5697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 1 to 9. New cstate: current_term: 9 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:54.043073 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.067301 26758 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:54.028544 26606 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:54.028712 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.031080 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.030980 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59991.3us
I20260709 13:08:54.032557 30951 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:54.027591 31150 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:54.036664 26708 debug-util.cc:398] Leaking SignalData structure 0x7b0800392f20 after lost signal to thread 26785
W20260709 13:08:54.008366 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 173633us
I20260709 13:08:54.007805 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.012707 26612 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:54.018287 31060 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.077721 31085 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.077965 31173 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.078420 31085 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:54.079306 31085 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.077762 31206 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.081398 31097 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:54.082231 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.082309 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.082762 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:54.025329 31121 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.083976 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.084375 31121 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:54.085785 31121 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:54.086163 31121 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:54.084004 30982 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:54.086529 31150 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:54.075644 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2080 after lost signal to thread 27345
I20260709 13:08:54.070791 31200 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.071310 30867 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9.
I20260709 13:08:54.070510 31214 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.087100 30982 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:54.087656 26708 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0900 after lost signal to thread 27346
I20260709 13:08:54.071727 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.029933 30963 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.085795 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.098048 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.104059 26604 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:54.041327 31213 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:54.124141 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.088268 31218 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:54.086534 31121 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.097496 30982 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:54.134652 31220 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:54.136081 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57643.3us
I20260709 13:08:54.087910 31150 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.135540 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.138530 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 109086us
I20260709 13:08:54.141201 30952 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.129062 31122 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:54.147768 26507 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.161599 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:54.163486 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:54.165773 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.167244 26610 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:54.170084 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:54.171833 26507 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.173579 26507 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 6 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:08:54.175559 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.178427 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.180205 27312 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:54.160776 31122 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:54.187197 26507 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.177060 31215 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:54.190670 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.174407 31175 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:54.198673 31060 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.162810 30952 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.201336 30952 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.177670 31090 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:54.188709 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53299.5us
I20260709 13:08:54.209177 26611 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:54.189680 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.210412 26610 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:54.174649 30867 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:54.191732 26507 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 8, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.193810 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.215752 30765 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:54.216223 30765 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:54.189642 30951 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.217048 30765 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.218259 30765 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.187799 30584 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:54.219554 30584 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:54.219916 30584 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:54.220744 30584 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.221891 30584 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.186821 31122 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.226904 26507 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 5 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:54.234198 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.242913 26604 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:54.247730 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53953.4us
I20260709 13:08:54.248561 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.194911 31215 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:54.256928 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 91719.9us
I20260709 13:08:54.257987 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.177816 31213 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.260823 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.244316 31175 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:54.265713 31202 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:54.253500 31215 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.266188 31207 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:54.266678 31207 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.267026 31207 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.277338 26651 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.252987 31180 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:54.263553 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.280536 26611 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:54.255111 31214 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.298962 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.299330 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.265923 31227 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:54.265225 31175 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:54.305697 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.309259 31240 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:54.309434 31122 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.312953 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.313625 26603 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9. Re-sending same reply.
I20260709 13:08:54.314981 26607 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:54.316000 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.316093 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:54.319733 31228 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:08:54.327260 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:54.327834 31070 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.336586 31060 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.336810 30982 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.342731 26754 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:54.339888 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:54.349740 26685 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:54.351107 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:54.351284 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45653.9us
I20260709 13:08:54.353295 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.262647 31071 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:54.262517 30768 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:54.355772 26604 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:54.355856 26608 raft_consensus.cc:2410] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:54.304366 31150 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:54.364616 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:54.357144 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58256.7us
I20260709 13:08:54.366320 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.348158 31070 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:54.338934 30982 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.357041 30951 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.383616 31070 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.387401 30768 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:54.404467 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:54.392926 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:54.397305 31207 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.357728 31180 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:54.401088 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52422.5us
I20260709 13:08:54.355490 31121 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.401898 31175 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:54.420289 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 239969us
I20260709 13:08:54.425400 31114 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.425339 31239 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:54.414428 31201 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:54.404882 30768 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:54.405263 30951 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:54.428571 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.411595 31173 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.398815 31208 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.419862 31214 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:54.450139 31215 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.433179 31201 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:54.451578 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.452601 31201 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.453886 31201 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:54.455300 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.455955 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:54.457825 30584 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.458509 30952 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:54.459370 26609 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:08:54.433650 31240 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:54.450654 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:54.438989 30951 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.441741 31122 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.461702 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:54.477072 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.464206 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:54.464983 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:54.492319 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.437599 31175 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.459610 30584 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:54.519027 30584 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:54.520948 30584 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.425001 30963 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.467131 26605 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:08:54.532492 26605 pending_rounds.cc:85] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 9
I20260709 13:08:54.532815 26605 pending_rounds.cc:107] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:54.533088 26605 raft_consensus.cc:2889] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.465837 26683 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:54.471233 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:08:54.503432 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52865.4us
I20260709 13:08:54.507378 26684 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:54.462940 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:08:54.466569 31247 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:54.462141 31144 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
I20260709 13:08:54.460697 26680 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:54.510738 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.468861 31121 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.462620 30768 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:54.538990 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 67822.8us
I20260709 13:08:54.518965 30951 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.441999 31150 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:54.506465 31122 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:54.544924 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 112884us
W20260709 13:08:54.542188 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.548594 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.549147 27286 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.551481 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:54.552369 26761 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:54.552973 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.553881 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.557956 30963 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.545365 31060 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.560285 26759 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:54.562935 26757 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:08:54.565970 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.569934 26752 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:54.570827 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:54.571398 27313 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.575794 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.579262 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.580125 26760 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:54.578418 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:54.591632 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 128789us
I20260709 13:08:54.545565 31214 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:54.545981 31239 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:08:54.597719 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 233207us
I20260709 13:08:54.598460 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.570950 31060 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:54.575948 30768 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.550653 31144 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.590162 30834 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:54.611286 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.611873 26577 leader_election.cc:400] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12.
I20260709 13:08:54.606099 27313 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:54.607023 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:54.613333 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:54.614351 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.615116 26684 raft_consensus.cc:2410] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:54.598992 31215 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.622035 26684 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:08:54.622502 26684 pending_rounds.cc:85] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 9
I20260709 13:08:54.622771 26684 pending_rounds.cc:107] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:54.623049 26684 raft_consensus.cc:2889] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:54.625665 31251 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:54.627696 31257 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.628777 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.630782 30951 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.612108 31200 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:54.632085 31200 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.632215 31060 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.634413 31200 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.636060 31242 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:54.636650 31242 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:54.637307 31082 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:54.637683 31242 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.638336 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:54.639169 27313 raft_consensus.cc:2368] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:08:54.638931 31239 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:54.636559 31207 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:54.636541 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.639928 31150 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:54.641783 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.643507 26575 leader_election.cc:400] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:08:54.643783 31144 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:54.644435 30867 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:54.644884 30867 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:54.645293 30867 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.648957 31114 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.653738 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.643926 26575 leader_election.cc:403] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.656883 26680 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:54.658097 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.658397 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.659399 26683 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:54.618062 31213 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:54.676023 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:54.684166 26683 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:54.684535 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.685199 26680 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.687397 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.689031 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.696298 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:54.696950 26606 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.706434 26611 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:54.707564 26609 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:54.655707 30696 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:54.708973 30696 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:54.709446 30696 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.707342 31208 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:54.671037 30963 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:54.671655 31200 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.724896 26604 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:54.729650 26606 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:54.689057 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.733877 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.736702 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:54.736193 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59470.2us
W20260709 13:08:54.738184 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45433.1us
I20260709 13:08:54.679318 31213 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:54.748752 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.748862 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.747524 26755 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:54.744942 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.721160 31214 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.784422 26760 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:54.784565 26753 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:54.785055 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.676985 31144 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:08:54.783938 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 234859us
W20260709 13:08:54.782614 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45996.9us
I20260709 13:08:54.783187 26683 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:54.795280 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:54.798337 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.734346 30963 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:54.799750 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:54.806836 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:54.810480 26685 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:54.744899 31202 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:54.713307 30982 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:08:54.814040 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.750116 31257 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.749655 31085 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.823366 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:54.816007 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.820992 26680 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:08:54.785382 31088 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:54.817234 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:54.835985 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.836477 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:54.840059 26753 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:54.824030 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:54.786285 30952 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.781843 31213 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.825524 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:54.813237 30963 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.862905 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:54.852834 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:54.744994 31122 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:08:54.911485 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95579.6us
I20260709 13:08:54.822146 31121 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.915330 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.916731 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.803647 31215 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:54.925433 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:08:54.927380 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 103407us
I20260709 13:08:54.928910 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:54.814175 31180 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:08:54.839432 31088 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:54.800423 31214 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.822319 31254 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.932435 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:54.982095 26753 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:54.933247 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68245.3us
I20260709 13:08:54.945267 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:54.835772 31202 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:54.925782 31144 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:54.926640 30834 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:54.842916 31085 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.031419 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.036235 26685 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:55.020684 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:54.836095 31208 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:08:54.916139 30982 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:55.050923 26752 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:55.053016 26680 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:54.982796 31088 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.061445 26681 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:55.055774 31060 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:55.090555 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.091264 26680 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:55.096016 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 299307us
I20260709 13:08:55.135839 26758 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:55.138562 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.139225 26685 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.038050 31144 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:55.035255 30951 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260709 13:08:55.137867 31201 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.000s
I20260709 13:08:55.145001 26604 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:55.182636 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
W20260709 13:08:55.144846 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 216036us
I20260709 13:08:55.133692 31060 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.134701 31254 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:55.194811 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:55.197739 31060 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.197858 31256 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.346s
I20260709 13:08:55.198740 31121 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:55.199131 31121 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:55.199492 31238 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.200007 31238 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.199965 31121 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.201488 31121 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:55.201843 26608 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:55.202008 31238 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:55.202864 31246 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
W20260709 13:08:55.203981 31262 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:08:55.163486 30584 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:55.205641 31266 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:55.207831 30982 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:55.208269 30982 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:55.208812 31122 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:55.211683 31264 raft_consensus.cc:2764] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:55.213677 30982 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:55.221453 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.086774 31257 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:08:55.218767 31082 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:55.279598 30768 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.003s
I20260709 13:08:55.279953 31121 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.278968 31215 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.303624 26752 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:55.306957 31121 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.309123 31121 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.309720 31252 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:55.317589 26687 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:08:55.317414 31060 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:55.319020 30696 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.000s
W20260709 13:08:55.320333 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 299911us
W20260709 13:08:55.321065 30867 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.000s
I20260709 13:08:55.321585 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:55.321445 30867 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.322345 30584 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:55.319653 26683 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.000s
I20260709 13:08:55.326783 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:55.286787 30952 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:55.332289 26684 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:55.323438 30867 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.297070 31238 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:55.399196 26685 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:55.430544 26604 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:55.434801 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:55.440092 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 107627us
I20260709 13:08:55.454509 26611 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:55.297567 31257 consensus_queue.cc:1243] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:55.470845 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.005s	sys 0.054s
W20260709 13:08:55.471243 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.005s	sys 0.054s
W20260709 13:08:55.471515 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 688001us
I20260709 13:08:55.471591 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1691) took 1108 ms. Trace:
I20260709 13:08:55.388628 30768 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.319480 30696 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.480518 26682 rpcz_store.cc:276] 0709 13:08:54.319027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.321123 (+  2096us) service_pool.cc:224] Handling call
0709 13:08:54.464066 (+142943us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:08:55.427623 (+963557us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:55.427798 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615036032}
I20260709 13:08:55.490846 31150 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:55.339147 30834 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.409874 30951 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.491437 31150 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.491801 30951 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.493590 31150 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.493675 30951 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.494108 31150 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.494179 30951 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.494679 30951 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.497169 31257 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:55.490557 30768 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.497656 30696 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.498306 30696 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:55.498754 30696 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:55.499359 30768 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.494647 31150 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:55.503192 26650 leader_election.cc:336] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.571s (SENT)
I20260709 13:08:55.503763 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:55.426515 31206 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.504650 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49687.2us
I20260709 13:08:55.451588 31060 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.329344 31215 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.432336 31121 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:55.501121 31251 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:55.441454 31238 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:55.518296 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 323846us
W20260709 13:08:55.518189 27313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.029s
W20260709 13:08:55.501561 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 471988us
W20260709 13:08:55.546597 27313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.029s
W20260709 13:08:55.543787 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 488909us
I20260709 13:08:55.550681 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:55.525379 31264 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:55.561908 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58756us
W20260709 13:08:55.564827 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45823.7us
I20260709 13:08:55.567392 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:55.564419 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48421.9us
I20260709 13:08:55.497694 31257 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.598564 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.599133 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.601985 27319 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:55.599920 27312 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 7 LEARNER]: Advancing to term 9
I20260709 13:08:55.542791 31202 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:55.606801 31268 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:08:55.610132 27312 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 9 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:55.499619 30696 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.550673 31121 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.549386 31085 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.527884 31114 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:08:55.517422 31206 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.669700 31082 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.670176 31082 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.670274 31206 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.562799 30584 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:55.612187 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:55.615586 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.671546 26754 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:08:55.672188 30963 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.003s
I20260709 13:08:55.616792 26760 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:55.672611 30963 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.616035 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.674031 26761 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:55.674671 30963 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.601296 30867 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:55.623782 31214 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.553658 31060 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:08:55.676721 31214 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:55.569264 31254 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:08:55.588076 31270 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:55.678200 31270 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.616067 31286 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:55.631199 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 2995) took 1007 ms. Trace:
I20260709 13:08:55.589169 31264 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.633880 31215 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:55.654853 30951 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:55.634558 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67266.5us
I20260709 13:08:55.635299 30971 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:55.692207 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.693045 26682 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.693948 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:55.696084 26683 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:55.697490 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.702106 26680 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:55.703640 26686 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:55.635303 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66198.2us
I20260709 13:08:55.636859 31275 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.637629 31296 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:55.637974 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:55.710250 26753 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.638250 31114 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:55.640496 31150 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:55.659377 31121 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:55.616350 31261 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:08:55.660072 31144 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:55.661375 31213 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.002s
W20260709 13:08:55.746043 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 198947us
I20260709 13:08:55.706773 31242 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.598610 31280 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:55.641373 31273 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:55.671625 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59523.5us
I20260709 13:08:55.625234 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.624905 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:55.640870 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:55.680990 26679 rpcz_store.cc:276] 0709 13:08:54.623457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.623566 (+   109us) service_pool.cc:224] Handling call
0709 13:08:54.627655 (+  4089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.654643 (+ 26988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.654672 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.681175 (+ 26503us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.022162 (+340987us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.022201 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.022267 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.630999 (+608732us) raft_consensus.cc:1685] finished
0709 13:08:55.631017 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.631144 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14811,"thread_start_us":326283,"threads_started":1,"wal-append.queue_time_us":500023}
I20260709 13:08:55.716006 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:55.716358 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:55.716989 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.614058 31272 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.658015 31088 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:08:55.762526 26756 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:55.762725 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 121930us
W20260709 13:08:55.732825 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 220536us
I20260709 13:08:55.741110 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:55.652010 31257 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.632975 31238 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.688318 30982 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:55.667250 31200 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.000s
I20260709 13:08:55.680440 31270 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:55.753680 26755 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:55.752468 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:55.746476 31278 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.762173 26754 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:55.744642 31281 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.002s
I20260709 13:08:55.802491 26758 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:55.769305 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.724967 31275 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.723971 31114 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:55.709509 30765 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:08:55.751080 30971 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.760946 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:55.828315 26753 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:55.729812 31239 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.769345 26611 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:55.800462 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.796105 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.803725 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.817878 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.844551 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:55.817878 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.845124 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:55.800040 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.845867 26756 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:55.810477 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.820981 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:55.846923 26679 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:55.789551 30768 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:55.752661 31213 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.840171 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:55.837864 31279 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:08:55.781868 31215 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:55.748484 31252 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:08:55.822352 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69956.9us
I20260709 13:08:55.842278 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:55.836704 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70044us
I20260709 13:08:55.821679 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:55.848675 27321 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:55.804817 31280 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:55.840003 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.850035 27317 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:55.851361 27318 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:55.806934 31200 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:08:55.860793 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:55.781466 31088 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.764456 31242 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.822842 31256 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.837479 31085 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.898687 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 284987us
I20260709 13:08:55.867491 26752 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:55.852833 31070 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.791082 31206 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:08:55.867962 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:55.869288 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:55.837515 31004 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:55.889178 26681 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:55.810792 30951 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.810775 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:55.907027 26604 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:55.848349 31144 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:55.894815 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:55.910852 26609 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:55.792793 31282 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:08:55.897396 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.864218 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:55.901830 27314 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:55.781924 31272 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.913913 26611 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:55.914038 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49895.6us
I20260709 13:08:55.904937 26679 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:08:55.905556 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:55.844159 30971 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.848568 31239 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.915076 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:55.768944 31273 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.913462 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:55.934906 26681 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:55.936156 26609 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:55.936184 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:55.926218 26680 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:55.937777 26608 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:55.938594 26680 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:55.934696 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:55.820261 31278 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.876017 30768 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.947625 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:55.948331 26611 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:08:55.950261 26650 leader_election.cc:336] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.838s (SENT)
I20260709 13:08:55.950676 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:55.898558 31097 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:55.952186 26757 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:08:55.932088 31254 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:55.917411 31284 raft_consensus.cc:2764] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:55.939385 31269 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.919163 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112493us
I20260709 13:08:55.903324 31256 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.965569 31250 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.918151 31201 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:55.937402 31121 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:55.907095 31070 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.980082 26678 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
W20260709 13:08:55.964465 31298 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:08:55.916771 30951 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.949432 31150 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:55.906894 31085 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.890511 31280 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:55.949571 31114 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:55.986050 31213 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:08:55.913465 31299 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.261s
I20260709 13:08:55.958729 31254 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.057220 26682 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:55.983242 31257 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:56.027081 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76846.1us
I20260709 13:08:56.064038 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.069993 26683 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:08:56.051584 31088 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.051740 31200 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:56.058120 31121 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:56.053683 31264 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.054576 31150 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.070437 31254 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.106324 31175 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.122889 31175 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:56.122473 31263 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.960s	user 0.004s	sys 0.014s
I20260709 13:08:56.125177 31175 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.125510 31242 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.125779 31175 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:56.127097 31242 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:56.106596 30696 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.129446 31315 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:56.046253 31250 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.132788 31250 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.134557 31280 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.135684 31256 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.136718 31278 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:56.115032 31200 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.137099 31275 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:56.138082 31239 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.138260 31309 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.138875 31082 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.060132 31269 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.140789 31085 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.140939 31082 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.141752 31272 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:56.142935 31313 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.088s	user 0.000s	sys 0.004s
I20260709 13:08:56.147001 31269 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.148612 31070 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.150105 31070 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.150568 31070 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.155992 30768 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.156848 31121 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:56.162111 31304 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 13:08:56.163885 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.053716 31097 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:56.167999 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.169826 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.170948 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.171128 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.172056 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.172420 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.173883 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.174585 26606 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:56.175527 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.171856 26611 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:56.183007 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.127490 31242 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.186539 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.187882 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.188272 26603 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:08:56.189141 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 321303us
I20260709 13:08:56.189419 26603 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:56.189903 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.190943 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.191274 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:56.191591 26608 raft_consensus.cc:2376] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9. Re-sending same reply.
I20260709 13:08:56.187196 26687 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:56.122215 31150 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.192631 26687 pending_rounds.cc:85] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:08:56.196101 26687 pending_rounds.cc:107] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:56.196434 26687 raft_consensus.cc:2889] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.194459 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.197181 26610 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:08:56.191545 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.198361 26605 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:56.138878 31200 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:56.202239 31271 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:56.202118 31285 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:56.202797 31271 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.204813 31271 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.205384 31271 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:56.205777 31271 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:56.177367 31269 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:56.165644 31097 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.180655 31309 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.178687 31207 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:08:56.199457 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 95051.6us
I20260709 13:08:56.216161 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.209506 26607 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:56.185247 31082 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.201691 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.223351 26611 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:56.223721 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.182140 31215 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:56.228086 26755 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:56.221464 26604 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:56.230391 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.222177 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:56.230856 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.224337 26605 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:56.197311 31122 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.234440 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.235117 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.236407 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.237188 26681 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:56.238215 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.235255 26680 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:56.239734 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.239909 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.240298 26680 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:56.240247 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.238790 26681 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:56.244743 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:56.244242 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.245471 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.202119 31295 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.247658 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:56.249439 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.250504 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.246469 26681 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:08:56.251252 26682 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:56.206530 31271 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.265556 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:56.258195 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95832.7us
I20260709 13:08:56.267529 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.267653 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.266969 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:56.201037 30885 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:08:56.275228 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44920.2us
I20260709 13:08:56.283249 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.271181 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.211344 31206 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:56.228241 30971 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.297118 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.253504 31282 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:56.229837 31082 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.299010 31283 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.225412 31207 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:56.299863 31305 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.002s
I20260709 13:08:56.274493 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.297226 31213 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.275748 31295 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.297575 31173 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.241747 31122 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.303534 31270 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.304680 31239 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.305853 31071 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:56.307055 31318 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.214752 30952 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:08:56.352010 31318 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.248620 31287 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:56.312729 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.353089 31082 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:56.254251 31272 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:56.354291 31318 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.354254 31272 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.299437 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:56.355839 26680 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.316655 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:56.356688 31207 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.328506 31273 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.222955 31309 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.340754 31070 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.297996 31242 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.360921 31242 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.343032 31208 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:56.340859 31122 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.328372 31097 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.365224 31097 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.339567 30951 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:56.324186 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53077us
I20260709 13:08:56.366492 31320 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:56.328547 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.300730 31215 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.338855 26607 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:56.273783 31306 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:56.339454 26761 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:56.338287 31321 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:56.372337 31321 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.343292 31282 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:56.293385 31278 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:56.222259 31269 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.345778 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.378741 26680 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:56.381645 26758 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:56.372802 31321 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.381879 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.338871 26726 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.344135 31173 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.370958 31254 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:56.375957 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 73953.5us
W20260709 13:08:56.379904 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 135731us
I20260709 13:08:56.388208 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.393600 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:56.366950 31320 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.379153 31285 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:56.397197 26650 leader_election.cc:336] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.675s (SENT)
I20260709 13:08:56.412786 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:56.397459 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104686us
W20260709 13:08:56.417580 26650 leader_election.cc:336] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.716s (SENT)
W20260709 13:08:56.398386 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.419219 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:56.398507 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59712.8us
W20260709 13:08:56.401549 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 237733us
I20260709 13:08:56.403530 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.348083 31295 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.396342 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:56.424641 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:56.425058 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.417413 27318 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:56.423866 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.425639 26757 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:08:56.427003 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.427062 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:56.428645 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.435889 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.441586 26684 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:08:56.435165 26757 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:56.443189 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.380614 31180 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:56.434851 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.444235 31273 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.444464 31077 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:56.448848 31270 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.416989 31285 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:56.395442 31207 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:08:56.451943 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.417219 30885 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:56.453029 31173 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.455331 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.445294 31214 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:56.471922 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.473416 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.465831 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:08:56.476465 26681 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.426476 31213 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.462637 30963 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:56.500197 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:56.473762 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43574.7us
I20260709 13:08:56.505865 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.485157 31295 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.490554 31328 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:56.506789 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51526.4us
I20260709 13:08:56.432796 31239 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:08:56.510541 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.510917 31302 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:56.511724 31323 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:56.509137 31082 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:56.504379 31278 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:56.506085 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:56.525193 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.539539 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.527107 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.499275 30963 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.568679 30768 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.519649 31272 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:56.528561 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.541716 26761 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:56.508939 30951 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.509186 31214 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:56.507385 31090 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:56.476879 31077 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.524561 31275 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:56.549523 31082 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.601716 31082 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:56.551972 31144 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.002s
I20260709 13:08:56.524217 31328 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.606362 31328 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.611019 26679 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:56.611771 31310 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:56.612321 31310 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.612743 31310 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.616748 31275 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.618067 31275 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.619861 31297 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:56.502142 31320 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.622298 31320 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.576028 31256 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.625877 31256 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.626349 31256 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.630347 31070 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:56.630764 31070 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:56.631536 31070 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.552656 31324 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.558784 31285 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.560847 26605 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.562655 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:56.635617 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 73065.9us
I20260709 13:08:56.636369 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.569245 30768 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.502251 31283 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:56.527783 31302 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.571085 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.571399 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.534662 31250 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.534886 31206 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.580526 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.572285 31180 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:56.576191 30951 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:56.581236 31214 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.574858 31207 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:08:56.575150 31085 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:08:56.594846 31331 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:56.501976 31282 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.595870 31326 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.596292 30584 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.678117 30584 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.679445 31309 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.664819 31238 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.680166 31238 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.680259 30584 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.680567 31238 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.655896 31250 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.541337 31278 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.611546 26679 pending_rounds.cc:85] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:08:56.684556 26679 pending_rounds.cc:107] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:56.684836 26679 raft_consensus.cc:2889] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.572480 30952 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:56.648972 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 77968.6us
W20260709 13:08:56.659830 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88536.8us
I20260709 13:08:56.692296 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.640813 31144 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.635040 31324 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:56.654346 31302 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.705427 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.676416 30768 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.671958 31207 consensus_queue.cc:1243] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:56.670468 31121 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.573419 31325 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:08:56.656181 31206 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.665789 30951 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.695115 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:56.696291 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.702143 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.599865 31334 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.647459 30885 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:56.709739 30768 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:56.707598 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.686321 31278 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.686488 31250 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.710808 26681 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:56.633200 31090 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.713383 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.716995 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.716923 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.718222 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.720499 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:56.675580 31070 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.730020 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:56.709399 31150 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.008s
I20260709 13:08:56.766959 26685 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:56.711848 31309 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:56.720192 26686 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:56.755869 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.755281 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:56.706743 31324 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.753798 30768 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.711702 31254 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.768138 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:56.687428 31097 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.716064 31206 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.707428 31269 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.677593 31122 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.777573 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.784528 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.756737 31200 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.787384 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.791924 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.800868 31122 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.762374 31121 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.801602 31121 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.806851 30765 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.771921 31327 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:56.808552 31295 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:56.809118 31295 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.810575 26678 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:56.811367 30768 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.791494 26681 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:56.820116 31090 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:56.821848 31114 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.772615 31309 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:56.841938 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.788193 31270 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:56.823997 30765 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.822773 30885 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.811249 31121 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.849043 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3018) took 1052 ms. Trace:
I20260709 13:08:56.773818 31150 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.854408 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.861220 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.855551 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.858132 26679 rpcz_store.cc:276] 0709 13:08:55.796775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.917622 (+120847us) service_pool.cc:224] Handling call
0709 13:08:55.939764 (+ 22142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.700239 (+760475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.848803 (+148564us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000b4354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:56.848980 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542623616}
I20260709 13:08:56.839285 31309 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.864274 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.872839 26611 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:56.864977 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.866180 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.866460 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:56.874007 26612 raft_consensus.cc:2376] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11. Re-sending same reply.
I20260709 13:08:56.875407 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:56.844031 31270 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:56.883949 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:56.884936 26607 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:08:56.880591 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 244272us
I20260709 13:08:56.887382 31270 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.891978 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.892982 31257 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:56.893486 31257 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:56.894551 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.897078 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.899493 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.900076 26680 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:56.900853 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.897709 26681 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:08:56.878432 31242 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.001s
I20260709 13:08:56.904608 26761 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.870880 31301 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.875278 31297 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.905068 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.906493 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.908242 26679 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:56.798409 31321 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.850544 31302 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.884557 31334 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.910372 26682 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:56.912438 26758 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:56.887064 31207 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.886200 30765 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.914726 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:56.894335 31257 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.916993 26681 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:56.922199 31150 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:56.925433 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.878273 30867 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:56.875631 31337 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:56.915562 31077 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:56.904418 31326 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.940471 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.883658 31238 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:56.928370 31336 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:08:56.950860 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.916458 31207 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:56.954718 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:56.955730 26760 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:56.894009 31310 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:56.972891 26759 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:56.935624 30765 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.971383 31207 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.971702 31077 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.995141 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.998315 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.016866 26605 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:57.017730 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:57.019250 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:56.972404 31256 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:56.994771 26603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:57.016009 31325 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:57.039773 26603 raft_consensus.cc:606] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:57.049706 26603 raft_consensus.cc:614] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.018838 31352 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.053529 30765 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.054356 30765 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:57.056202 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57124.2us
I20260709 13:08:57.057204 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:57.018646 31321 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.029922 31150 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.063644 31150 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.063711 26683 pending_rounds.cc:85] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 4
I20260709 13:08:57.066288 31150 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.068145 31278 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:57.069131 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 536321us
I20260709 13:08:57.070261 31278 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.070660 31310 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:57.071137 31060 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.067066 26683 pending_rounds.cc:107] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:08:57.072113 26683 raft_consensus.cc:2889] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.054792 30765 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.066262 31295 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.075598 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:57.047497 31090 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:57.082728 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:57.049583 31325 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:57.088411 31353 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:57.080875 31077 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:57.048848 31358 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:57.038161 31269 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:57.062307 31302 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.079757 30765 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.078683 31150 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:57.084580 31121 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.092631 31325 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:57.062666 31352 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:57.113922 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94730.2us
I20260709 13:08:57.115346 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:57.095369 31077 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:57.121690 26757 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:57.126474 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.127758 26606 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:57.127774 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.113900 31269 consensus_queue.cc:1243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:57.109949 31358 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.130649 26610 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:57.116663 31282 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.112951 31365 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:57.140565 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.141196 26607 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:57.143616 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.123909 31238 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.163076 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.164240 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.166944 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:57.169534 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54286.9us
I20260709 13:08:57.172943 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.173635 26608 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.174533 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.175105 26603 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:57.175974 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.173501 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.180254 26610 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:57.177747 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.181358 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.182523 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.182808 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.185417 26606 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:57.154810 31269 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.189561 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.169387 31318 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:57.237605 26608 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:57.142243 31365 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.241024 31295 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.241525 26606 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:57.189843 31345 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:08:57.241909 26606 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.241932 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.243762 31269 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:57.245860 31144 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.003s
I20260709 13:08:57.246446 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:08:57.248183 31359 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:08:57.249063 31364 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:57.148003 31282 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.254174 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:57.253654 26606 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.189749 31121 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:57.267701 31121 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.268286 31121 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.189594 31302 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:08:57.242352 31318 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.273324 31318 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.259927 31295 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.257076 26756 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.167606 31077 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:57.257917 31354 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:57.258498 31206 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.260805 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.263290 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e89d788bee4a128b18985e582217d9"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:08:57.256357 31256 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.326200 26754 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:08:57.324821 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64106.8us
I20260709 13:08:57.262060 31144 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:57.276475 31295 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.255949 31358 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.260990 30951 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.329699 31283 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:57.341307 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:57.334491 31328 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:08:57.331046 31302 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.324229 31309 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.360816 26680 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:57.334491 31206 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.365760 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 615) took 1516 ms. Trace:
I20260709 13:08:57.366149 27316 rpcz_store.cc:276] 0709 13:08:55.846779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.863185 (+ 16406us) service_pool.cc:224] Handling call
0709 13:08:55.893398 (+ 30213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.100556 (+207158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.100587 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:56.100626 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:56.100661 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.362528 (+1261867us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001b26d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:57.362572 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.362719 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475964160}
I20260709 13:08:57.359579 31283 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:57.378785 31365 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:57.379109 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:57.379861 27315 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:57.382668 31325 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.360116 31302 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.385828 31302 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.389663 31325 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.390813 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.338238 31270 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.355376 31328 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.393368 26756 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:57.400988 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:57.407503 27285 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.650s (SENT)
I20260709 13:08:57.412025 31325 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.412673 31325 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.413086 30765 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.414908 31325 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.416754 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:57.417994 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.418529 26684 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.419389 31269 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:57.424511 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.379357 31283 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.425168 26686 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.415243 30765 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.431928 31369 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.432508 31278 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.432574 31369 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.433197 31278 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.433847 26684 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:57.434753 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.435304 31278 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.435967 26684 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:57.437789 26684 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:57.442885 31250 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.672s	user 0.004s	sys 0.005s
I20260709 13:08:57.454787 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.455545 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.458493 26684 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.460569 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.459960 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.460875 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.466972 26685 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:57.387337 31318 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.468775 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.435354 31369 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.469524 26685 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:57.446818 31256 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.459411 31278 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.483729 26608 raft_consensus.cc:2368] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:57.443475 31250 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.480523 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:57.496726 26756 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:57.464570 31207 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.478317 30765 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.492654 31295 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.473371 31071 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:57.499125 31308 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:57.499166 31201 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.500263 31366 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:57.499265 31320 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:08:57.495975 31114 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.674s	user 0.004s	sys 0.008s
I20260709 13:08:57.499799 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:08:57.556922 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57254us
I20260709 13:08:57.557626 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.561800 31201 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:57.562628 31356 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.501s	user 0.009s	sys 0.000s
W20260709 13:08:57.528388 31368 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:57.503378 31273 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:57.565234 31273 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:57.528407 31324 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.010s
I20260709 13:08:57.529735 31071 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.571475 26609 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:08:57.577369 31207 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:57.578164 26761 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:57.486829 31351 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:08:57.580245 31351 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:57.579912 31071 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.580621 31351 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.581025 31351 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:57.496932 31278 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.587018 31309 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.587958 31309 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:57.550779 31366 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.552094 30765 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:57.553566 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:57.483700 31256 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.588660 31097 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:57.537007 26684 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:08:57.555160 30951 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.541635 31308 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:57.599382 31309 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.760466 31308 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.756470 26756 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:08:57.741770 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 188273us
I20260709 13:08:57.605317 31302 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.742172 31097 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.772701 26686 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:57.759541 31309 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.593705 31324 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:57.780462 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 222897us
I20260709 13:08:57.783826 26756 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:57.784111 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.774217 31282 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:57.789152 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.793248 26681 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:57.774720 31302 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:57.821350 31121 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.000s
I20260709 13:08:57.818989 31173 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.818481 31388 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:57.832928 31282 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.847352 31386 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:57.847920 31386 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.848786 31386 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.849274 31114 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:57.849800 31114 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.850615 31114 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.840291 31173 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.857719 31173 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:08:57.858264 31382 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:57.862265 31352 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.864495 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 513) took 1076 ms. Trace:
I20260709 13:08:57.864878 26681 rpcz_store.cc:276] 0709 13:08:56.788320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.944037 (+155717us) service_pool.cc:224] Handling call
0709 13:08:56.971719 (+ 27682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.795076 (+823357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.864275 (+ 69199us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54000c3fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:57.864441 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888803584}
I20260709 13:08:57.869366 31285 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:57.874320 31378 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:57.874994 31308 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:57.875571 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86553.1us
I20260709 13:08:57.878242 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.878849 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.879386 26684 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.841316 31388 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.899760 31301 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:57.899639 30963 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.900717 31301 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.900945 31388 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.901261 31301 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.901844 31318 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.903923 31264 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:57.904284 31264 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:57.905055 31264 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.906121 31264 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.908875 31270 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:57.910403 31384 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:57.912483 30951 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:08:57.912874 30951 raft_consensus.cc:1068] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:57.913115 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.913558 31278 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.914158 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.915179 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:57.915180 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.915508 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.916014 30768 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:57.916682 26678 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:57.917598 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.915243 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.910326 31328 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.919674 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:57.921506 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.832567 31121 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.925403 26684 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:57.927027 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.903437 31301 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.967989 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 498) took 1178 ms. Trace:
W20260709 13:08:57.934962 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.968426 26759 rpcz_store.cc:276] 0709 13:08:56.789191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.833231 (+ 44040us) service_pool.cc:224] Handling call
0709 13:08:56.842939 (+  9708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.979963 (+137024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.967796 (+987833us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400201054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:57.967941 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298412416}
I20260709 13:08:57.970315 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1830) took 1106 ms. Trace:
I20260709 13:08:57.970428 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.970815 26605 rpcz_store.cc:276] 0709 13:08:56.864203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.864326 (+   123us) service_pool.cc:224] Handling call
0709 13:08:56.886478 (+ 22152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.017384 (+130906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.970094 (+952710us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540017b454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:57.970254 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267552512}
I20260709 13:08:57.971248 31369 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:57.971495 31301 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:57.972266 31369 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:57.972469 31301 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:57.972929 31301 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:57.973220 31327 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:57.978610 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.935501 31387 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:08:57.936257 26678 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:57.934974 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:57.980801 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:57.982270 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:57.937650 31302 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.886986 31250 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.939219 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:57.942330 30765 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.943123 31324 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.972481 26605 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:57.943773 26612 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:57.991277 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:57.918707 31256 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.984687 31257 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:08:57.952374 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:57.999749 26683 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:57.838663 31273 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.961450 31121 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:57.962082 26679 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:57.919170 31282 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.002022 31273 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:58.002780 31283 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.987356 31285 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.995644 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:57.918848 31366 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:57.984218 31238 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.979605 31337 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:57.998265 31301 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:57.972815 31369 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.973629 31327 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:57.998970 30765 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.002087 31367 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:57.947317 31351 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:57.997879 26756 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:58.007494 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:58.034397 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.010413 26612 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:58.003230 31282 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:58.022207 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.024502 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.032688 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:58.032249 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:58.035280 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:57.997541 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.003270 31302 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:58.041134 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:58.038511 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:58.042634 26612 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.003294 31283 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.020059 31121 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:58.065903 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:58.067116 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 242183us
I20260709 13:08:58.036023 31367 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:58.077176 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.022225 31285 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.022210 31238 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.081218 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:58.062624 31301 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.042371 31334 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:08:58.083427 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43595.2us
I20260709 13:08:58.091300 27316 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:58.091933 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:58.083698 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.092902 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:58.087204 26612 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:08:58.025465 31337 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.095054 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:58.095769 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:58.079254 31250 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.102141 26753 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:58.101325 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:58.074805 31121 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:58.040975 30765 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.101217 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:58.112701 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.114140 26605 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14.
I20260709 13:08:58.116525 26612 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:58.116672 30768 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:58.118040 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:58.116518 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:58.120793 26612 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.064443 31302 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.123378 26759 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:58.077524 31272 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:58.125726 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.108928 31366 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.088745 31097 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.089444 31360 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:58.118695 31318 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:58.108227 30951 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:58.081889 31327 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.130681 31309 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.157263 31327 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.158325 31309 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.100579 31369 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.153611 31360 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.153270 31121 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.153815 31318 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.166528 31318 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:58.114437 31257 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:58.156296 30765 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:58.170694 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.171326 26686 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.171651 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.097430 31334 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.117013 31250 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.139073 31366 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:58.176734 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117485us
I20260709 13:08:58.178483 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.180725 26687 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:08:58.180239 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.192444 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:58.195420 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.196089 26753 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.197027 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.202824 26756 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:58.203617 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.205473 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.206650 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.208375 26756 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:58.209487 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.210687 26756 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:58.211862 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:58.225085 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.227027 26758 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:58.177310 31293 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:58.188777 31366 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.228022 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:58.229049 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:58.243839 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.244669 26687 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.260689 27315 raft_consensus.cc:2410] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:58.268751 26753 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:08:58.270159 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.257921 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1834) took 1109 ms. Trace:
I20260709 13:08:58.273198 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:58.271574 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.311790 26753 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.328359 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.329216 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.328645 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.231499 26686 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:58.333724 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.334291 26686 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:08:58.335877 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.336818 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.337508 26686 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:58.224561 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.328919 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:58.272397 26752 rpcz_store.cc:276] 0709 13:08:57.148833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.485700 (+336867us) service_pool.cc:224] Handling call
0709 13:08:57.485989 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:57.486330 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.486359 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:57.486879 (+   520us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.767639 (+280760us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:58.063454 (+295815us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.257455 (+194001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.257566 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.257627 (+    61us) raft_consensus.cc:1685] finished
0709 13:08:58.257646 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.257840 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":349655,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2983,"raft.queue_time_us":30872,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8848,"thread_start_us":740647,"threads_started":3,"wal-append.queue_time_us":293655}
I20260709 13:08:58.333214 26605 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:08:58.340257 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.340773 26752 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:58.328914 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 127444us
I20260709 13:08:58.227079 31392 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.368386 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.356812 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.360217 26753 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:58.371001 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.371819 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.372262 26686 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:58.372934 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.236934 26612 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:58.377415 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:58.380745 26687 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:58.381947 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.232544 31293 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:58.385181 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.389961 26752 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:58.447136 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.273343 31324 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:58.446033 26685 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:58.409875 30768 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:58.412072 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:58.413887 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:58.414804 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 141731us
I20260709 13:08:58.463009 30768 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.465879 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:58.326632 31238 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:58.330993 31299 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:58.467573 31299 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.324625 31278 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:58.349687 31378 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:08:58.468206 31299 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.386566 31270 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.425542 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.426088 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.426980 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:58.429952 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.364988 31351 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.475689 26758 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:58.328884 30951 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 13:08:58.439144 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.448866 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.429427 31391 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:58.421855 31283 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.469897 26685 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:58.378213 27314 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:58.468842 31278 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.480110 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.415482 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.484995 26686 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:58.485217 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.486692 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.435305 31285 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:58.490581 26686 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:58.498019 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.499487 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.499773 26686 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.500357 26752 raft_consensus.cc:2368] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:58.501304 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:58.481204 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123547us
I20260709 13:08:58.445052 31388 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.494441 26685 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:58.502390 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:58.506142 26758 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:58.508493 26758 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:58.509939 26758 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.416270 31392 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.514217 26686 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:58.522087 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.502934 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:58.487972 26687 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:58.476672 31287 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:58.525485 26685 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:58.480934 30951 consensus_queue.cc:1243] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:58.518079 31285 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.546254 31077 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.565420 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 499) took 1725 ms. Trace:
I20260709 13:08:58.433315 31402 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:08:58.511402 31361 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.329s	user 0.003s	sys 0.002s
I20260709 13:08:58.565855 26757 rpcz_store.cc:276] 0709 13:08:56.839804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.839987 (+   183us) service_pool.cc:224] Handling call
0709 13:08:56.857747 (+ 17760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.123758 (+266011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.539900 (+1416142us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002dbed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:58.565349 (+ 25449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604654464}
I20260709 13:08:58.497252 31278 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:58.575189 31395 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:08:58.577039 31326 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.580312 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1847) took 1252 ms. Trace:
I20260709 13:08:58.513945 31283 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.586637 26603 rpcz_store.cc:276] 0709 13:08:57.327741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.327902 (+   161us) service_pool.cc:224] Handling call
0709 13:08:57.334854 (+  6952us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:57.340835 (+  5981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.340867 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:57.972792 (+631925us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:08:57.973248 (+   456us) log.cc:844] Serialized 52 byte log entry
0709 13:08:58.258829 (+285581us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:58.258886 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.258981 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.579979 (+320998us) raft_consensus.cc:1685] finished
0709 13:08:58.579998 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.580246 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2275,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":1862,"spinlock_wait_cycles":2892032,"thread_start_us":285151,"threads_started":1,"wal-append.queue_time_us":488228}
W20260709 13:08:58.569893 31381 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:08:58.593748 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127953us
I20260709 13:08:58.527240 31287 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:58.495390 31270 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.597294 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.566241 31097 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:58.632299 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:08:58.598857 31413 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.665485 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:58.665922 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 324555us
I20260709 13:08:58.622574 31287 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:58.666633 31121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.052s	sys 0.147s
I20260709 13:08:58.606786 31250 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.571014 31293 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.648640 31283 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.670702 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.602149 31326 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.668457 26757 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:08:58.673888 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 290174us
I20260709 13:08:58.661247 31337 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:58.665510 31173 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.011s
I20260709 13:08:58.678648 31293 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.684453 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:58.686342 26605 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:58.668332 31414 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:58.689431 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 509228us
I20260709 13:08:58.671041 31334 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:58.681298 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:58.688726 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.690460 31283 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:58.683353 31121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.052s	sys 0.147s
I20260709 13:08:58.712605 31392 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.671876 31413 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.714304 31402 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:58.683156 31238 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.719874 31302 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:58.722072 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1724) took 1852 ms (client timeout 1821 ms). Trace:
I20260709 13:08:58.723980 26605 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:58.726145 31326 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.703454 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.701006 31250 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:58.737238 31175 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.772109 26605 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:58.741387 26680 rpcz_store.cc:269] 0709 13:08:56.869295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.900619 (+ 31324us) service_pool.cc:224] Handling call
0709 13:08:58.721866 (+1821247us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54003c1754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:58.721994 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056572672}
I20260709 13:08:58.774227 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.775142 26680 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:08:58.766455 31337 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:08:58.776403 31175 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.777578 31422 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:58.778824 31175 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.779098 31422 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:58.744956 31324 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.786381 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.805588 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:58.804893 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 509) took 2358 ms. Trace:
I20260709 13:08:58.806495 26680 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:08:58.805296 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.806273 26682 rpcz_store.cc:276] 0709 13:08:56.442059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.442206 (+   147us) service_pool.cc:224] Handling call
0709 13:08:56.514991 (+ 72785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.910756 (+395765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.367131 (+456375us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54000c44d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:58.799948 (+1432817us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54000c44d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:58.800090 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075569152}
I20260709 13:08:58.804612 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:58.808284 26611 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 7: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:58.808553 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:58.808297 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:58.810811 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.738933 31402 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:58.817335 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 113970us
I20260709 13:08:58.818365 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:58.811376 26680 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:58.815001 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.826197 26680 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:58.792637 31327 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:08:58.824635 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 518) took 1714 ms. Trace:
I20260709 13:08:58.828408 26686 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:58.824504 31299 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.830946 26687 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:58.793633 31406 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.787739 31408 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:58.833498 26577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.600s (SENT) [suppressed 11 similar messages]
W20260709 13:08:58.842206 26754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 491) took 2135 ms (client timeout 1650 ms). Trace:
I20260709 13:08:58.787937 31423 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.810132 31414 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.820200 31175 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.863443 31175 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.863888 31175 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.863651 31406 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.866367 31406 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:58.821313 31402 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.838260 27319 rpcz_store.cc:276] 0709 13:08:57.109771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.109911 (+   140us) service_pool.cc:224] Handling call
0709 13:08:57.116828 (+  6917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.242242 (+125414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.242282 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.242329 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:57.242367 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.824394 (+1582027us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:58.824441 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.824583 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287892224}
I20260709 13:08:58.819854 31326 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:58.779644 31422 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:58.843887 26760 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:58.842823 26754 rpcz_store.cc:269] 0709 13:08:56.707070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.707368 (+   298us) service_pool.cc:224] Handling call
0709 13:08:58.841984 (+2134616us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400138b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:58.842132 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314107776}
I20260709 13:08:58.828508 31337 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:58.792879 31334 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:58.851689 31408 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.828814 31420 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:08:58.879956 31420 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.880563 31424 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:58.880963 31424 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:08:58.881985 31420 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:58.881712 31424 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.882884 31424 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.794268 31324 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.856606 31413 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.856957 31283 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:08:58.857947 31366 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.002s
I20260709 13:08:58.858294 31423 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:58.871941 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.836186 31405 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:58.863044 31287 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.859187 31414 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:58.884382 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66721.3us
W20260709 13:08:58.888876 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.907653 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:58.908587 31283 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:58.908955 31283 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:08:58.909065 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2948) took 2739 ms (client timeout 2018 ms). Trace:
I20260709 13:08:58.909363 31283 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:58.909545 26609 rpcz_store.cc:269] 0709 13:08:56.169349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.169515 (+   166us) service_pool.cc:224] Handling call
0709 13:08:58.908857 (+2739342us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400162954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:58.908987 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3189698944}
I20260709 13:08:58.910868 31238 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:58.911281 31238 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:08:58.912833 31431 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:08:58.913663 26679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1731) took 1735 ms (client timeout 1600 ms). Trace:
W20260709 13:08:58.914059 26679 rpcz_store.cc:269] 0709 13:08:57.178429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.330895 (+152466us) service_pool.cc:224] Handling call
0709 13:08:58.913468 (+1582573us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001e9bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:58.913597 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401987840}
I20260709 13:08:58.916697 31299 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.917119 26603 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:58.918401 26603 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.921341 26609 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:58.925562 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92092.6us
I20260709 13:08:58.876472 31326 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.905827 31405 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:58.924683 26603 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:58.932125 26682 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:58.931082 31405 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.933224 31414 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:58.936760 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 110223us
I20260709 13:08:58.904068 31366 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:58.976389 31287 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:58.976212 31367 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.023625 26605 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:59.020082 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81648.4us
W20260709 13:08:59.021493 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76214.8us
I20260709 13:08:59.025339 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:08:59.030858 26724 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14.
I20260709 13:08:59.031194 26724 leader_election.cc:403] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.037535 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:58.976547 31408 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:58.944069 31238 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.089709 31238 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.090488 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.033190 31436 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:59.094727 31175 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:58.923295 31422 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.161284 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.176667 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.979848 31242 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.027794 31324 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.044185 31435 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:59.231364 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.036505 31367 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.238576 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.041599 31293 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.245841 26757 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:08:59.283680 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.233078 31278 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.004s
I20260709 13:08:59.228947 30982 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.331116 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:59.361361 26761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1830) took 2215 ms (client timeout 1698 ms). Trace:
W20260709 13:08:59.344539 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 72168.5us
W20260709 13:08:59.337078 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 296687us
W20260709 13:08:59.362164 26761 rpcz_store.cc:269] 0709 13:08:57.145498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.145649 (+   151us) service_pool.cc:224] Handling call
0709 13:08:59.361143 (+2215494us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540010fed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.361290 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944238336}
I20260709 13:08:59.338860 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:59.370688 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 508) took 1365 ms (client timeout 1606 ms). Trace:
W20260709 13:08:59.371142 26759 rpcz_store.cc:269] 0709 13:08:58.004839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.004999 (+   160us) service_pool.cc:224] Handling call
0709 13:08:59.370520 (+1365521us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b5400226354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.370632 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193050496}
I20260709 13:08:59.376654 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:08:59.325044 31422 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.377971 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:08:59.235033 31242 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:08:59.361291 31326 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.375372 31299 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.382913 31004 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.312439 31435 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.376538 31287 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:59.336959 30982 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.380276 31408 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.378919 31090 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:08:59.391290 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.331146 31278 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.406062 31441 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:08:59.408600 31201 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.410495 26603 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:59.421859 31396 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.977s	user 0.000s	sys 0.010s
I20260709 13:08:59.426744 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2967) took 1403 ms. Trace:
I20260709 13:08:59.433905 31270 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.437436 31358 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.438182 30963 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.427165 26605 rpcz_store.cc:276] 0709 13:08:58.023730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.826604 (+802874us) service_pool.cc:224] Handling call
0709 13:08:58.831310 (+  4706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.024085 (+192775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.426510 (+402425us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400064d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:59.426682 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441827072}
I20260709 13:08:59.439496 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.440618 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.441583 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:59.442127 31283 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.000s
I20260709 13:08:59.442143 26605 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:08:59.442690 31283 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.443140 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:08:59.445007 31376 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.868s	user 0.012s	sys 0.031s
W20260709 13:08:59.445518 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1849) took 2056 ms (client timeout 2234 ms). Trace:
W20260709 13:08:59.445937 26608 rpcz_store.cc:269] 0709 13:08:57.389026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.390518 (+  1492us) service_pool.cc:224] Handling call
0709 13:08:59.445321 (+2054803us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400088c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.445436 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211422976}
I20260709 13:08:59.446565 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1842) took 2271 ms. Trace:
I20260709 13:08:59.446909 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.447604 26608 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:59.448424 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.448925 26608 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:08:59.449882 26608 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:59.452083 31423 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.453596 31175 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.437954 31358 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.455842 26605 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:59.457585 31242 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.399554 31366 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.458885 31358 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.395126 31299 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:59.459299 31411 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.626s	user 0.006s	sys 0.013s
I20260709 13:08:59.461954 31299 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:08:59.461908 31429 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.614s	user 0.002s	sys 0.007s
I20260709 13:08:59.398624 31287 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.464923 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 558) took 1441 ms. Trace:
I20260709 13:08:59.465199 31287 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:59.465401 26612 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:08:59.466017 31351 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.466449 31351 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.470270 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.471067 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.471318 31442 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:59.472968 31412 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.473322 31404 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.473511 31412 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.473824 31404 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.475806 31404 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.476222 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 504) took 1913 ms. Trace:
I20260709 13:08:59.476693 26760 rpcz_store.cc:276] 0709 13:08:57.562515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.564515 (+  2000us) service_pool.cc:224] Handling call
0709 13:08:58.843522 (+1279007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.874663 (+ 31141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.475972 (+601309us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400138b50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.476148 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940566784}
I20260709 13:08:59.479532 31435 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.481251 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1759) took 1250 ms. Trace:
I20260709 13:08:59.481778 26685 rpcz_store.cc:276] 0709 13:08:58.230544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.535886 (+305342us) service_pool.cc:224] Handling call
0709 13:08:58.565606 (+ 29720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.632480 (+ 66874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.632551 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.632634 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:58.632743 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.480938 (+848195us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b54001261d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:59.481007 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.481175 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131852672}
I20260709 13:08:59.484606 31412 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.465345 27315 rpcz_store.cc:276] 0709 13:08:58.023250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.023429 (+   179us) service_pool.cc:224] Handling call
0709 13:08:59.464720 (+1441291us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54005406d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.464861 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506721664}
I20260709 13:08:59.485409 30982 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.393352 31405 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.487710 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.488265 31405 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:59.489748 26754 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:08:59.500892 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.508212 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.509819 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.447055 26607 rpcz_store.cc:276] 0709 13:08:57.174931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.186293 (+ 11362us) service_pool.cc:224] Handling call
0709 13:08:57.234566 (+ 48273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.242663 (+  8097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.242696 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.256305 (+ 13609us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.391166 (+134861us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:57.391205 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.391349 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.367527 (+1976178us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:59.446191 (+ 78664us) raft_consensus.cc:1685] finished
0709 13:08:59.446220 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.446476 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17377,"raft.queue_time_us":8045,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8632,"spinlock_wait_cycles":5140864,"thread_start_us":123995,"threads_started":1,"wal-append.queue_time_us":211958}
I20260709 13:08:59.514746 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:59.520792 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.521692 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.522321 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.522903 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:59.523064 26679 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:59.524071 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:59.524333 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 489829us
I20260709 13:08:59.403329 31004 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.494792 31404 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.524775 26678 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:59.526365 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:59.516516 31424 consensus_meta.cc:287] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 13:08:59.529294 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.529893 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:59.529304 26756 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:08:59.530613 26683 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:08:59.518093 31402 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.002s
I20260709 13:08:59.533466 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.537603 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.403865 31090 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.403152 31408 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.540356 26755 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 5
I20260709 13:08:59.540656 26755 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:08:59.533188 31404 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.540999 26755 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:08:59.541311 31306 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:59.541610 31090 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.541693 31306 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:08:59.542356 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.542676 31404 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:08:59.526165 30982 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:59.547022 31435 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:59.544024 30982 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.552110 31435 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.553514 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.554108 31435 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.554805 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.555471 26681 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:59.555801 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.556540 26687 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:08:59.557782 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 2969) took 1517 ms. Trace:
I20260709 13:08:59.549817 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:59.558245 26611 rpcz_store.cc:276] 0709 13:08:58.040614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.817942 (+777328us) service_pool.cc:224] Handling call
0709 13:08:58.832135 (+ 14193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.832375 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:58.840458 (+  8083us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.557165 (+716707us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b18003ec1a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a
0709 13:08:59.557382 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.557442 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:59.557506 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.557586 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.557720 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9502,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":66489216,"thread_start_us":111601,"threads_started":1,"wal-append.queue_time_us":102918}
I20260709 13:08:59.577816 26683 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:59.578969 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.579296 26650 leader_election.cc:400] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:59.582240 26650 leader_election.cc:403] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.582581 26679 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:59.584223 26683 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:59.543648 31351 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.582967 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:59.534893 31402 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.594552 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:59.596952 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1858) took 1365 ms. Trace:
I20260709 13:08:59.597190 30982 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.579954 31420 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.597375 26612 rpcz_store.cc:276] 0709 13:08:58.231072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.385104 (+154032us) service_pool.cc:224] Handling call
0709 13:08:59.596774 (+1211670us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.596893 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276840320}
I20260709 13:08:59.598027 31420 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:59.598493 31420 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.600162 26687 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:59.601198 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:08:59.601854 26687 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:59.602607 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:08:59.597211 31397 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.936s	user 0.010s	sys 0.000s
I20260709 13:08:59.605407 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1834) took 2739 ms. Trace:
I20260709 13:08:59.605759 26604 rpcz_store.cc:276] 0709 13:08:56.866437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.866557 (+   120us) service_pool.cc:224] Handling call
0709 13:08:56.866948 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.874490 (+1007542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.874520 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.874999 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.087859 (+212860us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:58.087912 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.917564 (+829652us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400065c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:08:58.917627 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.596639 (+679012us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:08:59.605197 (+  8558us) raft_consensus.cc:1685] finished
0709 13:08:59.605218 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.605350 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5618,"raft.queue_time_us":13753,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":30941,"spinlock_wait_cycles":2425861248,"thread_start_us":212426,"threads_started":1,"wal-append.queue_time_us":644716}
I20260709 13:08:59.608530 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.609417 31299 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:59.609378 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.610976 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:59.612116 26754 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:59.613091 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.614521 26754 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:59.610989 26678 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:59.592643 31302 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:08:59.616362 31283 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.617961 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.618693 26758 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:59.615995 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.603546 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.625329 26683 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.625689 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.626842 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:59.630859 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:08:59.631577 26684 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:08:59.632364 26761 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:08:59.629262 30696 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:59.637795 30696 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:59.638172 30696 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:08:59.638302 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.638736 31293 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14.
I20260709 13:08:59.638954 26754 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:59.627080 30982 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.639902 30982 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.640247 30982 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.641279 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.639027 30696 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.650193 26606 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:59.650789 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:08:59.636386 31238 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
I20260709 13:08:59.646412 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.656215 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.658103 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.646703 30696 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:59.645089 31410 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.962s	user 0.002s	sys 0.013s
I20260709 13:08:59.632180 31278 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.634060 31435 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:59.659819 31408 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.661923 26759 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:59.688196 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.695983 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:59.700750 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.690449 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.699194 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.704278 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.705120 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:59.705935 26758 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.708519 31278 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.667773 31121 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.671232 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.709688 26752 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:08:59.709940 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:59.644886 31283 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.672732 26577 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.711767 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:59.676669 26606 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:59.713194 26610 raft_consensus.cc:606] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:08:59.713369 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1843) took 2538 ms. Trace:
I20260709 13:08:59.713675 26610 raft_consensus.cc:614] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:59.664170 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:08:59.646140 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:08:59.663715 31275 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:59.644883 31365 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:08:59.708595 31319 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.651906 31367 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.711830 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.716912 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:59.713871 26606 rpcz_store.cc:276] 0709 13:08:57.175157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.237915 (+ 62758us) service_pool.cc:224] Handling call
0709 13:08:57.238167 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.898009 (+659842us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b18001b1680. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32cb646 00007f40f320558e 00007f40f3286f9e 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4
0709 13:08:59.649888 (+1751879us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b580071ead0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4
0709 13:08:59.713046 (+ 63158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.713305 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5227240704}
I20260709 13:08:59.707969 31402 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:08:59.749640 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:08:59.756227 26753 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:59.756724 26753 pending_rounds.cc:85] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:08:59.756990 26753 pending_rounds.cc:107] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:59.757269 26753 raft_consensus.cc:2889] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.752816 26755 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.761674 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:08:59.743314 31290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:59.724836 31200 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.743709 31320 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:59.694000 31383 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:59.726157 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 348239us
I20260709 13:08:59.705528 31270 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.707587 31408 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.747162 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:08:59.707326 31299 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.748236 31275 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:59.781790 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:08:59.743448 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 97360.9us
I20260709 13:08:59.786396 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.760190 30963 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.789445 27320 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:08:59.724664 31283 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.793974 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.775187 30765 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.787096 31407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.030s	sys 0.037s
I20260709 13:08:59.775918 31175 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:59.779042 31358 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:59.802335 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.747403 31367 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.809500 26576 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.764798 31070 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:59.749259 31319 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:08:59.813856 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.802840 31407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.030s	sys 0.037s
W20260709 13:08:59.723809 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.819331 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36480 (request call id 24) took 2548 ms. Trace:
W20260709 13:08:59.819831 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 155738us
I20260709 13:08:59.832423 26651 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.821859 30768 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.780702 31366 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:59.783259 31423 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:59.798888 31273 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.799853 31175 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.799711 31358 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.782974 31363 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:59.831879 26610 rpcz_store.cc:276] 0709 13:08:57.262969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.263143 (+   174us) service_pool.cc:224] Handling call
0709 13:08:59.811561 (+2548418us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328a853 00007f40f825860a 00007f40f17de7d4 00007f40f17de762 00007f40f17de691 00007f40f17de60c 00007f40f17dd8c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:08:59.811744 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5492750720}
I20260709 13:08:59.799384 31447 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:08:59.830286 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:08:59.722795 26758 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:08:59.811318 31320 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:59.795604 30982 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.858626 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:59.827739 31435 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.865859 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:08:59.869035 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:08:59.854048 31417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.009s	sys 0.023s
I20260709 13:08:59.827484 31408 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.872054 27320 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:59.872221 26603 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:59.790807 31299 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.803819 30765 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.852795 31352 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.875499 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.876823 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.784876 31306 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.860294 31358 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.855837 31175 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:59.880604 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:08:59.910562 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 192533us
I20260709 13:08:59.894747 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.911752 26605 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:08:59.912628 26604 raft_consensus.cc:2368] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:08:59.918808 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:08:59.919824 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.920150 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.865363 31200 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:08:59.919549 27320 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:08:59.867862 31414 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.835717 31420 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:08:59.875837 31417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.009s	sys 0.023s
W20260709 13:08:59.880182 31285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.029s	sys 0.017s
W20260709 13:08:59.926410 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67895.1us
I20260709 13:08:59.856035 31402 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:59.924032 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:08:59.924670 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:08:59.871337 31383 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.878103 31070 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.930483 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:08:59.947445 26605 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.947750 27320 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.933125 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:08:59.925058 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.872449 31451 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.954953 31451 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.955374 31451 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.955413 31402 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.956117 31402 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.959555 30982 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.866881 31275 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.960965 31319 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:08:59.961165 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:08:59.962808 26678 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.921590 31408 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.934410 31326 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.937992 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:59.969128 26612 raft_consensus.cc:2376] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13. Re-sending same reply.
I20260709 13:08:59.865588 31447 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.938858 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.940560 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:08:59.952037 31200 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.973483 26608 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:08:59.954124 31450 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:59.921025 31422 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:59.921615 31320 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.962052 31319 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:59.939882 31285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.029s	sys 0.028s
I20260709 13:08:59.878511 31435 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.971691 31070 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:08:59.975929 31257 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.971611 31326 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:08:59.976033 31454 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:59.979934 31463 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:08:59.980218 31462 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:59.984040 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:08:59.991015 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.058043 26608 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
W20260709 13:08:59.963613 31444 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:08:59.997505 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.997980 26760 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
W20260709 13:09:00.004364 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 218047us
I20260709 13:09:00.062292 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.056960 27320 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:00.014237 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.009603 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.012555 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.054670 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.034822 26610 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:59.971431 31408 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.983543 31451 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:08:59.997015 31365 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:00.015272 31326 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.080453 31408 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.007519 31319 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:00.007613 31328 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:09:00.011312 31436 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:09:00.012912 31273 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:00.060653 31257 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:00.011514 31422 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.061192 31463 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.143198 31474 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:00.103587 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.157750 31474 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:00.135076 31293 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:00.158766 31474 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.159395 31293 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:00.093784 31405 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:00.160312 31405 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:00.160511 31293 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.089318 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.161729 31293 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.162179 31200 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:00.162588 31200 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:00.162959 31200 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:00.134955 30696 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.161149 31436 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:00.168192 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 78952.3us
I20260709 13:09:00.169737 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1859) took 1384 ms. Trace:
I20260709 13:09:00.183940 26609 rpcz_store.cc:276] 0709 13:08:58.785687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.928947 (+143260us) service_pool.cc:224] Handling call
0709 13:08:59.019271 (+ 90324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:59.019653 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.019703 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:59.020330 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:08:59.394622 (+374292us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:59.689533 (+294911us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.689770 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.689858 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.169512 (+479654us) raft_consensus.cc:1685] finished
0709 13:09:00.169532 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.169680 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4815,"prepare.queue_time_us":389366,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3208,"raft.queue_time_us":564,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6476,"thread_start_us":646446,"threads_started":2,"wal-append.queue_time_us":643798}
I20260709 13:09:00.184650 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:00.082392 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 158145us
W20260709 13:09:00.084414 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 122032us
I20260709 13:09:00.173216 31463 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.182771 30765 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.217492 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.217893 26605 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:00.218886 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.219558 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.217911 26683 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:00.220153 26679 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:00.221185 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.174533 31257 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.175680 31238 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:00.094136 31363 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:00.093076 31367 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.176805 31070 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.176833 31319 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.143261 31465 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.188053 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.189559 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.246254 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.246415 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.183139 31436 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:00.206862 31270 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:00.218961 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.173621 31422 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.081321 31285 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.168016 31299 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.170428 31467 raft_consensus.cc:2764] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:00.080607 31283 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.134347 31470 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.182873 31405 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.240971 26684 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:00.242635 26685 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:00.247038 26608 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:00.191047 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:00.244652 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.255182 31270 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:00.250541 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 195963us
I20260709 13:09:00.249924 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.192540 26680 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:00.248287 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 378220us
I20260709 13:09:00.224349 31242 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:00.236349 31275 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.260640 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 251073us
I20260709 13:09:00.237125 31238 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:00.310973 26724 leader_election.cc:400] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:00.311359 26724 leader_election.cc:403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:00.131994 31365 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.185456 30696 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.302801 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:00.303113 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 112128us
I20260709 13:09:00.251071 26610 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:00.320942 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.307785 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:00.307475 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.300026 31283 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.265897 31319 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.252213 31200 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:00.312021 31476 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:09:00.321894 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.337155 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.301843 31447 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.325119 26651 leader_election.cc:400] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:00.316339 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:00.319171 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 407854us
I20260709 13:09:00.327746 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.341657 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.342895 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.343881 31480 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:00.344692 31480 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.345669 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.346439 31467 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:00.346961 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.348029 31483 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:00.337000 31293 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:00.253799 31465 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.350883 31465 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.329080 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.310099 31270 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.352171 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.352991 27313 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:09:00.263512 31285 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.356400 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.357227 31285 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:00.309296 31454 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.357805 31454 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:00.358201 31454 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.358346 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.359499 27313 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:00.361377 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.338826 30765 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:09:00.368417 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.369907 31270 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.370322 27313 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:09:00.370692 31408 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.374586 27313 pending_rounds.cc:85] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 6
I20260709 13:09:00.374874 27313 pending_rounds.cc:107] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:00.375102 27313 raft_consensus.cc:2889] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.375170 26612 raft_consensus.cc:2368] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:00.371460 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.372169 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.372213 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.376849 31408 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.373023 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.373505 27317 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:00.373026 27321 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:00.373965 31454 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.379554 31454 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.381181 31270 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:00.382094 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65832.8us
I20260709 13:09:00.383881 31302 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.384255 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.384881 31414 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.385486 31238 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:00.387032 31475 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:00.410569 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.387449 31479 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:00.387928 31482 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.388839 31402 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:00.394177 31306 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.401136 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.319013 31290 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.309154 31463 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:09:00.402817 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.320672 31435 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.324682 31275 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.336175 31121 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:00.405580 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:00.441062 27321 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.406456 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:00.408653 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.409267 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.411643 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.413123 31238 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:00.414719 30696 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:00.484577 31455 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.570s	user 0.002s	sys 0.000s
I20260709 13:09:00.471323 31326 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.485347 31420 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.400853 31436 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:00.485752 31358 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.005s
W20260709 13:09:00.417196 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89561.6us
I20260709 13:09:00.492654 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.493484 31367 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:00.494222 31367 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.494557 31473 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:00.417950 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 88939.5us
I20260709 13:09:00.305400 31470 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.496681 31468 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.496850 31358 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.421607 31482 consensus_queue.cc:1243] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:00.498342 31470 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.498358 26611 raft_consensus.cc:2368] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:00.403115 31451 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.498885 31358 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.337522 31283 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.500618 31422 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:00.501030 31422 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:00.501430 31283 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.501821 31422 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.502288 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.506907 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.507339 26754 pending_rounds.cc:85] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:09:00.507652 26754 pending_rounds.cc:107] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:09:00.508252 26754 raft_consensus.cc:2889] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.425828 26753 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:00.510443 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:00.448613 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.512051 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.512915 26758 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:09:00.513674 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.514281 26758 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.447508 31290 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.448171 31201 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:00.452895 31200 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.459558 31418 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.464349 31477 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:00.465857 31407 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.545876 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.466651 31275 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.467077 31435 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.468307 31414 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:00.469156 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.543581 26758 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:00.554888 26755 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
W20260709 13:09:00.471053 31457 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:09:00.563908 31420 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:00.564363 31420 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:00.565172 31420 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.566609 31420 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:00.478029 31474 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:00.481647 31352 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:00.568413 31352 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.570652 31352 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.483381 30963 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:00.483282 31483 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:00.571250 30963 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:00.436095 31479 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:00.572126 30963 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.572338 31479 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.573345 30963 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:00.435514 30765 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:00.409992 31302 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.486009 26682 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:00.486927 31326 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.487589 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.616055 27320 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 7.
I20260709 13:09:00.616375 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.489796 27321 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:00.434736 31270 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.446722 26759 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:00.515964 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.625680 26604 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:00.516672 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.518541 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.629647 26753 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.526563 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:00.630663 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104204us
I20260709 13:09:00.630785 30696 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:00.631224 30696 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.631608 30696 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.528780 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.529057 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.633275 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:00.633406 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104449us
I20260709 13:09:00.633423 31326 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.635157 26687 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:00.636322 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:00.530879 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.535625 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.637290 26611 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.637357 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:00.637880 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.638854 31367 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:00.638988 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.639297 31367 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.639560 26608 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:00.639658 31367 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:00.640056 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.640309 26608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:00.640676 26686 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:00.640893 26608 raft_consensus.cc:606] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.641297 26608 raft_consensus.cc:614] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:00.641654 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.412945 31454 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:00.537992 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.481508 31365 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:00.484619 31175 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:09:00.554612 31448 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.545775 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.546964 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.546582 26684 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.547889 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.615556 31302 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.548521 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:00.696059 26612 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:00.545944 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.697523 26681 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:00.535820 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.527997 31319 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:00.541658 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.555773 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.703070 27317 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:00.703789 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.704568 26758 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:00.705724 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.707072 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.535229 31201 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.557008 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.538270 31418 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.565689 31435 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.474380 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:00.721132 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 246815us
I20260709 13:09:00.488059 31436 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.487421 31405 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.642668 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.636349 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:00.732249 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.733212 26686 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:00.646185 26604 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
W20260709 13:09:00.649298 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 333175us
I20260709 13:09:00.734282 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.734932 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.656512 26753 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:00.546320 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.684492 26606 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:00.687691 26760 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:00.538832 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.737438 26752 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:00.745239 30696 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.747974 30696 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.686877 31175 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.751514 31293 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:00.724465 31418 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.752209 31175 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.730455 31481 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.694393 31448 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.731564 31435 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.753425 31481 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:00.753346 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.755561 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.756131 31272 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:00.756296 26687 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:00.756557 31272 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.756973 31272 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:00.752216 31293 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:00.758471 31293 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.614286 31238 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.686008 26679 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 6.
I20260709 13:09:00.689808 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.643906 31352 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:00.699333 26684 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:00.700063 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:00.767158 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67214.2us
I20260709 13:09:00.767441 26684 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:00.768205 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.625172 31270 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:00.710457 31485 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:00.725667 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.727954 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.723271 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.738395 26757 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
W20260709 13:09:00.761956 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.763564 26724 leader_election.cc:400] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:00.777622 26682 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:00.773041 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.778214 26724 leader_election.cc:403] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:00.715883 31201 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:00.774597 26603 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:00.775384 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.780973 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.777202 26759 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:00.778190 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.774169 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:00.779196 26611 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:00.779438 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:00.781157 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53285.2us
W20260709 13:09:00.782910 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59745.2us
I20260709 13:09:00.787578 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:00.763978 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.781716 26761 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:00.789906 26686 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:00.806279 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:00.807077 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43645.2us
I20260709 13:09:00.808168 26724 leader_election.cc:400] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:00.808571 26724 leader_election.cc:403] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:00.809849 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:00.776026 31257 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:00.778963 31270 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.813988 31326 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:00.828137 31326 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.828524 31326 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:00.814455 31283 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:00.832165 31283 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.834262 31283 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:00.834596 31435 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.761011 31486 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:00.835948 26678 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:00.786345 31474 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.836966 31474 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:00.837244 31405 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:00.806623 31328 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:00.837970 31328 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.817800 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:00.814986 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:00.840196 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.840842 26686 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:00.824005 31402 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.845012 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.825744 31257 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:00.812598 31285 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:00.812281 31306 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:00.837343 31474 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.773686 31238 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.819420 31422 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.785804 31414 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:00.840852 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.841938 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.917008 26761 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:00.842629 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.843945 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:00.838335 31328 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:00.813649 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:00.918648 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 105090us
I20260709 13:09:00.917631 26752 raft_consensus.cc:2376] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12. Re-sending same reply.
I20260709 13:09:00.850835 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:00.864266 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90185.3us
I20260709 13:09:00.875025 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:00.923561 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48654.6us
I20260709 13:09:00.925078 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.805517 31121 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:00.860921 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.785507 31352 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:00.894405 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:00.903437 30765 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.939564 26758 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:09:00.941152 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:00.777477 30696 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.909546 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.942775 26760 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:00.911336 26757 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:00.912292 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:00.880710 31257 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.946311 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:00.947250 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 240155us
I20260709 13:09:00.882550 31423 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:00.929893 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79163.6us
I20260709 13:09:00.930964 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:00.950580 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.932457 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.951100 26686 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:00.952478 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.945019 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.945055 26679 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:00.928838 26752 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:00.954988 26752 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:00.941256 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:00.956497 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 257442us
I20260709 13:09:00.902115 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.958967 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:00.928321 31319 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:00.937381 31454 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:00.968026 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:00.972065 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.943537 31463 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:00.942453 30696 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.905946 31306 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.987962 26757 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:00.988498 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43594.2us
I20260709 13:09:00.942725 30765 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.946777 31477 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:00.968632 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66634.3us
I20260709 13:09:00.992623 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:00.999728 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:01.000384 26607 raft_consensus.cc:606] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.000813 26607 raft_consensus.cc:614] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:00.929653 31272 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:00.963622 31462 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:00.968305 31436 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.973922 31285 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:01.016070 31285 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:00.969668 31423 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:00.987165 31407 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:01.018906 26752 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:01.019814 26610 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:00.988797 31463 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.001884 31405 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:00.995877 30696 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:01.024046 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.008343 31201 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:01.070901 31201 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.018640 31479 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.988628 31465 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:01.030228 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:01.012166 31272 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:00.994520 31367 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.008581 31462 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.010334 31363 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:01.025290 31175 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:00.997748 30765 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.016646 31238 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:01.024936 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.008383 31477 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:01.111685 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 87203.3us
I20260709 13:09:01.111842 31477 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:01.075608 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45457.5us
I20260709 13:09:01.022307 31436 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.114552 31436 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:01.008082 31273 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:09:01.031116 31463 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:01.016664 31285 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.061429 31451 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:01.075487 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 267529us
W20260709 13:09:01.128531 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.142320 31272 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:01.142943 31273 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:01.142369 31238 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:01.143569 31273 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.144459 31272 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:01.145028 31272 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:01.145975 31273 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.145810 31272 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:01.146627 26724 connection.cc:256] RPC call timeout handler was delayed by -1.0759401010000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
W20260709 13:09:01.147568 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.150465 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.151790 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.148913 31273 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.153381 31273 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.149081 26726 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.157598 31436 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:01.158073 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.159106 31436 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:01.160709 31405 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:01.161237 31405 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.163300 31405 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.163990 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.171533 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.074839 31201 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:01.177860 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 64665.9us
I20260709 13:09:01.088874 31468 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:01.179265 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:01.103350 31097 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.183718 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:01.184542 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 252188us
I20260709 13:09:01.089143 31462 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:01.190392 31498 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:09:01.195852 30765 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.024420 31352 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.172999 31405 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:01.176612 31486 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:01.223443 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.247633 26607 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:01.236462 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:01.278564 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 54939.6us
I20260709 13:09:01.210937 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:01.206137 31293 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:01.208314 31497 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:09:01.201838 31435 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.260438 26605 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:09:01.187477 31070 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:09:01.189595 31451 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:09:01.207427 31463 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.187680 31423 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:01.275705 31496 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:09:01.267782 31175 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:01.285756 26606 raft_consensus.cc:2368] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:01.302542 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.261300 31468 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:01.164606 31285 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.317698 31272 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:01.318643 31501 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:09:01.289995 31490 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:09:01.289326 31273 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:01.419857 27317 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:01.433775 26607 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:01.307417 31306 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:01.435699 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 476124us
I20260709 13:09:01.436972 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.463644 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.447311 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.278820 31507 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
W20260709 13:09:01.437808 31493 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:09:01.303694 31405 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.136s
W20260709 13:09:01.444578 31497 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:01.470366 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.422845 31486 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:01.414942 31175 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.478704 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.455112 31513 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.484506 31367 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.383957 31293 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 13:09:01.474566 31495 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:09:01.517158 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.519733 31463 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.501973 31175 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:01.525681 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 314878us
I20260709 13:09:01.526978 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1749) took 1019 ms. Trace:
W20260709 13:09:01.528364 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 248687us
I20260709 13:09:01.527383 26756 rpcz_store.cc:276] 0709 13:09:00.507216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.507834 (+   618us) service_pool.cc:224] Handling call
0709 13:09:00.508159 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.508492 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.508519 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.537842 (+ 29323us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.901849 (+364007us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.901908 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.902008 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.526746 (+624738us) raft_consensus.cc:1685] finished
0709 13:09:01.526784 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.526920 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"raft.queue_time_us":1659,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7467,"thread_start_us":344312,"threads_started":1,"wal-append.queue_time_us":412941}
I20260709 13:09:01.495118 26610 raft_consensus.cc:2376] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12. Re-sending same reply.
W20260709 13:09:01.514559 31454 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:09:01.532533 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:01.532647 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:01.518199 31510 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:09:01.529713 31514 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:01.542126 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1747) took 1035 ms. Trace:
I20260709 13:09:01.542546 26754 rpcz_store.cc:276] 0709 13:09:00.506694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.506867 (+   173us) service_pool.cc:224] Handling call
0709 13:09:00.507147 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.508764 (+  1617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.508797 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.509155 (+   358us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.906661 (+397506us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.906698 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.906768 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.541931 (+635163us) raft_consensus.cc:1685] finished
0709 13:09:01.541952 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.542066 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":397226,"threads_started":1,"wal-append.queue_time_us":570854}
W20260709 13:09:01.552314 31508 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:09:01.559047 31270 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.000s
I20260709 13:09:01.563213 26607 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:01.564150 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:01.564774 27317 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:01.565869 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:01.535172 31454 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:01.571336 31290 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.572527 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:01.573077 31524 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:01.579732 31524 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.581888 31524 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:01.582608 31474 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.000s
I20260709 13:09:01.536893 31525 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.583029 31474 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.583765 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.584427 31526 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:01.586954 31402 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.742s	user 0.004s	sys 0.003s
I20260709 13:09:01.588044 31201 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.591754 31405 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:01.559526 31270 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:01.596251 31257 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.001s
I20260709 13:09:01.510543 31513 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:01.596849 30696 consensus_meta.cc:287] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.005s
W20260709 13:09:01.562274 31302 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.844s	user 0.007s	sys 0.004s
W20260709 13:09:01.598371 31418 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.001s
I20260709 13:09:01.599905 26604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
W20260709 13:09:01.544814 31326 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.002s
I20260709 13:09:01.630511 27321 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:01.628612 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92541.7us
I20260709 13:09:01.629473 26604 raft_consensus.cc:606] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:01.630065 26612 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
W20260709 13:09:01.609501 31518 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:09:01.619774 31402 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:01.630960 31302 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.642127 31302 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.626369 31257 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.645502 31257 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.647943 31270 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.632850 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:01.522990 31468 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.624316 31526 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:01.631829 26604 raft_consensus.cc:614] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:01.637331 31201 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.655260 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:01.627935 31528 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:01.649780 26753 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
W20260709 13:09:01.652136 31328 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
I20260709 13:09:01.663100 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:01.651945 31474 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.659117 31097 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.675477 31530 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.677313 26606 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:01.633644 31326 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.661943 31272 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:01.692155 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:01.692138 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.701297 27315 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:01.703301 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:01.704711 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:01.693830 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:01.657343 31290 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:01.696610 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.721853 26606 raft_consensus.cc:2368] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8.
I20260709 13:09:01.632158 30696 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.698971 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:01.631251 31418 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:01.736544 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.700280 31530 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.671402 31436 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.713776 31435 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:01.673041 31405 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.665650 31528 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:01.716306 31513 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.696380 31481 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.709522 31529 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:01.713865 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:01.670360 31328 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.712000 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:01.763698 31454 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:01.727420 31306 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.764149 31454 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.764664 31454 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.764580 31306 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.765097 31328 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.761813 31436 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.766681 31306 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.767604 31436 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.736585 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.768507 26606 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:01.769382 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.770391 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:01.771898 26611 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:01.738054 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:01.774025 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:01.739209 27313 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 7.
I20260709 13:09:01.775130 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:01.776154 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:01.739799 31272 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:01.762190 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48395.1us
I20260709 13:09:01.777628 31272 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.778110 26650 leader_election.cc:400] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:01.778477 26650 leader_election.cc:403] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.673746 31402 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:01.776820 26758 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:01.779023 31402 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.779441 31402 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.780146 31526 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.785655 26650 leader_election.cc:400] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8.
I20260709 13:09:01.786470 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:01.786612 26650 leader_election.cc:403] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.787055 27313 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:01.775681 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:01.764057 26755 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:01.793267 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:01.794826 31407 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.815752 31474 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:01.816977 31463 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:01.817344 31418 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:01.821085 31462 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.003s
I20260709 13:09:01.758949 31486 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.759982 31528 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.761816 31529 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:01.847601 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62138.5us
I20260709 13:09:01.737286 31290 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.817440 31463 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:01.762933 31405 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.849882 31461 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:01.846036 31435 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:09:01.866015 31422 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.000s
I20260709 13:09:01.876596 31463 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.845162 31454 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:01.906617 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.907469 31530 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:01.916083 31529 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.920269 26759 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:01.866197 31462 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:01.863972 31486 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:01.947432 27320 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:01.941279 31529 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.943539 31407 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
W20260709 13:09:01.976145 31533 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:01.982470 27317 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:09:01.983654 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 118471us
I20260709 13:09:01.968832 31326 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:01.981577 30696 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.993676 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:01.994616 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:01.999224 31290 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:01.994148 31402 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.005229 31402 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.006045 26752 raft_consensus.cc:2368] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
W20260709 13:09:02.009035 31537 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:02.009416 31542 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:09:01.986227 31435 consensus_queue.cc:1243] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:02.011775 26606 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:02.012630 31454 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.012710 31407 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:02.013221 31407 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:02.013794 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:02.014389 26606 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.014006 31407 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.014542 31462 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.015215 31407 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:02.016382 31486 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.019378 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1758) took 1404 ms. Trace:
I20260709 13:09:02.021160 26759 rpcz_store.cc:276] 0709 13:09:00.615048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.846470 (+231422us) service_pool.cc:224] Handling call
0709 13:09:00.846825 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.925456 (+1078631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.019122 (+ 93666us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000db6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:02.019323 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467595648}
I20260709 13:09:02.021749 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:02.020211 31405 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.023605 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:02.025717 27317 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.023558 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:02.015131 31534 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:09:01.981011 31528 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.038093 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 2991) took 2055 ms. Trace:
I20260709 13:09:02.038653 26603 rpcz_store.cc:276] 0709 13:08:59.982270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.013951 (+ 31681us) service_pool.cc:224] Handling call
0709 13:09:02.037837 (+2023886us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400031e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:02.038016 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575406848}
I20260709 13:09:02.042929 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:02.044731 26685 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:02.054092 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.028852 31402 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:02.060218 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.026971 31486 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:09:02.060081 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.068622 26684 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:02.069223 26606 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:02.070345 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:02.022989 31175 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.077426 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:02.054452 31418 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.083474 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.081735 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.092008 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:02.092800 26681 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:02.057389 31462 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.093931 31462 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.096976 31318 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.097568 31318 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.099005 31448 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.101017 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:02.102169 31462 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.102919 26685 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:02.061305 31238 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.148391 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.164013 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.068403 31402 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:02.162566 31514 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:02.084761 31544 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:02.165999 31511 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.004s
W20260709 13:09:02.212735 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.182248 31549 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:02.183991 31175 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.226526 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:02.186798 31528 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:02.191908 30765 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:02.198982 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1761) took 1508 ms (client timeout 1733 ms). Trace:
I20260709 13:09:02.200295 31420 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:09:02.202037 31435 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:02.205637 31492 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.202s	user 0.003s	sys 0.001s
I20260709 13:09:02.163690 31448 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.216094 26679 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:02.220252 27317 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:02.166405 31238 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.162871 31462 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.256871 31462 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.258184 31238 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.258993 31462 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.260394 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1881) took 1745 ms. Trace:
I20260709 13:09:02.164525 31418 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:02.235826 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.233368 26753 rpcz_store.cc:269] 0709 13:09:00.690244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.736121 (+ 45877us) service_pool.cc:224] Handling call
0709 13:09:00.831546 (+ 95425us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b5800194a98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:02.198638 (+1367092us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400083254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:02.198912 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675855488}
I20260709 13:09:02.238363 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:02.247457 31548 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:09:02.237287 31363 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.249744 31522 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:02.252512 31328 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:02.252576 31242 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:02.170747 31402 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:02.234444 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 413259us
I20260709 13:09:02.179836 31318 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.286688 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.237605 31435 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:02.275142 26606 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:02.260809 26608 rpcz_store.cc:276] 0709 13:09:00.515039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.641969 (+126930us) service_pool.cc:224] Handling call
0709 13:09:00.642224 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.684936 (+ 42712us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:01.175791 (+490855us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.569558 (+393767us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b1800042220. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf 00007f40f32aa038
0709 13:09:01.663529 (+ 93971us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.664744 (+  1215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.664798 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.664856 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.260169 (+595313us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54001135d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:02.260222 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.260339 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18329,"prepare.queue_time_us":74472,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":10775,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":24778,"spinlock_wait_cycles":136280448,"thread_start_us":645089,"threads_started":3,"wal-append.queue_time_us":302847}
I20260709 13:09:02.232563 31544 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.294374 31242 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.298117 26509 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 9, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.299512 31544 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.299690 31242 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:02.280596 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:02.260733 31463 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.300473 26760 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:02.301395 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.301895 26760 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.281817 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:02.303653 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.304220 26754 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:02.271014 31538 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:02.231704 31285 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.287907 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:02.295120 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:02.295189 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.262516 31405 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.412344 26755 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:02.432575 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:02.433418 26685 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.437116 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:02.438014 26679 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:02.294620 31528 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.404670 31511 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:09:02.484959 26680 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:02.486650 26682 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:02.265162 31448 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.492118 26678 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:09:02.492501 26678 pending_rounds.cc:85] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 6
I20260709 13:09:02.492723 26678 pending_rounds.cc:107] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:09:02.492934 26678 raft_consensus.cc:2889] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.494510 26754 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:02.495750 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.451977 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.499493 31407 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.500010 31407 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.500911 26753 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:02.502931 27285 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:02.504722 26685 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:02.455063 26760 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:02.412192 31544 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:02.465718 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49182 (request call id 7) took 1181 ms. Trace:
I20260709 13:09:02.472875 31420 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.438966 31405 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.296041 31328 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:02.279618 31363 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.479751 31463 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.481437 26686 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:02.481458 31418 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.482479 26681 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:02.302542 31530 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.489670 27317 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:02.488402 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:02.535513 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47202.4us
I20260709 13:09:02.537940 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:02.507021 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.538964 26760 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.511089 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:02.548229 26758 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.510787 26604 rpcz_store.cc:276] 0709 13:09:01.299842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.654297 (+354455us) service_pool.cc:224] Handling call
0709 13:09:02.465398 (+811101us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400249854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3296735 00007f40f328e9fa 00007f40f82564c9 00007f40f17d2c54 00007f40f17d2be2 00007f40f17d2b11 00007f40f17d2a8c 00007f40f17d1d42 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:02.465625 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438983424}
I20260709 13:09:02.516394 27313 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:02.550987 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:02.551512 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1759) took 1862 ms. Trace:
I20260709 13:09:02.552670 26761 rpcz_store.cc:276] 0709 13:09:00.689499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.923913 (+234414us) service_pool.cc:224] Handling call
0709 13:09:00.924189 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.924527 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.924556 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.924963 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.124389 (+199426us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:01.263031 (+138642us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.347565 (+ 84534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.382643 (+ 35078us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.027318 (+644675us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b1800460fc0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:02.526494 (+499176us) raft_consensus.cc:1685] finished
0709 13:09:02.551306 (+ 24812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.551456 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":321052,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":50826,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":70920,"spinlock_wait_cycles":17743104,"thread_start_us":317943,"threads_started":3,"wal-append.queue_time_us":448273}
I20260709 13:09:02.550221 31530 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:02.558476 31520 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.071s	user 0.005s	sys 0.002s
I20260709 13:09:02.558868 31530 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.554445 31525 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:02.512475 30696 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:02.561971 31422 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:02.562551 31422 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:02.563493 31422 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.491758 31528 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.567237 31528 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.517949 31544 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.570205 31544 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:02.551239 31461 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 13:09:02.572353 31461 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 7. Current term is 8.
I20260709 13:09:02.554351 31097 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:09:02.578138 31550 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:09:02.554793 31408 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:02.583039 31328 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.583633 27313 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:02.584764 31363 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.586488 31405 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.551934 31407 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.528054 31293 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:09:02.512656 31326 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.591446 31326 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.593324 31326 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.593945 26761 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:02.600358 31402 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.532780 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:02.601562 31238 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.602157 31293 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:02.602480 31525 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:02.522877 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 539) took 1302 ms. Trace:
W20260709 13:09:02.613862 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76035.7us
I20260709 13:09:02.628798 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:02.630805 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:02.624543 26760 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:02.626575 26758 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:02.628378 27321 rpcz_store.cc:276] 0709 13:09:01.220334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.225245 (+  4911us) service_pool.cc:224] Handling call
0709 13:09:01.225606 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.630925 (+405319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.522615 (+891690us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400560254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:02.522811 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930692864}
I20260709 13:09:02.621170 26687 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:09:02.633458 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:02.652733 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.661108 31473 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.661375 31470 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:02.662026 31470 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:02.661870 31473 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.662914 31470 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.620601 31363 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:02.667914 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:02.668759 27321 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.669716 26759 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:02.672809 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1889) took 1741 ms. Trace:
I20260709 13:09:02.673303 26611 rpcz_store.cc:276] 0709 13:09:00.931228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.931364 (+   136us) service_pool.cc:224] Handling call
0709 13:09:00.940316 (+  8952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.772307 (+831991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.672506 (+900199us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:02.672739 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911920512}
I20260709 13:09:02.628293 31525 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:02.642236 31097 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:02.678665 31320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.070s	sys 0.079s
I20260709 13:09:02.694710 27315 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:02.515512 31435 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:02.701128 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.024s	sys 0.087s
I20260709 13:09:02.685774 27321 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8.
I20260709 13:09:02.642506 31328 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:02.694394 31320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.070s	sys 0.079s
I20260709 13:09:02.688639 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:02.684480 27317 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:02.641547 31293 consensus_queue.cc:1243] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:02.657523 31385 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:02.668167 31423 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:02.630817 31238 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.681557 31242 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:02.700429 31535 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.702914 31530 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.749877 31483 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.679051 31201 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:02.702057 31097 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:02.703197 31486 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.734977 31328 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:02.734491 31462 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.735570 31272 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.790575 31328 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.803968 31405 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.813656 31405 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.818025 31405 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.797662 31468 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:02.821638 31238 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:02.823129 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:02.823995 27320 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:02.838595 31097 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.780222 31535 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.848795 31535 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.789673 31486 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.851577 31486 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:02.796111 31462 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.796394 31272 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.784535 31483 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.858049 31483 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.779975 31530 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.860129 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:02.860952 26758 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:02.861786 31530 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.877455 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:02.878304 27320 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:02.878373 27317 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:02.880519 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:02.705767 31473 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:02.739989 31435 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.882074 31530 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:02.882486 31530 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.882862 31530 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.855465 31272 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.919122 31272 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:02.920567 31528 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:02.921257 31528 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:02.924173 31272 consensus_queue.cc:1243] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:02.928591 31402 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:02.949658 31528 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:02.958837 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:02.960094 27320 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:02.987582 31530 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:02.994269 31530 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.068135 31483 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:03.069490 31483 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.074460 31483 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.105135 31328 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.108258 31328 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.190497 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:09:02.689796 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 469362us
W20260709 13:09:03.191568 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.025s	sys 0.074s
W20260709 13:09:02.709057 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.024s	sys 0.087s
I20260709 13:09:03.246824 31200 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:03.247056 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 1.17041e+06us
W20260709 13:09:03.204339 26679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.022s	sys 0.027s
W20260709 13:09:03.205117 26683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.007s	sys 0.011s
W20260709 13:09:03.207639 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.213359 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 255284us
I20260709 13:09:03.214128 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:03.218592 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.235783 31422 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.245129 30696 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:03.246228 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.025s	sys 0.075s
I20260709 13:09:03.247445 31200 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:03.255187 26759 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:03.255942 31290 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.256594 26753 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:03.257507 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 67619.1us
I20260709 13:09:03.259647 26609 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:03.259492 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:03.259979 26683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.011s
I20260709 13:09:03.260759 26755 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:03.260694 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:03.261353 26679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.023s	sys 0.027s
I20260709 13:09:03.262287 26606 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:03.262110 31422 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:09:03.263983 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.264334 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:03.264181 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:03.266302 26607 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:03.263334 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.267167 26754 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:03.268025 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.269481 26758 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:03.269199 30696 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.270753 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.271176 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.272519 31273 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:03.275251 26509 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.278489 31097 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:03.280746 31328 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:03.281486 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.282991 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:03.287896 26612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3001) took 2038 ms (client timeout 1828 ms). Trace:
I20260709 13:09:03.290681 31474 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:03.279389 26687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1815) took 1227 ms (client timeout 1563 ms). Trace:
I20260709 13:09:03.315021 26752 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:09:03.306589 31273 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:03.317572 26756 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:03.318267 31328 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:03.322201 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:03.323881 31290 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.324674 26604 raft_consensus.cc:2410] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:03.326813 31290 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.327219 31474 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.309392 26687 rpcz_store.cc:269] 0709 13:09:02.051872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.053839 (+  1967us) service_pool.cc:224] Handling call
0709 13:09:03.278970 (+1225131us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003129d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:03.279171 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191955712}
I20260709 13:09:03.330147 31474 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:03.317961 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54092.3us
I20260709 13:09:03.332732 31422 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.335151 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:03.336330 26756 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:03.336135 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:03.337209 26758 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:03.337389 31528 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.309118 26612 rpcz_store.cc:269] 0709 13:09:01.211566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.375264 (+163698us) service_pool.cc:224] Handling call
0709 13:09:03.249379 (+1874115us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:03.249646 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380343168}
I20260709 13:09:03.338011 31528 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.322736 31328 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.385613 26605 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:03.345046 26687 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:03.428171 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.429044 26758 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 8.
I20260709 13:09:03.433331 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.434077 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
W20260709 13:09:03.388963 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 74953.7us
I20260709 13:09:03.401005 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:03.419410 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 136585us
I20260709 13:09:03.438788 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:03.435510 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.443492 26753 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:03.343569 31462 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.449105 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.458180 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.459582 31358 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:09:03.468211 30696 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.468371 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.469239 26681 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:03.470233 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.472359 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.473340 26685 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:03.458216 31417 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:03.475922 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 67273.7us
I20260709 13:09:03.476586 31417 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:03.478005 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.478076 31417 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.458515 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1820) took 1377 ms. Trace:
I20260709 13:09:03.480636 26680 rpcz_store.cc:276] 0709 13:09:02.081276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.081422 (+   146us) service_pool.cc:224] Handling call
0709 13:09:03.438089 (+1356667us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001da954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:03.458306 (+ 20217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920388480}
I20260709 13:09:03.486500 31448 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.486963 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.487277 31448 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:03.503607 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.503831 31448 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.504410 26755 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:03.505396 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.487819 26756 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 9.
I20260709 13:09:03.488518 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:03.488888 31507 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:03.507165 31507 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:03.508548 31507 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.489209 31535 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.510461 31535 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.511547 26603 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:03.512653 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.512849 31535 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.513238 26603 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:03.513769 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1770) took 1236 ms. Trace:
I20260709 13:09:03.509932 31507 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.516114 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.516901 26759 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:03.518610 26611 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:03.490568 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:03.521837 31420 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.522922 31407 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:03.523258 26509 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 6, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 6 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.491355 31283 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:03.526458 31283 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:03.526813 31283 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:03.514125 26757 rpcz_store.cc:276] 0709 13:09:02.276783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.278118 (+  1335us) service_pool.cc:224] Handling call
0709 13:09:02.278396 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.305444 (+ 27048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.305477 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.402395 (+ 96918us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.223092 (+820697us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b1800461080. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:09:03.404022 (+180930us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.404141 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.404278 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.513332 (+109054us) raft_consensus.cc:1685] finished
0709 13:09:03.513352 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.513590 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38964,"raft.queue_time_us":34041,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":25675,"spinlock_wait_cycles":46892800,"thread_start_us":93200,"threads_started":1,"wal-append.queue_time_us":1062506}
I20260709 13:09:03.525952 26509 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.496868 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.447359 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.528033 31283 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.496049 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.501647 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.352025 31200 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.530522 31200 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:03.502854 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 49941.7us
I20260709 13:09:03.494141 31273 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.532346 31273 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.497620 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.535885 26607 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:09:03.536063 31548 raft_consensus.cc:1068] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Unable to promote non-voter 77c617823f2e4a938ef247a8924e299b: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }.
  Pending config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.539862 31525 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.541431 26726 leader_election.cc:336] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.784s (SENT)
I20260709 13:09:03.541577 31525 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.545405 31363 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:03.545878 31363 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:03.546132 26509 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 8, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:03.525296 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:03.515389 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.524415 31407 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:03.549800 31528 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:03.495345 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.550686 31548 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:03.551331 31548 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:03.553408 31448 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.554714 31570 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.552577 31548 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.556028 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:03.506089 26755 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:03.549952 31407 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:03.559569 31448 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:03.560305 31448 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.560853 31407 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.562273 31407 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.564059 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:03.550695 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.564635 31200 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.565518 31200 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.566118 31454 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.566818 31454 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.569897 31454 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.570604 31454 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.568007 31200 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.547012 31363 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.572077 26651 connection.cc:256] RPC call timeout handler was delayed by -1.2877933070000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:09:03.573225 31363 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.573603 31435 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:03.574469 31435 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.576058 31477 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:03.576413 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.576853 31477 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.579257 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.579411 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.581077 31420 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:03.581961 31420 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:03.558635 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.584800 31420 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.585616 31570 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.590255 26651 connection.cc:256] RPC call timeout handler was delayed by -1.1446933070000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:09:03.590868 26651 connection.cc:256] RPC call timeout handler was delayed by -1.1329933070001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:09:03.592106 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.592024 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:03.592893 31528 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.593786 31121 raft_consensus.cc:2764] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:03.593731 31528 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.600427 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75379.4us
I20260709 13:09:03.601755 31121 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.593025 26605 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:03.562685 31448 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.549055 26509 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.571312 31454 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.602638 31121 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.636847 31283 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:03.658869 31570 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.661311 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.662177 26684 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:03.655062 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:03.656773 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.666810 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:03.668407 31448 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.668570 26685 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:03.666680 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.668710 26509 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 7 to 9, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.669184 31448 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.676208 31448 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:03.675699 26509 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:03.678602 26605 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:03.683614 31574 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:09:03.682657 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 186668us
I20260709 13:09:03.676200 31454 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.697497 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.699579 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:03.701776 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1832) took 1217 ms. Trace:
I20260709 13:09:03.690209 31435 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.712141 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:03.698719 31454 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.720055 31302 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.720976 31542 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:03.703262 31420 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:03.725766 31528 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:03.730476 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.736050 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:03.736928 31121 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:03.753893 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 113545us
I20260709 13:09:03.754992 26685 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:03.712510 31477 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:03.753708 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 198783us
I20260709 13:09:03.758484 31420 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:03.759124 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:03.757849 26509 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:03.764595 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:03.765105 31420 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:03.767753 31542 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.750470 31302 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:03.768976 31302 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.768090 26509 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.702157 26683 rpcz_store.cc:276] 0709 13:09:02.481261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.487432 (+  6171us) service_pool.cc:224] Handling call
0709 13:09:02.499804 (+ 12372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.500001 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:03.328053 (+828052us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.656526 (+328473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.669362 (+ 12836us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:03.682770 (+ 13408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.685437 (+  2667us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.698856 (+ 13419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16185,"prepare.queue_time_us":314529,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1807,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":16732,"thread_start_us":1076235,"threads_started":2,"wal-append.queue_time_us":249530}
I20260709 13:09:03.770306 26607 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:03.755823 31121 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.798494 27320 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:03.799535 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.802723 31529 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.803444 31529 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.806200 31529 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:03.809767 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.760267 31454 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.812741 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:03.798244 31477 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:03.794471 31200 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.824384 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:03.813937 31328 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.832973 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.834256 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.836103 27321 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:09:03.841686 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 147965us
I20260709 13:09:03.840191 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.846530 26755 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:03.851805 31468 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.852551 31542 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.852506 31468 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.854928 31468 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.833956 31097 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:03.860477 31578 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:03.860258 31097 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.816984 31121 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.862839 31097 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.863889 31121 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:03.865404 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:03.844481 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.716s (SENT) [suppressed 18 similar messages]
W20260709 13:09:03.868217 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.868386 31479 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.868844 31454 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.869076 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.869766 26606 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:03.869891 31507 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:03.825572 31407 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.870996 31529 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:03.871393 31529 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:03.822999 31200 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.872336 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.872934 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:03.872489 31529 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:03.874215 31529 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.874621 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.875276 26610 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:03.875823 27314 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:03.876535 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.873512 31200 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.877153 26612 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:03.868861 31479 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.879038 31479 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.874851 31420 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:03.879944 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.871282 26604 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.882416 27320 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:03.884160 31483 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:03.884389 27315 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.884858 31483 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:03.885929 31483 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.887737 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 96019.4us
I20260709 13:09:03.871546 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:03.888743 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:03.845521 31435 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.889935 31435 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.891252 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:03.892026 31570 raft_consensus.cc:2764] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:03.893333 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:03.894035 31570 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:03.894419 31570 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:03.894789 31570 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:03.900100 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:03.900779 31420 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.901937 31200 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:03.903100 31200 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:03.903486 31200 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:03.905066 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.907788 27314 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.909286 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:03.910049 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.910233 27319 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:09:03.910573 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.911562 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:03.913287 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:03.914204 27316 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:09:03.915004 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72696.1us
I20260709 13:09:03.839342 31328 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.917927 31328 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.921651 31507 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:03.924081 31525 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.924659 31525 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.925947 26507 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 218) took 29879 ms (client timeout 15000 ms). Trace:
I20260709 13:09:03.904385 31200 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:03.954311 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.933326 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:03.933049 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44488us
I20260709 13:09:03.932933 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:03.967063 26605 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:03.937525 27315 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:03.965256 27316 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:03.931952 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:03.932511 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:03.927465 31525 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.940973 31290 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.892046 31435 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:03.997725 27318 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:03.932392 31552 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.005025 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.005718 31529 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:04.006129 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.007025 31570 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.009444 31479 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.010973 31531 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:04.011657 31546 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:03.980692 31363 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:09:03.926376 26507 rpcz_store.cc:269] 0709 13:08:34.046270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.046540 (+   270us) service_pool.cc:224] Handling call
0709 13:09:03.925720 (+29879180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:55.212436 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:55.213190 (+   754us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:55.213244 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:55.213260 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:55.312150 (+ 98890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:55.312246 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:55.312273 (+    27us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:08:55.314625 (+  2352us) tablet.cc:701] Row locks acquired
0709 13:08:55.314677 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:55.314868 (+   191us) write_op.cc:270] Start()
0709 13:08:55.315013 (+   145us) write_op.cc:276] Timestamp: P: 1783602535314805 usec, L: 0
0709 13:08:55.315051 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:08:55.387796 (+ 72745us) log.cc:844] Serialized 13127 byte log entry
0709 13:08:55.679275 (+291479us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b
0709 13:08:56.820297 (+1141022us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.989240 (+168943us) write_op.cc:301] APPLY: starting
0709 13:08:56.997248 (+  8008us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:57.386486 (+389238us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:57.386522 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.865491 (+478969us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.866013 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=0,mrs_lookups=0
0709 13:08:57.866066 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:57.873131 (+  7065us) log.cc:844] Serialized 284 byte log entry
0709 13:08:58.208655 (+335524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.328151 (+119496us) write_op.cc:454] Released schema lock
0709 13:08:58.414270 (+ 86119us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:58.479928 (+ 65658us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.481741 (+  1813us) write_op.cc:454] Released schema lock
0709 13:08:59.421156 (+939415us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
Metrics: {"mutex_wait_us":116041,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":166018,"apply.run_cpu_time_us":75965,"apply.run_wall_time_us":1448291,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142001,"num_ops":33,"prepare.queue_time_us":461176,"prepare.run_cpu_time_us":23547,"prepare.run_wall_time_us":677849,"raft.queue_time_us":309372,"raft.run_cpu_time_us":18735,"raft.run_wall_time_us":108415,"replication_time_us":1505036,"spinlock_wait_cycles":59414016,"thread_start_us":1259938,"threads_started":5,"wal-append.queue_time_us":1046099,"wal-append.run_cpu_time_us":57105,"wal-append.run_wall_time_us":3763823}]]}
I20260709 13:09:03.933624 31542 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:04.016898 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 107050us
W20260709 13:09:04.019425 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.941380 31097 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:09:03.905172 31477 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:03.934199 31463 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:09:04.046633 30696 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.046918 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59277.9us
I20260709 13:09:04.049155 30696 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.014582 31290 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.035730 31283 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.031767 31363 consensus_queue.cc:1243] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:04.059115 31525 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:04.068894 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:04.060832 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77858.9us
I20260709 13:09:04.041291 31407 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:04.071426 31525 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.080999 31525 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.085105 31477 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.085219 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.086153 31546 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:04.086050 31407 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.086822 31546 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.088143 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:04.087924 31507 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:04.093026 31479 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.093660 31302 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.094082 31507 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:04.094698 31507 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.095062 31507 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.052239 31542 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.096014 31548 raft_consensus.cc:2764] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:09:04.097028 31542 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.096902 31548 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:04.097829 31290 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.098475 31290 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.098879 31290 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.099339 31531 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:04.100030 31531 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.102273 31531 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.103154 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:04.103298 30696 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.103905 31200 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.104190 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:04.104808 31468 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.094182 31570 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.108721 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.088979 31407 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:04.111083 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 195435us
I20260709 13:09:04.130662 31525 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.131987 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.135181 31528 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:04.135413 26651 leader_election.cc:400] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:04.135632 31528 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:04.135859 31477 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.132277 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.143627 26758 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:04.098875 31593 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:04.136792 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65095.9us
I20260709 13:09:04.122157 31468 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.099354 31290 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:04.154016 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43661.1us
I20260709 13:09:04.154680 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.147500 31590 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:04.158707 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.161736 27321 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:04.159988 31570 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:04.164264 31570 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.164786 31570 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.164196 31528 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.165736 31528 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.152738 31468 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:04.176479 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 107690us
I20260709 13:09:04.169060 31529 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:04.177551 31529 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:04.178691 31529 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.180117 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.180167 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.184876 31531 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.185237 31407 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.185398 31531 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.185813 31531 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.186472 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.192013 31420 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.193540 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.194810 31507 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.195353 31420 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.191529 31570 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.196816 31525 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:04.201052 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.202064 31570 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.204869 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.205446 26758 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.161114 31302 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.163270 31590 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:04.208107 31590 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:04.212217 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.212646 26758 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
W20260709 13:09:04.215312 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.216348 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58879us
I20260709 13:09:04.217420 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.217569 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:04.218281 31570 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:04.218894 31570 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:04.219789 27321 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 9 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:04.221191 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.221366 31420 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.221772 31420 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:04.222159 31420 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.222627 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.223315 31407 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:04.223472 26678 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:04.226321 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.227043 26685 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:04.227985 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.229067 31417 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:04.229454 31417 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.229766 31417 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.226361 31529 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.223747 31407 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:04.232547 31407 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.231950 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.234997 26679 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:04.236071 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.237080 31525 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.237463 31525 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.237824 31525 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.237924 26724 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:04.238281 26724 leader_election.cc:403] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.239038 31273 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:04.239482 31570 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.242853 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:04.250921 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.247332 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.250689 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.252794 27318 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:04.251573 27316 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:04.253616 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.211419 31546 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.258150 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.264339 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.267309 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.268062 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.268915 26678 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:04.269068 26686 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:04.269830 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.270449 26684 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:04.280079 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.281297 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.286886 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:04.281840 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64756.8us
I20260709 13:09:04.279011 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.288813 26682 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:04.288899 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:04.290277 31363 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:04.290367 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:04.295931 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.296007 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.296598 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.296830 26607 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:04.297250 26609 raft_consensus.cc:2376] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10. Re-sending same reply.
I20260709 13:09:04.300473 26612 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:04.304404 27316 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:04.307008 31592 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:04.311833 27313 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:04.276942 31591 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.302711 31525 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.303440 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:04.326706 31290 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.335189 31290 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.331804 31525 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:04.332331 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.332474 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.332988 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:04.328003 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 103167us
I20260709 13:09:04.337003 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.337093 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.337913 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.338289 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.338587 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.338852 31302 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:04.339483 26687 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:04.340476 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.340679 31507 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:04.341881 31283 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:04.343811 31420 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.346896 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:04.381423 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49221us
W20260709 13:09:04.357848 31598 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:09:04.360165 31546 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.364233 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.385835 26758 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.366146 26752 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:04.376071 26678 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:09:04.376256 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.376362 26679 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:04.376880 26684 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:04.374444 26680 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:04.377599 26686 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:04.379864 26682 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:04.347389 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 108440us
I20260709 13:09:04.353250 31328 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:09:04.390591 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.391078 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.395589 31477 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:04.396029 31477 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:04.396875 31477 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.397782 31420 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.398183 31477 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.402618 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.407732 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:04.386058 31290 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:04.438200 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.455991 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.456597 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.456723 26682 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:04.457854 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.457913 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.459002 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.459151 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.460076 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.461591 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:04.464183 26684 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:04.464509 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.465164 26679 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:04.465490 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.465950 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:04.466311 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.466562 26679 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:04.467494 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.467864 31507 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.468338 26678 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:04.468852 31328 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:04.469218 31328 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:04.469321 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.469942 26678 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.470165 31328 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.468307 31507 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:04.472605 31507 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:04.473675 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.408543 31548 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:04.467424 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.482456 26679 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:04.384845 31590 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.435539 31529 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:04.481295 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:04.388103 31417 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:04.487911 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80261us
I20260709 13:09:04.489089 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.489086 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.491128 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:04.494551 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67230.3us
I20260709 13:09:04.430335 31468 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.496660 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.484485 31328 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.499051 26679 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:04.497490 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.515401 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.519174 30696 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:04.519766 30696 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:04.520447 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.499204 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.487779 31529 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:04.476815 31546 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:09:04.529903 26680 raft_consensus.cc:2368] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:04.481580 31407 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.499557 31525 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:04.497481 31597 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.546202 26678 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:04.536003 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.553658 26679 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.541561 31417 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:04.544433 31595 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:09:04.522347 31591 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:04.557235 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.546202 26687 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:04.558947 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.565218 26682 raft_consensus.cc:2410] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:04.545181 31407 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.533623 31529 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:04.569553 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:04.570305 27317 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.571990 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:04.572077 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48931.2us
I20260709 13:09:04.563627 30696 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.549264 31525 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:04.557163 31483 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.546413 31597 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.559478 31468 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.582980 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.588366 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.598502 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:04.596347 26682 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:04.604950 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.584810 31525 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:04.624586 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 85347.1us
I20260709 13:09:04.628628 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.629181 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.629314 26682 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:04.597211 31597 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.634336 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.634755 30696 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.603083 31290 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:04.636644 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.642473 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.643216 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.604311 31483 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.644976 26754 raft_consensus.cc:2393] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:04.643216 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.650133 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:04.756229 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 174631us
I20260709 13:09:04.646952 31606 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:04.644627 26757 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:09:04.778875 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.780927 27317 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
W20260709 13:09:04.784935 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 138483us
I20260709 13:09:04.785107 26678 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:04.785497 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.618726 31407 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.778335 26759 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:04.792593 26679 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:04.798429 26760 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:04.802213 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.802450 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.786996 26680 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:04.799002 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.793385 26757 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:09:04.803627 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.805392 26753 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:04.805603 26760 raft_consensus.cc:2410] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:04.806051 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:04.789541 31531 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.603s	user 0.015s	sys 0.004s
I20260709 13:09:04.803786 26757 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:04.815462 26757 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.815989 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.817029 26756 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:04.816491 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.812525 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.818667 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:04.819249 26760 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:04.820500 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.821197 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:04.821059 31525 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.822216 26758 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:04.821869 31290 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.822796 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.823362 26757 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.824836 31507 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:04.825340 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 190967us
I20260709 13:09:04.825819 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.826553 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.826491 26759 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:04.827411 31572 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.827896 26752 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:04.828492 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:04.829329 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.830148 26759 raft_consensus.cc:2368] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:04.815944 26755 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:04.800518 31417 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.833299 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.827014 31507 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:04.812978 31604 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.222s	user 0.009s	sys 0.000s
I20260709 13:09:04.806947 31302 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:04.839154 31601 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.437s	user 0.005s	sys 0.000s
I20260709 13:09:04.813336 31606 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:04.831473 31531 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.839658 31529 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:04.840600 31435 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.840799 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:04.843842 26684 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:04.845366 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.857105 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:04.860983 26681 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:04.861181 26756 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.859360 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:04.867163 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61172.7us
I20260709 13:09:04.859902 31542 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.880754 31542 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:04.881287 31542 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:04.881507 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 251692us
I20260709 13:09:04.881968 31483 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.882459 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:04.883778 31435 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.884382 31525 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.884739 31529 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:04.854195 31363 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:04.886292 31435 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.858711 31468 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.887890 31468 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.890157 31468 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.891986 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.892683 26681 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:04.893594 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.894701 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.895217 26681 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.895776 31528 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:04.896417 31528 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.896850 31528 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.858834 31590 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.900117 26761 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:04.900621 31548 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.901189 31548 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.906924 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.856045 31302 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.807380 31407 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.910734 31407 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:04.911231 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.911828 31479 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.911968 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.912683 26610 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:04.912478 31479 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:04.914753 31479 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:04.916010 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.916807 26612 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:04.917776 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.919129 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.918833 31597 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:04.920608 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.922219 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62951.5us
I20260709 13:09:04.922312 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:04.925014 31585 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.288s	user 0.003s	sys 0.007s
I20260709 13:09:04.947330 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:04.948216 31531 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:04.948413 31529 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:04.949023 31477 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.949376 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.925048 26756 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:04.928210 26686 raft_consensus.cc:2376] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 8. Re-sending same reply.
I20260709 13:09:04.950251 31507 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.950682 31507 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.951009 31507 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.927428 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.951629 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.952414 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.952737 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.935360 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.954101 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.954632 26680 raft_consensus.cc:2376] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15. Re-sending same reply.
I20260709 13:09:04.881043 31606 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:04.936741 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.946785 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.948884 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:04.950945 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:09:04.929008 31600 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.534s	user 0.001s	sys 0.001s
I20260709 13:09:04.847210 31417 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:04.992147 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.993340 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.996382 26608 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:04.955338 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.953886 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:04.959874 26757 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:04.961062 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:04.998544 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:04.998723 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:04.984573 26687 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:04.999126 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:04.999625 26610 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:05.000891 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:04.997679 26680 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:05.001657 26611 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.002372 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:04.968101 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:04.986451 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:04.985438 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:04.985199 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.004652 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.003260 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.000366 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.006588 26607 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:05.008394 26680 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:05.008875 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:05.011055 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.011843 26612 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.948953 31529 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.015388 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.006490 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.017442 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.018625 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:05.019034 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 68153.5us
I20260709 13:09:05.023447 26608 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.022305 27315 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:05.029170 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.031204 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.032793 31417 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:05.006210 31407 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:05.033106 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:05.034431 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.061414 26607 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:05.039705 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.062165 26605 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.060698 26682 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:05.048089 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:05.005858 31097 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:05.063894 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:05.065076 26679 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:09:05.021510 31592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.024s	sys 0.051s
I20260709 13:09:05.056062 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.025360 31594 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:05.066840 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:05.067179 26606 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:05.068457 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.015544 31273 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:05.067061 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 242260us
I20260709 13:09:05.050218 26680 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:05.050592 26612 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:05.087209 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 204869us
I20260709 13:09:05.087621 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:05.089257 26680 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.092497 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:05.076059 31592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.024s	sys 0.052s
I20260709 13:09:05.091253 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.060482 31407 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:05.093802 26679 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:05.077524 31417 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:05.098685 26687 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:05.059074 31591 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:05.112627 26684 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:05.115159 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:05.118299 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 132927us
W20260709 13:09:05.108628 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 60627.3us
I20260709 13:09:05.129802 31435 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:05.140496 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.193655 31435 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.103281 31407 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.196841 31435 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.096060 31097 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:05.200696 31097 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.102602 31417 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.204169 31417 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.086122 31594 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.191524 26605 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:05.213492 26608 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:05.214198 26610 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:05.218595 31528 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.219857 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.220621 26606 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:05.220914 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.221345 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.221966 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.222615 26606 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:05.111869 31618 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:05.223218 31618 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.223862 31525 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:05.191874 31605 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:05.192235 31591 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:05.194119 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53764.8us
I20260709 13:09:05.225263 31605 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:05.225621 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.226156 31605 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.219106 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.088080 31273 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.227367 26726 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.229321 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.139096 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:05.230280 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 111143us
W20260709 13:09:05.178186 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66633.1us
I20260709 13:09:05.231518 26651 leader_election.cc:400] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:05.231904 26651 leader_election.cc:403] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.177836 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.232764 26604 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.211078 31594 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.222539 26603 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:05.226087 31548 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.245474 31621 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:05.245554 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.168949 31597 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:05.252511 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.247712 26685 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:05.253985 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 77028us
I20260709 13:09:05.254185 26682 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:05.254766 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.250006 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:05.260052 26607 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:05.253130 31328 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:09:05.270515 31597 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:05.271116 31597 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.270890 31618 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.272006 31597 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.274096 31542 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.099931 31529 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.253859 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.272392 31477 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:05.275601 26680 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:05.275967 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.276235 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.281899 26683 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11.
I20260709 13:09:05.284246 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.287129 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.288841 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.291059 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.251132 31525 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.292973 26687 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:05.252846 31606 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.296550 26651 leader_election.cc:400] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:05.299042 26651 leader_election.cc:403] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.302218 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.299901 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.279482 31531 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:05.316179 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86924.1us
I20260709 13:09:05.317022 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.390586 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.300145 31477 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:05.307228 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.300130 31435 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:05.280270 31594 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:05.294241 31358 raft_consensus.cc:2764] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:09:05.474191 26681 consensus_meta.cc:287] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 13:09:05.470916 26604 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:05.494768 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.511874 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.474965 31477 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:05.475260 31621 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:05.318885 31531 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.546615 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.546802 31629 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:05.753142 31629 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:05.753690 31629 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.754478 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:05.548617 31603 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.021s	user 0.000s	sys 0.012s
I20260709 13:09:05.478302 31606 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:05.477123 31525 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:09:05.568312 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.760751 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.761350 26610 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.532856 31625 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.249s
I20260709 13:09:05.475391 31273 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:05.573611 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 255354us
I20260709 13:09:05.616019 31633 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:05.598603 31507 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.002s
W20260709 13:09:05.620718 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.628530 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.632438 31643 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:05.602491 31641 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:05.638739 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.595534 31407 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.634575 31542 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:05.649549 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:05.654791 31639 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:05.646670 31528 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:05.672326 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 58566.2us
I20260709 13:09:05.655315 31548 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.690919 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:05.696606 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 379636us
I20260709 13:09:05.698719 31302 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:05.699761 31627 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 13:09:05.704066 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3130) took 1237 ms. Trace:
I20260709 13:09:05.705453 31634 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.777956 26683 rpcz_store.cc:276] 0709 13:09:04.466448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.952189 (+485741us) service_pool.cc:224] Handling call
0709 13:09:05.703829 (+751640us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54000c3fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:05.703999 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754366336}
I20260709 13:09:05.778738 31634 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.706550 26686 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:05.707168 31645 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.780896 31634 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.781193 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3115) took 1323 ms. Trace:
I20260709 13:09:05.781275 31645 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.781708 26686 rpcz_store.cc:276] 0709 13:09:04.457692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.085769 (+628077us) service_pool.cc:224] Handling call
0709 13:09:05.706346 (+620577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.780473 (+ 74127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.781022 (+   549us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54000c3fd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:05.781139 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402756864}
I20260709 13:09:05.707639 31618 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:05.712049 31630 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:09:05.783984 31618 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.717271 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.694578 31642 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:05.785300 26680 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:05.785415 31642 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.786334 31618 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.722422 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1853) took 1096 ms. Trace:
I20260709 13:09:05.787003 26687 rpcz_store.cc:276] 0709 13:09:04.626443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.113748 (+487305us) service_pool.cc:224] Handling call
0709 13:09:05.169076 (+ 55328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.299974 (+130898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.722145 (+422171us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540002a3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:05.722349 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284496128}
I20260709 13:09:05.725217 26685 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:05.726667 26605 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:05.733328 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 436163us
I20260709 13:09:05.736296 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:05.738377 26681 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:05.739239 26607 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:05.736047 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.792295 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 537) took 1322 ms. Trace:
I20260709 13:09:05.733013 31200 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:05.728071 31417 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
W20260709 13:09:05.547313 31604 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:05.757118 26682 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:05.767521 31525 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.800323 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.765645 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.801501 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.739943 31477 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.766609 26608 raft_consensus.cc:2368] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:05.740234 31621 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:05.771085 31607 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.010s	sys 0.004s
I20260709 13:09:05.804262 31548 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:05.771646 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.800184 31417 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.806025 31542 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:05.806592 31542 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:05.773136 31641 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.775168 31407 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:05.775698 26679 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:05.763808 31606 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.768304 31648 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:09:05.746502 31358 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.793216 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:05.793542 27314 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:05.793879 26612 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:05.794544 26610 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:05.792766 26681 rpcz_store.cc:276] 0709 13:09:04.469622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.894485 (+424863us) service_pool.cc:224] Handling call
0709 13:09:05.792237 (+897752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:05.761648 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:05.775866 31531 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:05.795226 31420 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:05.764618 26611 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.840243 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.795333 31200 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:05.766407 31507 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:05.804602 31607 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.010s	sys 0.005s
I20260709 13:09:05.808367 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.810563 26603 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:05.808866 26607 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:05.809764 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.810158 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.808094 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.863016 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.862959 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.807472 31417 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:05.800657 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:05.865892 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65322.1us
I20260709 13:09:05.866006 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.842135 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.867368 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.843850 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.844825 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.840121 31468 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:09:05.811434 31525 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.809186 31621 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.845837 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.844723 26753 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:05.869524 31507 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:05.848106 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:05.870654 31570 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:05.870316 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.800107 31618 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:09:05.871855 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:05.874053 31660 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.002s
I20260709 13:09:05.846208 31606 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:09:05.848253 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 72388.7us
W20260709 13:09:05.848970 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48753.8us
I20260709 13:09:05.879554 26726 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:05.880664 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.846254 31641 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.849843 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.881736 26756 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:05.852816 26611 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:05.810853 31548 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:05.849767 31531 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:05.841202 31358 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.849908 31200 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.896448 31548 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.903816 31618 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.905553 26604 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:05.853721 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.907124 26754 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.854153 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.854733 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.856105 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.847592 31659 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:05.788173 31642 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:05.863336 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.864522 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.928223 26757 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.862195 26609 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:05.867429 26612 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:05.844062 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 82504.8us
I20260709 13:09:05.884676 26607 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:05.888916 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.929967 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.888958 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:05.890455 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:05.930277 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49740.2us
I20260709 13:09:05.931929 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.884271 31648 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.934752 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.893309 31358 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:05.894070 31546 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:05.894380 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1862) took 1048 ms. Trace:
I20260709 13:09:05.937170 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.896442 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:05.884845 31594 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:05.903893 31625 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:05.907945 26759 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.940440 26605 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:05.908406 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.937633 26679 rpcz_store.cc:276] 0709 13:09:04.846208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.176880 (+330672us) service_pool.cc:224] Handling call
0709 13:09:05.249690 (+ 72810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.833793 (+584103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.894078 (+ 60285us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400313dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:05.894317 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209226624}
I20260709 13:09:05.941243 26611 raft_consensus.cc:2376] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16. Re-sending same reply.
I20260709 13:09:05.908429 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:05.910158 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.942907 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.943445 26758 raft_consensus.cc:2368] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16.
I20260709 13:09:05.801503 31645 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:05.917578 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.919341 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:05.859403 31629 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.919775 26684 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:05.807569 31542 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.920634 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.964234 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.921164 26681 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:05.964923 26610 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:05.921586 31420 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.930051 26606 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:05.932206 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.933039 26761 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:05.933141 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.933781 31507 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:05.935470 26608 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:05.930824 26603 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:05.934448 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.940124 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:05.944183 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.944419 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:05.970573 26607 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.940280 31407 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.971570 26756 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:05.972039 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.972810 26604 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:05.974072 27320 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
W20260709 13:09:05.976585 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 86206.4us
I20260709 13:09:05.977344 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:05.973214 26758 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:05.983587 27315 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:05.917572 31570 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:09:05.992733 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:05.919741 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:05.960120 26757 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:05.959995 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:05.993892 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 74229.3us
I20260709 13:09:05.961154 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:05.961699 31594 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:05.994616 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.940919 31546 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:05.962972 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74122.4us
I20260709 13:09:05.962819 31200 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.969667 31273 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:05.945093 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:05.982481 31507 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:05.973917 31420 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:05.940752 31625 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:05.970794 26759 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:05.997009 26757 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:05.966879 31591 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.012787 27284 leader_election.cc:336] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.709s (SENT)
I20260709 13:09:06.013314 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:06.013234 31591 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:05.963546 31358 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:05.994223 27314 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
W20260709 13:09:06.006515 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74386.4us
I20260709 13:09:06.015879 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:05.987161 31417 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.023814 31479 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:06.026609 31273 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:06.027961 31641 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:06.022671 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45406.9us
I20260709 13:09:05.969915 31531 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:05.970196 31634 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:09:06.005465 31302 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:06.022194 31358 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.003367 31546 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.037853 26760 pending_rounds.cc:85] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 7
I20260709 13:09:06.039074 31655 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.040939 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:05.948971 31648 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.029798 31605 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:09:06.053589 31617 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.054471 31570 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:06.055850 31665 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:09:06.091836 31302 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:06.133698 31302 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:06.060887 31507 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.134887 31594 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.067539 30696 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:06.137333 30696 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:06.137522 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:06.138362 26755 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:06.020135 31611 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:06.074831 31200 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.075814 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:05.982483 31477 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.084147 26612 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:06.079851 31625 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.105852 31358 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.088001 26754 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:06.080971 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65193.4us
I20260709 13:09:06.033209 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.094743 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:06.104417 26760 pending_rounds.cc:107] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:09:06.107452 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66578.4us
I20260709 13:09:06.037351 31593 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.131080 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:06.109084 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:09:06.154273 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48632.4us
I20260709 13:09:06.154644 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:06.126883 31435 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.163800 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.148031 26752 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:06.138263 30696 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:06.155506 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 122412us
I20260709 13:09:06.154295 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:06.166251 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.166549 26755 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:06.167269 26761 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:06.156426 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61844.6us
I20260709 13:09:06.146829 26758 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:06.152536 26760 raft_consensus.cc:2889] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.087365 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:06.151938 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:06.153231 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:06.170936 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:06.144786 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146771us
I20260709 13:09:06.173147 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:06.104974 31417 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:06.143513 31625 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.179782 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.193903 26757 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:06.141007 31611 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.127723 31653 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:06.110767 31645 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:09:06.223294 30696 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:06.144623 31671 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:06.308218 31671 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:06.140744 31644 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:06.309813 31644 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:06.259538 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79863.5us
I20260709 13:09:06.180045 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:06.312179 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 132199us
I20260709 13:09:06.172420 31618 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:06.316816 31477 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.317420 26681 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:06.317525 31477 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:06.317935 26681 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:06.318188 31477 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:06.318802 26684 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:06.197468 31627 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:06.320546 26679 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:06.126436 31643 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:09:06.321194 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:06.200150 31593 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:06.322132 31593 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:06.322570 31593 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.222725 31420 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:06.281798 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 110920us
W20260709 13:09:06.283720 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 91216.8us
I20260709 13:09:06.328497 31420 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:06.329228 31420 consensus_queue.cc:1243] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:06.329371 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:06.285192 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.165385 31655 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.268241 31200 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:06.285794 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112757us
I20260709 13:09:06.178498 31435 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:06.291221 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 125035us
I20260709 13:09:06.291443 31631 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:09:06.293464 31669 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:09:06.363566 31648 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.364765 31648 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:06.367766 31435 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.370891 26753 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:06.294103 31674 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.286301 31653 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:06.318799 26681 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.444298 31653 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:06.444597 26681 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.445629 31674 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.327783 31618 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.331629 26758 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:06.452135 26681 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:09:06.269897 31642 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.344607 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.345907 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:06.350472 26607 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:06.350868 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:06.434633 31591 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:06.351322 26755 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:06.351583 31658 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:06.352069 31417 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.454798 31658 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:06.454495 31591 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:06.455132 26681 pending_rounds.cc:85] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:09:06.455824 26681 pending_rounds.cc:107] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:09:06.455595 31591 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.456178 26681 raft_consensus.cc:2889] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.455924 31658 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.356792 31546 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.359921 31631 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:06.340493 31641 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:06.362082 31477 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.463979 31631 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.396569 26687 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:06.368304 31468 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:06.468459 31468 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:06.468698 27314 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:06.469360 31468 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.470664 31468 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:06.417222 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104077us
I20260709 13:09:06.472155 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:06.472609 31546 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:06.473052 31417 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:06.473798 31417 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:06.474782 31417 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.431607 31614 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:06.436311 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:06.481938 31614 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:06.485198 31653 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.441035 31629 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:06.331944 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 424103us
W20260709 13:09:06.487257 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.562294 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.439095 31570 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.483925 31614 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.490788 31674 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.500257 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:06.577910 27315 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:06.500914 31591 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:06.223580 31273 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.287639 31611 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:06.587159 26683 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:06.564091 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:06.588181 26756 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.348122 31479 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.574149 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 229605us
I20260709 13:09:06.590152 26726 leader_election.cc:400] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:06.590583 26726 leader_election.cc:403] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:06.574862 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 229043us
I20260709 13:09:06.591512 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:06.579324 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:06.582616 31683 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.583205 31617 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.583374 31614 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:06.342602 31097 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.232s
I20260709 13:09:06.510649 31655 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.601056 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:06.601821 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:06.615274 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:06.575438 31548 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:06.577114 31641 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:06.580905 31644 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.369262 31659 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.258s
I20260709 13:09:06.683424 26756 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:06.577817 31570 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.599874 31479 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.606500 31591 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:09:06.607967 31683 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:06.733332 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58497.3us
W20260709 13:09:06.743518 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 412901us
W20260709 13:09:06.785137 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.788635 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:06.790110 26682 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:06.794341 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:06.800348 30696 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:06.800635 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.801331 26650 leader_election.cc:400] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:06.802220 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:06.705694 31644 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:06.640935 31548 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.631945 31655 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.813867 30696 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:06.814301 30696 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:06.816475 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:06.817540 31641 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.819869 31679 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:09:06.820434 31682 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:06.824805 31686 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:09:06.825371 31302 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.000s
I20260709 13:09:06.825747 31302 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:06.826929 31672 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:09:06.827628 31546 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:06.830580 31570 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:06.831171 31687 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:06.832075 31629 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:06.800021 31671 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:06.832858 31671 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.802848 31642 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:06.835448 31407 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.005s
I20260709 13:09:06.839738 26650 leader_election.cc:400] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:06.848722 27315 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:06.811578 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 197636us
I20260709 13:09:06.841579 30696 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:06.855829 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55256.5us
I20260709 13:09:06.857160 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.858883 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:06.862449 30696 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.811100 31417 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:06.825762 31479 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.835597 31671 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.879251 31417 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:06.890496 31703 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:06.881827 31570 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.852880 31629 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.854179 31407 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:06.906630 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49555.9us
I20260709 13:09:06.928836 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.911897 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:06.930051 26685 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
W20260709 13:09:06.922803 31420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.006s
I20260709 13:09:06.809741 31644 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:06.931072 30696 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.879813 31302 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:06.936865 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.008s
I20260709 13:09:06.936421 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:06.836632 31593 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:06.916129 31417 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:06.965610 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.004s	sys 0.012s
I20260709 13:09:06.966934 26681 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:06.966923 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.932168 31697 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.981482 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.967203 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49671.4us
I20260709 13:09:06.980074 30696 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.933943 31653 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:06.973423 31687 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:06.969611 31097 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:06.939731 31611 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:07.028394 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48035.2us
I20260709 13:09:07.034267 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:06.974066 31546 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:09:07.040298 31358 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.001s
I20260709 13:09:06.987262 31697 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.052947 31655 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.058543 31611 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.032687 31687 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.060491 31593 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.064457 31644 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.072750 31696 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:07.073632 31542 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:07.051565 31468 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.004s
W20260709 13:09:07.078410 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.015282 31605 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.109524 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.110154 26576 leader_election.cc:400] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16.
I20260709 13:09:07.110286 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.111200 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.112319 26608 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 10: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:07.090092 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.075487 31417 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.092846 31671 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:09:07.094969 31633 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.095252 31697 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:07.095896 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.099378 31531 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.131166 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:07.096585 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 506568us
W20260709 13:09:07.097254 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 505822us
I20260709 13:09:07.097513 31687 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.084303 31358 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.139178 26756 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:07.098883 31617 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:07.099211 31658 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.102906 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1802) took 1093 ms. Trace:
I20260709 13:09:07.100078 31696 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.121008 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.149359 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.101680 31542 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:07.079721 31706 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.133389 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.141310 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.103735 31528 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:07.151055 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.153240 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:07.157446 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:07.157544 26761 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.127179 31546 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.158833 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:07.159721 26605 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:07.160027 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.154762 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:07.161145 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.155440 26757 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:07.155440 26753 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:07.163549 26604 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:07.166047 26611 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:07.167302 26607 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:07.128961 31633 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.160184 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.170121 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.169576 26752 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:07.157074 31631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.021s	sys 0.036s
W20260709 13:09:07.173012 31631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.021s	sys 0.037s
I20260709 13:09:07.173291 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.173542 31417 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.138756 31531 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:07.177379 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.152864 31687 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.180368 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.186252 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.171065 31633 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.170849 31593 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.130566 31605 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.191481 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:07.193367 31468 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:07.176548 31531 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.193986 31696 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.170475 31659 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:07.174386 31546 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.187479 31641 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:07.216022 31641 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:07.216436 31546 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.188071 31611 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:07.195848 31542 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.196924 31358 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.179031 31606 raft_consensus.cc:2764] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:07.200101 26603 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:07.176681 31705 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:07.206701 31645 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:07.207542 31677 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.915s	user 0.000s	sys 0.013s
I20260709 13:09:07.208564 31273 raft_consensus.cc:2764] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:07.184474 31617 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.176882 31614 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:07.228338 26761 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:07.231364 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:07.233395 31712 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:09:07.231053 31687 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:09:07.216442 31641 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.236080 31707 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:09:07.237426 31542 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:07.236115 31691 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:09:07.240010 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.240717 26761 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:07.229871 31328 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.241570 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.241986 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:07.242163 26761 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:07.243450 26752 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:07.243498 26761 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:07.225427 31525 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.248373 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:07.250815 26752 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:07.252399 31715 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:09:07.244083 31617 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.262665 31617 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.244608 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:07.264019 26755 raft_consensus.cc:606] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.268750 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:07.256134 31525 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.274029 26755 raft_consensus.cc:606] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.274508 26755 raft_consensus.cc:614] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.276535 31531 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:07.277529 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3069) took 1334 ms (client timeout 1735 ms). Trace:
W20260709 13:09:07.277944 26605 rpcz_store.cc:269] 0709 13:09:05.943501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.944935 (+  1434us) service_pool.cc:224] Handling call
0709 13:09:07.277352 (+1332417us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:07.277473 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653883264}
I20260709 13:09:07.278476 26756 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:07.278154 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:09:07.303785 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 111467us
I20260709 13:09:07.279448 26761 raft_consensus.cc:606] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.283064 31605 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.279381 31531 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.302946 31674 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:07.312013 31659 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:09:07.327435 31674 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:07.299860 31548 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:07.314231 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 122908us
I20260709 13:09:07.306348 26761 raft_consensus.cc:614] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.296468 31525 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:07.331840 26612 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:09:07.330482 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.332084 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.269587 31706 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.341169 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.342355 26611 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.343698 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.335953 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:07.352483 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:07.403107 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.404122 26605 raft_consensus.cc:2410] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:07.406937 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:07.408064 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.273037 31633 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.419828 26611 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:09:07.421228 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 72083.4us
W20260709 13:09:07.421399 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 77809.1us
I20260709 13:09:07.340508 31479 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:07.328145 31705 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:09:07.314477 31097 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:09:07.333488 31687 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:09:07.434367 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:07.435209 26761 raft_consensus.cc:606] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.435659 26761 raft_consensus.cc:614] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.406949 31614 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.422303 31273 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:07.308714 31617 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:09:07.431931 31634 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.496636 26683 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:07.439160 31614 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.498617 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:07.488823 31606 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.545557 26685 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:07.494686 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54207.8us
I20260709 13:09:07.499588 26683 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:07.500924 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.501236 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:07.501744 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.500953 31614 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.631290 31653 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.632023 31653 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.634545 31653 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.501530 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.636520 26608 raft_consensus.cc:2376] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12. Re-sending same reply.
I20260709 13:09:07.637674 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.638964 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.640017 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.641085 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.641647 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:07.642382 26686 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.642493 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.645089 31633 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.646008 26687 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:09:07.648444 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 141728us
I20260709 13:09:07.649930 31686 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:07.651121 31709 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:07.651616 31709 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.652638 31709 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.654341 31709 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:07.656558 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 162292us
I20260709 13:09:07.657550 26726 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:07.658805 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 111915us
I20260709 13:09:07.660043 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.663831 31706 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.664018 31363 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:07.664971 31363 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.664628 31706 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.665633 31363 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:07.665987 31363 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.666708 31363 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.488988 31531 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:07.668099 31531 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.670661 31531 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
W20260709 13:09:07.673230 31723 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:09:07.485769 31479 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.676335 31479 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.497617 31468 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.184s
W20260709 13:09:07.683084 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.684055 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.627569 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.632324 31697 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.627569 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.699826 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:09:07.689543 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.692087 31273 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:07.694037 31671 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.485458 31328 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
W20260709 13:09:07.700099 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.629226 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.700491 26761 raft_consensus.cc:606] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.734864 26761 raft_consensus.cc:614] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.700620 26606 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:09:07.719794 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:07.736924 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79465.2us
I20260709 13:09:07.667346 31706 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.741546 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:07.499382 31708 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.753897 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.544975 31200 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:07.765069 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.763090 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:07.717644 31363 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.494176 31719 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.267s
I20260709 13:09:07.502328 31674 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.772415 26687 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:07.754931 31634 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.776291 26608 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:07.732682 31617 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:07.732373 31531 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:07.699888 31703 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:09:07.627797 31606 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.785367 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:07.781045 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:07.731376 31697 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.784288 26686 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:07.791904 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:07.799297 26687 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.787047 31358 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:09:07.769507 31708 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.802012 31606 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.802440 31708 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:07.787185 31328 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.807717 31717 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:07.808045 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.809158 26612 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:07.771314 31200 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.812534 26678 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.810607 31717 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:07.820420 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 149055us
I20260709 13:09:07.824615 31696 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.806044 31634 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.842245 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:07.842996 27319 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:07.844877 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.847589 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:07.839308 26609 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:07.792775 31531 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.796341 31617 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.861089 26686 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:07.850867 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:07.821056 31674 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.865815 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:07.821101 31693 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.840133 31717 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:07.859850 31641 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.003s
I20260709 13:09:07.913295 31641 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:07.913861 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.855726 31633 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:07.855054 31719 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:07.812671 31328 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.921355 31621 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:07.921953 31621 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:07.922431 31328 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.867811 31468 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:09:07.926113 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:07.926689 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.926730 31706 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.927460 31706 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:07.873925 31725 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:07.876212 31507 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:07.876881 31640 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:07.879380 31701 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.901s	user 0.002s	sys 0.008s
I20260709 13:09:07.883490 27319 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:07.884639 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:07.884980 26687 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:07.885385 31695 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:07.806990 31273 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.922971 31621 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:07.968546 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:07.969062 31542 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.969480 27317 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:07.969586 31542 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.970752 31594 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:07.971019 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.973933 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1891) took 1371 ms. Trace:
I20260709 13:09:07.902422 31683 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.860484 31634 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.903406 31692 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:07.907867 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99903.9us
I20260709 13:09:07.978969 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:07.909147 31697 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.910871 31531 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:07.912549 31617 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:07.887496 26605 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:09:07.928504 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1890) took 1326 ms (client timeout 1748 ms). Trace:
W20260709 13:09:07.990190 26680 rpcz_store.cc:269] 0709 13:09:06.601757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.615000 (+ 13243us) service_pool.cc:224] Handling call
0709 13:09:07.928337 (+1313337us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001dae54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:07.928446 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548858624}
I20260709 13:09:07.934577 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.991952 26754 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:07.992010 26752 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:07.968514 31621 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.994418 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.995642 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.963868 31653 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.996378 26754 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:07.954434 31708 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.928490 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:07.963541 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:07.963694 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79126.2us
I20260709 13:09:07.963548 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.964032 27319 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:07.929121 31614 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:07.967185 31640 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:07.967519 31695 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:07.975468 31507 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.010141 31695 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.971161 31594 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:07.902192 31200 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:07.977075 26759 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:07.974563 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.012925 31468 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:07.975582 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.974359 26682 rpcz_store.cc:276] 0709 13:09:06.602214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.602410 (+   196us) service_pool.cc:224] Handling call
0709 13:09:06.632475 (+ 30065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.790708 (+158233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.973701 (+1182993us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001da954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:07.973875 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361855232}
I20260709 13:09:07.915587 31641 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:07.982472 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:07.928642 31671 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:07.935302 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:07.990427 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:07.927623 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:07.940665 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:08.019407 27316 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:07.996248 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.002043 27319 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.929208 31693 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.010363 26603 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:07.929759 31706 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.024760 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.035624 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.010272 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:07.980765 31642 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:09:08.016898 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:08.013914 31468 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:08.037557 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:07.981537 31692 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:08.011559 31645 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.045635 26612 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:08.045264 31695 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.047189 26612 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:08.048489 31468 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:08.049496 31468 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:08.050581 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.050845 31468 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.051236 31097 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:08.004510 31542 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.051687 31097 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:08.052173 31097 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.052296 31640 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.053704 31674 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:08.054134 31674 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.054524 31674 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.010192 31614 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.055886 31593 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:08.056466 31593 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:08.042881 31658 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:08.057564 31658 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.058106 31658 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.057512 31593 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.010803 31709 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:08.060209 31709 consensus_queue.cc:1243] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:08.060333 31645 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:08.061085 31645 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:09:08.064086 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 47296.2us
I20260709 13:09:08.064908 31634 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.065452 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:08.065964 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69801.6us
I20260709 13:09:08.066396 31611 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:08.066828 31611 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.067195 31611 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.067315 26726 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11.
I20260709 13:09:08.068732 31614 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.070951 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:09:08.072647 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.071189 31696 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:07.996415 31653 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.040805 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.084527 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.085913 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.086997 26685 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:08.089000 26604 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:08.039399 31697 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.007905 31708 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.044018 31641 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:08.071954 31709 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.103956 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.108026 26685 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.106465 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.109062 26687 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11.
I20260709 13:09:08.110181 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.111047 26687 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:08.105890 26682 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:08.111924 31731 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.112969 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.112742 31731 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.114384 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.115097 26682 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:08.118175 31731 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:08.120090 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.121690 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.122427 26687 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.124310 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.125586 31645 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.126412 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.126336 31645 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.125841 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.128153 26682 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.130625 31645 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.140422 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.141932 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.142717 26752 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:08.144349 26608 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:08.145067 26680 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:08.146421 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:08.090782 31542 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:08.152825 26612 raft_consensus.cc:2410] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:09:08.161764 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.169333 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.101646 31697 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.181577 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.043301 31671 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.195073 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.191483 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.086194 31621 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:09:08.141088 31709 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:08.191699 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 257678us
I20260709 13:09:08.100461 31548 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:09:08.197094 26726 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11.
I20260709 13:09:08.208272 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:08.209339 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 274114us
I20260709 13:09:08.211781 26686 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:08.192723 31697 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.217448 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.213162 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.199270 31709 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.219452 26686 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:08.212990 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.221169 26726 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.221413 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.222453 26685 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:08.194162 31696 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.220578 26752 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:08.225507 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.275202 26686 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.275564 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.225656 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.226588 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.143708 31594 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.236441 26687 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:08.211977 31642 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.225680 31621 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.257259 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.300889 26678 raft_consensus.cc:2410] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:08.262290 31640 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:08.306612 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 150168us
I20260709 13:09:08.309229 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.265754 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.316896 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:08.272207 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62972.1us
I20260709 13:09:08.231539 31641 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.277379 31683 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.277002 26681 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:08.277997 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.285442 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.303527 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:08.327098 26754 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.276459 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.277894 31507 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.332600 26678 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:08.334723 26687 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:08.335355 26678 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:08.337401 26678 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:09:08.337859 26678 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:09:08.331800 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.342828 26758 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:08.345439 26681 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:09:08.346990 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:08.350839 26681 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:08.350944 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.351648 26758 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:08.323329 31703 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.308065 31723 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:08.338142 26678 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 13:09:08.354023 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:08.279871 31696 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.278313 31717 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.329043 26682 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:08.362175 26678 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 13:09:08.370203 26678 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.307423 31642 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.344940 31645 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.363245 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:08.364718 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.328083 26686 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:08.338943 31542 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:08.372058 26687 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:08.362445 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:08.378666 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 152197us
I20260709 13:09:08.382241 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.347025 31273 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.324239 31640 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.355065 31756 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.385607 26756 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:08.390185 26685 raft_consensus.cc:2410] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:08.399540 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.400877 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.402184 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.403218 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.404315 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:08.399539 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.412878 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 202271us
I20260709 13:09:08.388522 31328 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:08.390301 31708 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.369410 31703 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:08.407442 31641 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.440833 31762 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.441556 31762 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.444398 31762 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.445756 31762 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.446015 31771 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.407282 31528 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.399210 31645 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.416420 31606 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.409446 31634 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.446540 31762 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.453835 31774 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.454689 31747 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.458935 31748 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:08.466586 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.398969 31273 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.425925 31671 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.469779 27321 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:08.425956 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 116833us
I20260709 13:09:08.432024 31617 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.482684 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.437795 31328 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:08.472433 31762 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.473820 31273 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.477308 31703 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.477217 31697 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.477641 31606 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.464083 31708 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:09:08.478802 31749 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:09:08.471448 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:08.467950 31735 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:08.457953 31747 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.484683 31528 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:08.512920 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 150553us
W20260709 13:09:08.508039 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 257137us
W20260709 13:09:08.478363 31736 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:08.406960 31756 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.514762 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.517484 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:08.501144 31671 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:09:08.534636 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2759983780000539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:09:08.560333 27315 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:08.554705 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1952) took 1050 ms. Trace:
I20260709 13:09:08.559095 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1950) took 1055 ms. Trace:
I20260709 13:09:08.541831 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:08.563256 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:08.604893 27320 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:08.506187 31774 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.542209 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:08.601961 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87302.9us
I20260709 13:09:08.603404 26604 rpcz_store.cc:276] 0709 13:09:07.504020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.753583 (+249563us) service_pool.cc:224] Handling call
0709 13:09:08.554495 (+800912us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000203d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:08.554633 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540671872}
I20260709 13:09:08.607442 27313 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:08.542583 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:08.608783 27317 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:08.603737 26608 rpcz_store.cc:276] 0709 13:09:07.503636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.786235 (+282599us) service_pool.cc:224] Handling call
0709 13:09:07.788327 (+  2092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.148950 (+360623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.558821 (+409871us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540017b454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:08.559041 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728893696}
I20260709 13:09:08.515432 31771 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:08.533114 31764 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:09:08.537912 31750 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:09:08.603070 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0338983780000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:09:08.619768 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.532586 31743 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:09:08.484594 31542 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.552549 31717 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:08.611193 31674 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:09:08.535171 31621 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.644001 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.624245 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.719230 26686 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:08.645900 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.541051 31762 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:08.548328 31642 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.725169 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.729709 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.619262 31771 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.523478 31528 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:08.719623 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95460.7us
I20260709 13:09:08.720640 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.738394 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.608460 31696 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:08.531688 31640 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:08.562861 31756 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.722303 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.504974 31617 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:09:08.731426 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.523780 31768 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:08.620847 31761 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.736995 26679 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:08.538043 31709 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.746991 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.762589 26686 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:08.771852 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.776798 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:08.779435 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57221.6us
I20260709 13:09:08.746058 31771 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.780718 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.734797 31273 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.748172 31641 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.734620 31328 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.790630 26679 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:09:08.791167 26679 pending_rounds.cc:85] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:08.791501 26679 pending_rounds.cc:107] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:09:08.791860 26679 raft_consensus.cc:2889] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.785897 26686 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:08.745162 31717 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.763572 31768 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:08.763759 31761 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:08.804358 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57434us
I20260709 13:09:08.764637 31697 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.724045 31674 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.807487 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.779769 31770 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.828575 31770 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.829439 31528 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.832158 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.832470 31775 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:08.832917 26758 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:08.755231 31525 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:08.797711 31774 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:08.818006 31761 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:08.788201 31726 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.899s	user 0.004s	sys 0.001s
I20260709 13:09:08.828917 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:08.839027 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99299.1us
I20260709 13:09:08.799976 31641 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.149266 26760 rpcz_store.cc:276] 0709 13:09:06.009836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.010036 (+   200us) service_pool.cc:224] Handling call
0709 13:09:06.034261 (+ 24225us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:06.332221 (+297960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.332250 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:06.348700 (+ 16450us) log.cc:844] Serialized 52 byte log entry
0709 13:09:06.799639 (+450939us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:06.924605 (+124966us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.102459 (+177854us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.102634 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.102707 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.102742 (+    35us) raft_consensus.cc:1685] finished
0709 13:09:07.102753 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.102857 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":430381,"prepare.queue_time_us":35930,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":7842,"raft.queue_time_us":264788,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":35012,"spinlock_wait_cycles":26206720,"thread_start_us":300817,"threads_started":2,"wal-append.queue_time_us":366650}
I20260709 13:09:08.805066 31755 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:08.844126 27319 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:09:08.844429 31617 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:08.844713 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.845274 31273 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.847084 31634 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.847741 31606 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.848662 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.841804 31774 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.854091 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1897) took 1352 ms. Trace:
I20260709 13:09:08.859390 31761 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.864791 31709 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:08.869722 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.876331 26758 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:08.819263 31747 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:08.842057 31611 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 13:09:08.820461 31717 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.889339 31779 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.889784 31634 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:08.890882 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.852808 31640 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:08.893556 31692 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:08.919234 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.919725 31692 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.919881 26758 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:08.920904 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.921451 26758 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:08.922222 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.923272 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.898908 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3091) took 1042 ms. Trace:
I20260709 13:09:08.924888 31761 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.923870 26611 rpcz_store.cc:276] 0709 13:09:07.856936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.023621 (+166685us) service_pool.cc:224] Handling call
0709 13:09:08.024082 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.077525 (+ 53443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.077572 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.107017 (+ 29445us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.253484 (+146467us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:08.253547 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.898498 (+644951us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54003791d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:08.898543 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.898588 (+    45us) raft_consensus.cc:1685] finished
0709 13:09:08.898600 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.898837 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4192,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9584,"spinlock_wait_cycles":121809280,"thread_start_us":56254,"threads_started":1,"wal-append.queue_time_us":262606}
I20260709 13:09:08.908288 27320 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:09:08.925799 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.868868 31641 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.912391 27315 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:08.914039 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.906224 26684 rpcz_store.cc:276] 0709 13:09:07.501625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.501731 (+   106us) service_pool.cc:224] Handling call
0709 13:09:07.501990 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.628740 (+126750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.628784 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.629400 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.810776 (+181376us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:07.810815 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.810879 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.502502 (+691623us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:08.853652 (+351150us) raft_consensus.cc:1685] finished
0709 13:09:08.853687 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.854003 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127748,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":13388672,"thread_start_us":180962,"threads_started":1,"wal-append.queue_time_us":247843}
I20260709 13:09:08.911134 31774 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.943019 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.943428 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:08.943800 26680 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:08.926127 27320 pending_rounds.cc:85] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 7
I20260709 13:09:08.945611 27320 pending_rounds.cc:107] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 13:09:08.945996 27320 raft_consensus.cc:2917] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 13:09:08.946676 27320 raft_consensus.cc:2889] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:08.946972 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77331us
I20260709 13:09:08.948362 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:08.950455 26685 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:09:08.909214 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.952042 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:08.945891 31755 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.928562 31738 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:08.931734 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124338us
I20260709 13:09:08.932283 31683 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:08.932410 31548 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:08.933212 31746 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:08.927027 31097 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.874s	user 0.004s	sys 0.008s
I20260709 13:09:08.959826 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.954416 31618 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:08.935182 31671 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.937897 31770 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:08.938925 31658 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.004s
W20260709 13:09:08.942272 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.949565 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:08.956471 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:08.956753 31755 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.957562 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:08.994349 26757 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:08.933283 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:08.963415 26680 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:09:08.942018 31779 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:08.917143 31611 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.974155 26758 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:08.974640 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.962007 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:08.958688 31738 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:08.962515 31683 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:08.964470 31697 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.962215 31746 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:08.885350 31768 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:08.979624 31696 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.975536 31468 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.984395 31671 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.002112 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:08.966353 31097 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.005564 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.009096 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.019450 26612 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:08.997658 31770 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:09.025362 26752 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:09.016314 31696 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.014008 31775 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.041620 31693 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:08.993659 31658 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:09.052691 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.053577 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1947) took 1550 ms (client timeout 1939 ms). Trace:
I20260709 13:09:09.069391 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:09.036610 31752 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:09:09.008224 31761 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:09.054910 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.059544 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.016980 31671 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.007547 31674 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:09.095705 26607 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:09.117143 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.095878 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.096385 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.118894 26611 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
W20260709 13:09:09.067862 26603 rpcz_store.cc:269] 0709 13:09:07.503120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.642171 (+139051us) service_pool.cc:224] Handling call
0709 13:09:09.045915 (+1403744us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:09.053511 (+  7596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829657344}
I20260709 13:09:09.070099 27321 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
W20260709 13:09:09.102439 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.020049 31768 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:09.010095 31747 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.101294 31775 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.109285 31779 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.133715 26678 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:09.105052 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:09.110800 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1833) took 1003 ms. Trace:
I20260709 13:09:09.111804 26605 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:09.111871 31717 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:09.065053 31653 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:09.120718 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.125126 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:09.124039 31594 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.080667 31770 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.135653 26754 rpcz_store.cc:276] 0709 13:09:08.107703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.370715 (+263012us) service_pool.cc:224] Handling call
0709 13:09:08.372089 (+  1374us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:08.372620 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.372654 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:08.373459 (+   805us) log.cc:844] Serialized 78 byte log entry
0709 13:09:08.462051 (+ 88592us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.465783 (+  3732us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.466043 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.466119 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.037298 (+571179us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180040dda0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:09.109319 (+ 72021us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b2400198f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:09:09.110599 (+  1280us) raft_consensus.cc:1685] finished
0709 13:09:09.110616 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.110749 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3502,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":6827,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":43280,"spinlock_wait_cycles":24107520,"thread_start_us":54135,"threads_started":1,"wal-append.queue_time_us":130771}
I20260709 13:09:09.119410 31328 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:09.161304 27313 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.016605 31776 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:09:09.164201 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 1945) took 1162 ms. Trace:
I20260709 13:09:09.130800 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.019873 31468 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.123288 31687 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.186103 26756 rpcz_store.cc:276] 0709 13:09:07.972421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.975208 (+  2787us) service_pool.cc:224] Handling call
0709 13:09:09.134936 (+1159728us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400226854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:09.135043 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843241344}
W20260709 13:09:09.188563 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57880.1us
I20260709 13:09:09.165433 31722 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.191192 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.183894 31770 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.191977 31731 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.210268 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.211007 31793 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.209125 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:09.223738 26609 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:09.187920 31328 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.167860 31738 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.197346 31528 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:09:09.222141 31708 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:09.260751 31722 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:09:09.168262 31746 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.196002 31687 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:09.296633 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.334604 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 99431.3us
I20260709 13:09:09.235811 31717 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:09.347795 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 83997.3us
W20260709 13:09:09.357117 31728 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.476s	user 0.000s	sys 0.004s
I20260709 13:09:09.359736 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1842) took 1249 ms. Trace:
I20260709 13:09:09.360154 26756 rpcz_store.cc:276] 0709 13:09:08.110344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.199315 (+1088971us) service_pool.cc:224] Handling call
0709 13:09:09.199651 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.224371 (+ 24720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.224408 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.224456 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.224500 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.359435 (+134935us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54000b95d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:09.359490 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.359646 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56333056}
I20260709 13:09:09.361753 26756 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:09.362308 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1843) took 1251 ms. Trace:
I20260709 13:09:09.362630 26756 rpcz_store.cc:276] 0709 13:09:08.110634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.361264 (+1250630us) service_pool.cc:224] Handling call
0709 13:09:09.361562 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.362111 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.362260 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.365904 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:09.366339 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1844) took 1255 ms. Trace:
I20260709 13:09:09.366757 26756 rpcz_store.cc:276] 0709 13:09:08.110949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.365622 (+1254673us) service_pool.cc:224] Handling call
0709 13:09:09.365881 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.366046 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.366071 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.366109 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:09.366144 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.366192 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.366292 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.376266 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:09.342868 31782 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:09.382923 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1898) took 1749 ms. Trace:
I20260709 13:09:09.383333 26683 rpcz_store.cc:276] 0709 13:09:07.633927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.647459 (+ 13532us) service_pool.cc:224] Handling call
0709 13:09:07.647846 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.648299 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.648338 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.648863 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.791607 (+142744us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:07.791646 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.791737 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.356466 (+1564729us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:09.362982 (+  6516us) raft_consensus.cc:1685] finished
0709 13:09:09.363003 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.382859 (+ 19856us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1327,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":4581120,"thread_start_us":142434,"threads_started":1,"wal-append.queue_time_us":217865}
I20260709 13:09:09.387873 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:09.388517 26683 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:09.362838 31674 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:09.343997 31686 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.389427 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:09.398125 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:09.401710 26684 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:09.398772 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:09.404043 26679 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:09.344189 31717 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.392221 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1839) took 1282 ms. Trace:
I20260709 13:09:09.389729 31674 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.408538 26758 rpcz_store.cc:276] 0709 13:09:08.109454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.015015 (+905561us) service_pool.cc:224] Handling call
0709 13:09:09.063104 (+ 48089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.066666 (+  3562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.066713 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.109793 (+ 43080us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.202439 (+ 92646us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:09.202479 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.202549 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.392017 (+189468us) raft_consensus.cc:1685] finished
0709 13:09:09.392035 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.392165 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6473,"raft.queue_time_us":62223,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15928,"thread_start_us":92183,"threads_started":1,"wal-append.queue_time_us":280009}
I20260709 13:09:09.401407 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1838) took 1292 ms. Trace:
I20260709 13:09:09.335124 31755 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:09.411970 26757 rpcz_store.cc:276] 0709 13:09:08.109126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.011828 (+902702us) service_pool.cc:224] Handling call
0709 13:09:09.056429 (+ 44601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.065508 (+  9079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.065554 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.066158 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.230020 (+163862us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.230077 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.230168 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.401074 (+170906us) raft_consensus.cc:1685] finished
0709 13:09:09.401117 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.401328 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40330,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7905,"thread_start_us":62093,"threads_started":1,"wal-append.queue_time_us":265173}
I20260709 13:09:09.364881 31746 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:09.383536 31780 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:09:09.416954 26604 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:09.422289 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:09.423116 26604 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:09.411386 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 71935.4us
I20260709 13:09:09.418078 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.425691 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.426857 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:09.396301 31785 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:09:09.397846 31788 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:09:09.419795 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.380669 31658 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.428620 26683 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:09.396948 31787 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:09:09.432714 26610 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:09.392177 31696 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.394014 31686 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.437180 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.444909 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.446040 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.433983 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:09.447450 31784 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:09:09.447552 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:09.411602 31717 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:09.438534 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.454911 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.439056 26757 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:09.448938 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.451221 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.457185 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.457617 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 554) took 1335 ms. Trace:
I20260709 13:09:09.458042 26757 rpcz_store.cc:276] 0709 13:09:08.122100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.413561 (+1291461us) service_pool.cc:224] Handling call
0709 13:09:09.434749 (+ 21188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.457376 (+ 22627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.457563 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.455870 26605 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:09.457312 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:09.460813 26605 raft_consensus.cc:1217] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 13:09:09.454290 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:09.464864 26605 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:09.464962 26604 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:09:09.466897 31754 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:09.468010 26608 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:09.460013 31786 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:09:09.466120 31756 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.465981 31706 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.457719 31696 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:09.478001 31641 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 13:09:09.467649 31605 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:09.479065 31683 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.483348 31671 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.487394 31525 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:09.488428 31808 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.488969 31799 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:09.494606 31789 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:09.496697 31328 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.497063 31528 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.498191 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3096) took 1614 ms. Trace:
W20260709 13:09:09.498570 31771 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.001s
I20260709 13:09:09.498845 31813 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:09.468453 26604 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:09.554898 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 693) took 1623 ms. Trace:
I20260709 13:09:09.555408 26604 pending_rounds.cc:85] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 8
I20260709 13:09:09.555864 26604 pending_rounds.cc:107] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:09.556205 26604 raft_consensus.cc:2889] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.510219 27313 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
W20260709 13:09:09.471426 31774 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
I20260709 13:09:09.516577 26757 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:09.467622 31097 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:09.470417 31468 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.559068 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 555) took 1436 ms. Trace:
I20260709 13:09:09.564210 26757 rpcz_store.cc:276] 0709 13:09:08.122425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.464541 (+1342116us) service_pool.cc:224] Handling call
0709 13:09:09.509364 (+ 44823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.558703 (+ 49339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.558991 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.565933 26758 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:09.517835 31605 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:09.538985 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.539386 31507 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.540520 31671 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.541153 31683 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.541071 31799 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.523299 31525 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:09.542135 31815 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:09.542748 27315 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:09:09.517535 31773 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:09.514532 31641 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:09.549237 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 95029.2us
I20260709 13:09:09.467873 31775 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.550024 26612 rpcz_store.cc:276] 0709 13:09:07.883499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.204007 (+320508us) service_pool.cc:224] Handling call
0709 13:09:08.220977 (+ 16970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.020722 (+799745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.497940 (+477218us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002391d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:09.498107 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830694656}
I20260709 13:09:09.552377 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3162) took 1415 ms. Trace:
I20260709 13:09:09.552775 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 701) took 1425 ms. Trace:
W20260709 13:09:09.521632 31803 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:09.592154 26754 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:09:09.569069 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:09.529032 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:09.571036 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 552) took 1449 ms. Trace:
I20260709 13:09:09.555445 27314 rpcz_store.cc:276] 0709 13:09:07.927757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.941257 (+ 13500us) service_pool.cc:224] Handling call
0709 13:09:07.941645 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.217763 (+276118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.217791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.217826 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:08.217854 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.551076 (+1333222us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002b8754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:09.551121 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.551253 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634539264}
I20260709 13:09:09.593293 26758 rpcz_store.cc:276] 0709 13:09:08.121417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.410994 (+1289577us) service_pool.cc:224] Handling call
0709 13:09:09.433059 (+ 22065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.565729 (+132670us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b540025a420. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:09:09.570757 (+  5028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.570977 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10094976}
I20260709 13:09:09.589622 27319 rpcz_store.cc:276] 0709 13:09:08.101846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.101999 (+   153us) service_pool.cc:224] Handling call
0709 13:09:08.102346 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.868614 (+766268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.527103 (+658489us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54005a4bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:09.527305 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705383296}
I20260709 13:09:09.589502 26687 rpcz_store.cc:276] 0709 13:09:08.142840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.336407 (+193567us) service_pool.cc:224] Handling call
0709 13:09:08.371741 (+ 35334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.381342 (+  9601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.552180 (+1170838us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b5400160dd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:09.552321 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80529280}
I20260709 13:09:09.589915 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:09.595049 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:09.595363 26757 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.596832 26761 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:09.597509 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1848) took 1216 ms. Trace:
I20260709 13:09:09.579609 26759 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:09.520350 31696 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.572403 31328 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.598351 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 556) took 1475 ms. Trace:
I20260709 13:09:09.563371 31528 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.602517 26759 rpcz_store.cc:276] 0709 13:09:08.122795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.554571 (+1431776us) service_pool.cc:224] Handling call
0709 13:09:09.579294 (+ 24723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.598129 (+ 18835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.598307 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.597824 26761 rpcz_store.cc:276] 0709 13:09:08.381049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.596260 (+1215211us) service_pool.cc:224] Handling call
0709 13:09:09.596543 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.597277 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.597459 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.600733 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:09.605700 26761 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:09.590701 31791 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:09:09.608222 27314 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:09.566628 31774 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.561929 31771 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.577536 31659 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:09:09.581001 31793 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:09:09.551082 31789 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.582175 31507 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.599398 31645 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:09.589288 31817 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:09.608175 31813 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:09.657608 31468 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:09:09.665948 31799 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.668262 31641 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:09.670156 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1840) took 1560 ms. Trace:
I20260709 13:09:09.670729 26761 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:09.681207 27312 raft_consensus.cc:2368] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10.
I20260709 13:09:09.681977 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.684689 31696 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:09.684995 31692 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 13:09:09.602059 31722 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:09:09.650219 31674 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.693501 31507 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:09.703773 31594 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:09:09.705530 26757 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:09.646703 31640 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.712291 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 551) took 1591 ms. Trace:
I20260709 13:09:09.589017 31815 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.648847 31775 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.726110 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:09.728341 26612 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:09.717410 31813 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:09.608294 31328 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.718380 26755 rpcz_store.cc:276] 0709 13:09:08.109756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.067048 (+957292us) service_pool.cc:224] Handling call
0709 13:09:09.067389 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.183794 (+116405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.183823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.184608 (+   785us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.599393 (+414785us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:09.599437 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.599515 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.669932 (+ 70417us) raft_consensus.cc:1685] finished
0709 13:09:09.669954 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.670098 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66542,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":21529,"thread_start_us":492397,"threads_started":2,"wal-append.queue_time_us":468994}
I20260709 13:09:09.735199 26606 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:09.599977 31605 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.658252 31525 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.742597 31789 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:09.778666 31823 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:09.755223 31640 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.779286 31823 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.781615 31823 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.781701 31640 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:09.756227 31695 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.783133 31695 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.786053 31695 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:09.739411 31768 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.603s	user 0.003s	sys 0.009s
I20260709 13:09:09.746592 26756 rpcz_store.cc:276] 0709 13:09:08.121042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.368223 (+1247181us) service_pool.cc:224] Handling call
0709 13:09:09.368536 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:09.368974 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.369003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:09.400394 (+ 31391us) log.cc:844] Serialized 52 byte log entry
0709 13:09:09.572881 (+172487us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:09.572919 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.572986 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.711920 (+138934us) raft_consensus.cc:1685] finished
0709 13:09:09.711954 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.712193 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4969,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10948,"thread_start_us":170683,"threads_started":1,"wal-append.queue_time_us":199729}
I20260709 13:09:09.789675 27320 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:09.754482 26753 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:09.756937 31605 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.757755 31525 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:09.762169 31328 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.746433 31808 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.746774 31696 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:09.769786 31804 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
W20260709 13:09:09.770097 31770 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:09:09.771270 31774 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.772600 31771 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.731648 31797 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:09.773512 31693 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.774902 31815 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.776031 31775 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:09.777952 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.777741 31813 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.724805 31817 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.804831 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1958) took 1029 ms. Trace:
I20260709 13:09:09.826337 26753 rpcz_store.cc:276] 0709 13:09:08.775339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.733549 (+958210us) service_pool.cc:224] Handling call
0709 13:09:09.754158 (+ 20609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.792003 (+ 37845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.804742 (+ 12739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51712}
W20260709 13:09:09.809094 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.804085 31768 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.848220 31097 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:09.848860 31097 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:09.850026 31708 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:09.849855 31097 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.850622 31708 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.851184 31097 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.852792 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:09.854364 27285 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:09.855958 31747 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:09.855814 31746 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:09.856745 31747 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:09.857496 31746 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:09.808709 31696 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:09.858062 31746 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:09.858320 31611 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:09.858728 31696 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.859982 31696 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:09.863588 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1830) took 1757 ms. Trace:
I20260709 13:09:09.864080 26752 rpcz_store.cc:276] 0709 13:09:08.106641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.346715 (+240074us) service_pool.cc:224] Handling call
0709 13:09:09.863428 (+1516713us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54000da7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:09.863533 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929408384}
I20260709 13:09:09.865648 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:09.866451 31528 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:09.859061 31746 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.868883 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:09.808086 31770 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.869606 26760 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:09.875905 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:09.878952 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:09.767585 31717 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.838441 31687 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:09.897375 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:09.901584 26753 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.898206 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:09.902732 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.903283 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.906252 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.828150 31817 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:09.922847 26759 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:09.885160 31645 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:09.893343 31799 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:09.821547 31693 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.811870 31808 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.880080 31768 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:09.928010 31799 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:09.937801 31816 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.961957 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 954559us
I20260709 13:09:09.970050 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:09.970834 26650 connection.cc:256] RPC call timeout handler was delayed by -1.37720054600004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:09:09.971349 26650 leader_election.cc:336] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.622s (SENT)
I20260709 13:09:09.971490 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.972175 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3177) took 1024 ms. Trace:
I20260709 13:09:09.973923 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:09.972533 26685 rpcz_store.cc:276] 0709 13:09:08.948101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.951262 (+  3161us) service_pool.cc:224] Handling call
0709 13:09:08.951524 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.958696 (+  7172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.958723 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.959134 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.150110 (+190976us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:09.189654 (+ 39544us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.971879 (+782225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.971947 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.971987 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:09.972001 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.972118 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":780003,"prepare.queue_time_us":38464,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":185,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":2351,"thread_start_us":175112,"threads_started":1,"wal-append.queue_time_us":266056}
W20260709 13:09:09.976105 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 767068us
W20260709 13:09:09.976281 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2845005460000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:09:09.977299 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:09.979074 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:09.980161 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:09.980872 26604 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:09.983572 26612 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:09.934237 31645 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.933940 31815 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:09:09.992628 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:09.989012 31776 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:10.000607 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3179) took 1052 ms. Trace:
I20260709 13:09:10.001017 26680 rpcz_store.cc:276] 0709 13:09:08.948624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.995869 (+ 47245us) service_pool.cc:224] Handling call
0709 13:09:08.996153 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.996623 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:09.011276 (+ 14653us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.976156 (+964880us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.976574 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.976714 (+   140us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:09.976745 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.976802 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.000390 (+ 23588us) raft_consensus.cc:1685] finished
0709 13:09:10.000411 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.000543 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1639985,"prepare.queue_time_us":14371,"prepare.run_cpu_time_us":283,"prepare.run_wall_time_us":7930,"raft.queue_time_us":710238,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":2800,"thread_start_us":159935,"threads_started":1,"wal-append.queue_time_us":373475}
I20260709 13:09:10.003842 31697 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:10.004143 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.004437 31697 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.005527 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.006668 31697 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.007365 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:10.003868 31717 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.006693 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.009310 26760 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:10.010540 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.011829 31755 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:10.012367 31755 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:09.962814 31799 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:10.014314 31755 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.015281 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.016014 26687 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.016182 26685 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:10.016832 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.017273 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.017846 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.018342 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.018857 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.019706 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.019986 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.020318 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.020592 26683 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:10.021052 26760 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:10.021893 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.023154 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.020891 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.023485 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.024498 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.024878 31770 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.024933 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.025673 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.026057 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:09.979740 31816 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.027169 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.028486 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.029095 31816 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.018926 26685 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
W20260709 13:09:10.030234 31830 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:10.030571 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.034924 26685 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:10.033012 31770 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:10.034374 26687 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.032454 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.035612 31653 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:10.037555 31642 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:10.060478 31640 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.060652 31658 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:10.061507 31658 consensus_queue.cc:1243] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:10.061189 31640 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.061954 31776 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:10.062548 31776 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:10.038532 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 615) took 1134 ms. Trace:
I20260709 13:09:10.040225 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:10.064770 27313 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:10.029155 26680 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:10.040388 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:10.065965 27321 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:10.040830 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:10.041596 26606 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:10.044396 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:10.047878 26753 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:10.059830 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.064491 27312 rpcz_store.cc:276] 0709 13:09:08.904154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.911727 (+  7573us) service_pool.cc:224] Handling call
0709 13:09:10.038325 (+1126598us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400570154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:10.038456 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562313472}
I20260709 13:09:10.068269 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.068701 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.070160 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.067428 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.046761 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:10.081621 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:10.082800 26687 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.025735 26760 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:10.059109 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:10.084049 27317 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:10.059767 31653 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:10.093811 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.095286 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:10.096686 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.099192 26724 leader_election.cc:400] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10.
W20260709 13:09:10.099490 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55184.3us
I20260709 13:09:10.064062 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:09.995059 31542 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:10.095445 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.066112 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.102658 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:10.105885 26683 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.102312 26687 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.106256 26680 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:10.106901 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.107818 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.108543 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.104929 31752 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:10.110476 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.094799 31653 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:10.111630 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.112514 26760 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:10.143589 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:10.144963 26687 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:10.146188 26687 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:10.145880 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.148510 31548 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:10.149483 26683 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:10.150128 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.150861 26753 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:10.041296 31828 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:09:10.065153 31761 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
W20260709 13:09:10.156810 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 51049.7us
I20260709 13:09:10.104592 31774 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.104866 31542 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.101902 31697 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.165658 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:10.112998 31640 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.149292 31752 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.162241 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.104560 31824 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:10.060521 31642 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.172036 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 571) took 1523 ms. Trace:
I20260709 13:09:10.157091 31707 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.101459 31770 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:09:10.144177 31813 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:10.172641 26681 rpcz_store.cc:276] 0709 13:09:08.648343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.717690 (+ 69347us) service_pool.cc:224] Handling call
0709 13:09:08.718055 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.718270 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:08.754952 (+ 36682us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.948992 (+1194040us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18004a8ae0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:10.171550 (+222558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.171605 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:10.171651 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.171732 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.171970 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24360,"prepare.queue_time_us":56024,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":956131,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2477824,"thread_start_us":462011,"threads_started":2,"wal-append.queue_time_us":251730}
I20260709 13:09:10.112066 31653 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.160933 31692 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:10.063486 31776 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.190171 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:10.177330 26683 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:10.179518 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.167474 31542 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.178709 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.153743 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:10.214083 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65245us
I20260709 13:09:10.216256 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.218115 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:10.210305 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.214682 26753 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:10.219832 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:10.174278 31824 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:10.174908 31707 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:10.221297 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.222602 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.223826 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.187965 31614 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:10.231547 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.191476 31762 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.189221 31692 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:10.235494 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.246255 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.241869 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.225260 31683 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:10.190892 31813 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.248697 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.228621 31824 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:10.190645 31816 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:10.227597 31707 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.233057 31653 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.302129 31813 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.268539 26753 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:10.232540 31468 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.271286 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.249801 31692 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:10.310964 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.311791 26753 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:10.234776 31770 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:10.265381 31683 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.336371 31683 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:10.276512 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3181) took 1327 ms. Trace:
I20260709 13:09:10.340000 26684 rpcz_store.cc:276] 0709 13:09:08.949061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.402506 (+453445us) service_pool.cc:224] Handling call
0709 13:09:09.402869 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.979478 (+576609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.979508 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.992377 (+ 12869us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.144561 (+152184us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:10.144602 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.144673 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.276303 (+131630us) raft_consensus.cc:1685] finished
0709 13:09:10.276322 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.276453 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576213,"raft.queue_time_us":596793,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":144896,"threads_started":1,"wal-append.queue_time_us":212388}
I20260709 13:09:10.277074 31841 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:09:10.342665 31841 consensus_queue.cc:1243] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:10.278187 31795 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.284584 31837 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:09:10.285683 31839 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:10.286641 31834 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:09:10.287508 31836 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:09:10.288298 26611 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:10.288749 31642 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.290557 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3182) took 1341 ms. Trace:
I20260709 13:09:10.391044 26679 rpcz_store.cc:276] 0709 13:09:08.949301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.404757 (+455456us) service_pool.cc:224] Handling call
0709 13:09:09.420582 (+ 15825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.989696 (+569114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.989725 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.990126 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.149650 (+159524us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:10.149701 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.149785 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.290334 (+140549us) raft_consensus.cc:1685] finished
0709 13:09:10.290356 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.290498 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568723,"raft.queue_time_us":579271,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":159202,"threads_started":1,"wal-append.queue_time_us":298440}
I20260709 13:09:10.385182 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:10.240067 31614 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.305087 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.299424 26760 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:10.230136 31752 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:10.309335 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63279.9us
I20260709 13:09:10.226384 31799 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.313827 31761 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:10.318082 31833 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:10.318934 31542 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.319309 26681 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:10.312721 31468 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.320240 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.324117 31097 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:10.408068 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 103056us
I20260709 13:09:10.419466 26753 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:10.419847 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:10.402413 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:10.331282 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 89539.5us
I20260709 13:09:10.328025 31797 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:10.354032 31795 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:10.354813 31525 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.005s
I20260709 13:09:10.356073 31686 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.366436 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1919) took 1421 ms. Trace:
I20260709 13:09:10.368341 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1957) took 1609 ms. Trace:
I20260709 13:09:10.371043 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 617) took 1466 ms. Trace:
I20260709 13:09:10.371886 31645 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.372483 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1841) took 2262 ms. Trace:
I20260709 13:09:10.426601 26754 rpcz_store.cc:276] 0709 13:09:08.110056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.185845 (+1075789us) service_pool.cc:224] Handling call
0709 13:09:09.186211 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.592662 (+406451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.372232 (+779570us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400139054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:10.372425 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932935552}
I20260709 13:09:10.376459 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3108) took 1281 ms. Trace:
I20260709 13:09:10.422910 26760 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:10.353034 31770 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:10.339012 31817 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.308638 31815 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.423976 26678 rpcz_store.cc:276] 0709 13:09:08.947862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.948021 (+   159us) service_pool.cc:224] Handling call
0709 13:09:10.366231 (+1418210us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001ea0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:10.366371 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418472704}
I20260709 13:09:10.385689 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:10.386734 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:10.394913 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.396497 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:10.435770 26605 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:10.421238 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.438011 26754 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:10.421564 26606 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:10.351366 31697 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:10.351455 31816 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:10.424211 26761 rpcz_store.cc:276] 0709 13:09:08.759446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.650713 (+891267us) service_pool.cc:224] Handling call
0709 13:09:09.651015 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.719928 (+ 68913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.368076 (+648148us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5400225e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:10.368278 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44605824}
I20260709 13:09:10.424399 27320 rpcz_store.cc:276] 0709 13:09:08.904772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.964659 (+ 59887us) service_pool.cc:224] Handling call
0709 13:09:08.972491 (+  7832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.790030 (+817539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.370806 (+580776us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400600754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:10.370980 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878568832}
I20260709 13:09:10.432104 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.427896 26609 rpcz_store.cc:276] 0709 13:09:09.094643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.094830 (+   187us) service_pool.cc:224] Handling call
0709 13:09:09.095189 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.227755 (+132566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.376219 (+1148464us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400065c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:10.376393 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269701888}
I20260709 13:09:10.328799 31813 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:10.438797 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:10.441707 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.444275 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47872.4us
I20260709 13:09:10.470602 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.446235 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:10.471381 26605 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:10.447991 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.382458 31687 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.398270 31614 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.426203 31653 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:10.454816 31686 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:10.426156 31852 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:10.456226 26607 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:10.454816 26754 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:10.456802 31817 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.462656 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1961) took 1660 ms. Trace:
I20260709 13:09:10.422109 31468 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.428478 31797 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.469867 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:10.426299 31841 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:10.478253 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.467689 26682 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.401643 31752 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.490595 26606 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:10.487762 26755 rpcz_store.cc:276] 0709 13:09:08.802472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.753610 (+951138us) service_pool.cc:224] Handling call
0709 13:09:09.754184 (+   574us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:09.787650 (+ 33466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.787718 (+    68us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:09.788708 (+   990us) log.cc:844] Serialized 78 byte log entry
0709 13:09:09.940028 (+151320us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.963078 (+ 23050us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.963517 (+   439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.963617 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.462437 (+498820us) raft_consensus.cc:1685] finished
0709 13:09:10.462456 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.462601 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14324,"prepare.queue_time_us":27480,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":37030,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":17561,"spinlock_wait_cycles":42752,"thread_start_us":111746,"threads_started":1,"wal-append.queue_time_us":290242}
I20260709 13:09:10.506186 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:10.422365 31531 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:09:10.466169 31642 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.482383 26753 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:10.514894 26605 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:10.476079 31696 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.474931 31813 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:10.491526 31815 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:10.488023 31686 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.492583 31852 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:10.534499 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1951) took 2326 ms. Trace:
I20260709 13:09:10.492103 31823 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:10.508618 31717 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:10.527838 31708 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.005s
I20260709 13:09:10.511261 31817 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:10.543286 26758 rpcz_store.cc:276] 0709 13:09:08.208364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.594272 (+1385908us) service_pool.cc:224] Handling call
0709 13:09:09.613166 (+ 18894us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:09.662816 (+ 49650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.662847 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:09.713862 (+ 51015us) log.cc:844] Serialized 52 byte log entry
0709 13:09:10.103131 (+389269us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:10.103171 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.103279 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.534208 (+430929us) raft_consensus.cc:1685] finished
0709 13:09:10.534233 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.534424 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34598,"raft.queue_time_us":43833,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11871,"thread_start_us":291863,"threads_started":1,"wal-append.queue_time_us":426894}
I20260709 13:09:10.521248 31695 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:10.497495 31687 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.548398 31717 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.549297 31819 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:10.560760 31683 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.563498 31752 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.545547 31852 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:10.584718 31683 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.592329 31770 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.598614 31795 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.600024 31542 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.580010 31708 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.581061 31717 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.578090 31687 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:10.564280 31845 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:09:10.509544 31816 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:10.517609 31692 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.546157 31686 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:10.605497 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 184321us
I20260709 13:09:10.628487 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:10.606632 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 103680us
I20260709 13:09:10.543855 31815 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.634110 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:10.645095 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:10.650100 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:10.631418 31815 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:10.631335 31653 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:10.642709 31696 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:10.665853 31776 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:10.671118 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3180) took 1722 ms. Trace:
I20260709 13:09:10.671708 26686 rpcz_store.cc:276] 0709 13:09:08.948846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.027387 (+ 78541us) service_pool.cc:224] Handling call
0709 13:09:09.100932 (+ 73545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.975043 (+874111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.975076 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.978821 (+  3745us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.158820 (+179999us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:10.350514 (+191694us) log.cc:844] Serialized 14 byte log entry
0709 13:09:10.350791 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.351049 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.670845 (+319796us) raft_consensus.cc:1685] finished
0709 13:09:10.670872 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.671041 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899434,"prepare.queue_time_us":195182,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":864872,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":20865,"thread_start_us":328119,"threads_started":2,"wal-append.queue_time_us":313513}
I20260709 13:09:10.631194 31687 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:10.644325 31683 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:10.654850 31752 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:10.684989 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 214878us
I20260709 13:09:10.675638 31776 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.693490 31707 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.695770 31776 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:10.645761 31813 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.699604 31852 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.676292 31799 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.708164 31692 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.707808 31707 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.711298 31852 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.713255 31468 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.714733 26609 raft_consensus.cc:2393] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:10.718756 31468 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.684451 31683 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.723836 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:10.724457 27320 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:10.736979 31693 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.738571 31548 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:10.738976 31548 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:10.739878 31548 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.740412 31775 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.741050 31614 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.742218 26610 raft_consensus.cc:2368] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17.
I20260709 13:09:10.742305 31768 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:10.745472 31614 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.746147 31542 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:10.746778 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59375.7us
W20260709 13:09:10.752159 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:10.758805 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:10.759533 27320 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:10.760612 31808 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.694922 31797 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.763187 31797 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:10.763444 31796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.354s	user 0.009s	sys 0.004s
W20260709 13:09:10.763882 31796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.009s	sys 0.004s
I20260709 13:09:10.741078 31548 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:10.765021 31824 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.767180 31824 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.776679 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.777004 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.781209 27320 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:10.787462 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.790290 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.791548 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.793653 31815 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:10.796069 31642 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:10.796645 31642 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.801784 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.803270 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.804728 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.805130 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.807971 31658 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:10.808702 31872 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:10.809221 31872 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.810319 31617 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:10.811371 31872 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.813308 31881 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:10.805977 26758 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:10.832129 31776 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.837280 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.838546 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.839188 26761 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.857095 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3120) took 1409 ms. Trace:
I20260709 13:09:10.862761 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.864352 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.865027 26758 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.804234 31642 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.820524 31697 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.735499 31686 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:10.869246 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.837368 31814 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:10.857647 26603 rpcz_store.cc:276] 0709 13:09:09.447337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.514010 (+ 66673us) service_pool.cc:224] Handling call
0709 13:09:09.543877 (+ 29867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.567291 (+ 23414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.567343 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.762057 (+1194714us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:10.762433 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.826429 (+ 63996us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:10.826468 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.827018 (+   550us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.827060 (+    42us) raft_consensus.cc:1685] finished
0709 13:09:10.827070 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.857007 (+ 29937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7386,"raft.queue_time_us":43652,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5268,"spinlock_wait_cycles":22204288,"thread_start_us":63655,"threads_started":1,"wal-append.queue_time_us":44512}
I20260709 13:09:10.875078 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:10.898191 31542 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.877549 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 229528us
I20260709 13:09:10.838310 31815 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.913300 26685 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:10.915102 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.915244 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.889163 26761 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:10.915956 26687 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:10.891080 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:10.916463 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:10.916580 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.915908 26684 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:10.921958 26680 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:09:10.922348 26680 pending_rounds.cc:85] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 5
I20260709 13:09:10.922574 26680 pending_rounds.cc:107] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:10.922857 26680 raft_consensus.cc:2889] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.934639 26758 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:10.833992 31882 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:09:10.939954 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.941605 26679 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:10.945997 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:10.946468 31686 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:10.935746 31642 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:09:10.922868 31824 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.947963 31824 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.948344 31824 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:10.961136 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 492588us
I20260709 13:09:10.962028 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:10.898929 31542 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:11.041918 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.043337 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:11.043232 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:10.890017 31697 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.050901 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.051204 31697 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:10.990643 31752 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:11.048345 31542 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:11.052014 31752 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.057685 31890 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.055320 31815 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.058570 31815 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.063189 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.065519 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.066277 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.068184 26609 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:11.069706 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.075804 26605 pending_rounds.cc:85] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 7
I20260709 13:09:11.076238 26605 pending_rounds.cc:107] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:11.076538 26605 raft_consensus.cc:2889] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.074060 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.057747 31752 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:11.095927 26608 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:11.105386 31867 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:11.105957 31867 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.106379 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1952) took 2496 ms. Trace:
I20260709 13:09:11.106792 26759 rpcz_store.cc:276] 0709 13:09:08.610544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.646479 (+1035935us) service_pool.cc:224] Handling call
0709 13:09:09.646850 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.923344 (+276494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.106120 (+1182776us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400138654. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:11.106323 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634166144}
I20260709 13:09:11.106127 26609 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:11.103983 31752 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:11.104665 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:11.118355 26608 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.119520 31697 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:11.120191 26609 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:11.107900 31542 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.121201 31542 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.121737 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:11.123096 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:11.123829 26609 raft_consensus.cc:2368] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:11.124188 31752 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.125109 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.123181 31542 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:11.120144 31867 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:11.129263 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.130406 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.130525 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.126463 31752 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:11.134946 31815 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:11.136911 31697 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:11.137356 31697 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:11.138162 31697 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.140003 31776 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:11.181512 31815 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.142201 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.212781 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.187252 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.214766 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:11.215576 31542 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:11.216698 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.217401 31542 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:11.217751 31755 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:11.217159 31762 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:11.218317 26650 leader_election.cc:400] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:11.215009 31776 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:11.219023 26650 leader_election.cc:403] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.217804 31542 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:11.220685 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:11.221129 31542 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.221818 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.222573 31542 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:11.223963 31658 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:11.210840 31815 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.165979 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1871) took 1055 ms. Trace:
I20260709 13:09:11.205127 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.183073 31867 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:11.226719 31815 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:11.212924 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 393672us
I20260709 13:09:11.229025 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:11.230779 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.236878 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.238044 26757 raft_consensus.cc:2410] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:11.240630 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:11.227246 26754 rpcz_store.cc:276] 0709 13:09:10.110796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.489901 (+379105us) service_pool.cc:224] Handling call
0709 13:09:10.503273 (+ 13372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.503537 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:10.665065 (+161528us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.165421 (+500356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.165518 (+    97us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:11.165596 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.165698 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.165894 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29345,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":55279,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":1635,"thread_start_us":637164,"threads_started":2}
I20260709 13:09:11.242800 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:11.246675 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.247443 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:11.248085 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.205864 31697 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:11.156455 31833 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:11.157012 31097 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.282680 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:11.290611 26685 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:11.283685 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:11.235879 31692 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.154573 31708 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:11.228351 31867 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:11.268829 26604 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:11.291157 26684 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:11.259078 31762 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:11.288853 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.296186 26685 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:11.246313 31548 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:11.264328 31468 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.301826 31867 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:11.303154 31683 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:11.312417 31867 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.291307 31776 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.318524 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.295893 26608 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:11.296233 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48765.3us
I20260709 13:09:11.337620 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:11.338599 26761 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:11.340653 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:11.321950 31468 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:11.319278 31683 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.317430 31819 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:11.345466 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:11.337905 31779 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.303835 31692 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.312449 31824 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:11.351285 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 389328us
I20260709 13:09:11.354497 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:11.338636 31776 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:11.371269 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:11.363130 31892 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:11.392700 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:11.394702 31891 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:11.399598 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1971) took 1430 ms. Trace:
W20260709 13:09:11.400974 31894 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:11.413446 26607 rpcz_store.cc:276] 0709 13:09:09.968867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.971275 (+  2408us) service_pool.cc:224] Handling call
0709 13:09:11.399368 (+1428093us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400378cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:11.399531 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113099008}
W20260709 13:09:11.402204 31893 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:11.410221 31795 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:11.426147 31795 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:11.426285 31862 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.770s	user 0.000s	sys 0.003s
W20260709 13:09:11.426951 31842 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.091s	user 0.004s	sys 0.000s
I20260709 13:09:11.422441 31882 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:11.380064 31867 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.419588 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:11.430006 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1972) took 1159 ms. Trace:
I20260709 13:09:11.430428 31900 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:11.431174 31900 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:11.417919 31891 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:11.430409 26760 rpcz_store.cc:276] 0709 13:09:10.270783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.516308 (+245525us) service_pool.cc:224] Handling call
0709 13:09:10.516630 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.214474 (+697844us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:11.215492 (+  1018us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.225009 (+  9517us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.340937 (+115928us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.340973 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.341043 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.429794 (+ 88751us) raft_consensus.cc:1685] finished
0709 13:09:11.429816 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.429946 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251129,"raft.queue_time_us":277072,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":559045,"threads_started":2,"wal-append.queue_time_us":198943}
I20260709 13:09:11.432207 31891 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:11.425695 31866 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.694s	user 0.002s	sys 0.000s
W20260709 13:09:11.435958 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.428107 31882 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.428939 31528 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:11.429024 31824 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:11.429503 31825 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.620s	user 0.006s	sys 0.000s
I20260709 13:09:11.431824 31900 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:11.295197 31097 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.385392 31819 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:11.440843 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:11.363196 31883 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:09:11.381711 31548 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:09:11.420189 31892 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.393728 31889 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:11.367857 31779 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.427105 31795 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.476539 26609 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:11.390379 31683 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:11.463604 31892 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:11.500735 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.512223 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:11.514057 26679 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:11.441866 31888 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:09:11.525295 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1973) took 1555 ms (client timeout 1982 ms). Trace:
W20260709 13:09:11.525938 26611 rpcz_store.cc:269] 0709 13:09:09.969492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.969608 (+   116us) service_pool.cc:224] Handling call
0709 13:09:11.511166 (+1541558us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:11.525217 (+ 14051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677343488}
I20260709 13:09:11.477299 31658 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:11.652868 26679 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:11.513005 31795 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.511421 31683 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:11.459452 31468 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:11.476451 31889 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:11.745463 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3127) took 1348 ms. Trace:
I20260709 13:09:11.746064 26610 rpcz_store.cc:276] 0709 13:09:10.397542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.438575 (+ 41033us) service_pool.cc:224] Handling call
0709 13:09:11.729767 (+1291192us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400271354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:11.745361 (+ 15594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620891520}
W20260709 13:09:11.784847 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 303046us
I20260709 13:09:11.789104 31755 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:12.004369 26604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.011s	sys 0.011s
W20260709 13:09:11.888988 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.004002 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.022s
W20260709 13:09:12.090378 31752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.023s
W20260709 13:09:12.004200 26684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.057s
I20260709 13:09:11.803474 31891 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:12.090401 31542 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.867s	user 0.015s	sys 0.000s
W20260709 13:09:12.163849 31883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.011s	sys 0.016s
W20260709 13:09:12.271337 31883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.011s	sys 0.016s
I20260709 13:09:12.275705 31528 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:12.277078 26760 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:12.201623 31892 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.667s	user 0.003s	sys 0.005s
I20260709 13:09:12.286715 31892 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:12.203743 26652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.011s
W20260709 13:09:12.262638 31752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.011s	sys 0.031s
W20260709 13:09:12.288655 26652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.011s
W20260709 13:09:12.263217 26684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.013s	sys 0.066s
W20260709 13:09:12.262025 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.007s	sys 0.024s
W20260709 13:09:12.297266 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.002s	sys 0.007s
W20260709 13:09:12.297780 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.007s
W20260709 13:09:12.300092 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.301668 26678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.003s
W20260709 13:09:12.302224 26678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.003s	sys 0.003s
I20260709 13:09:12.260190 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:12.296635 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 864812us
I20260709 13:09:12.309006 26686 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:09:12.260172 26604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.014s	sys 0.017s
I20260709 13:09:12.309799 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3193) took 1060 ms. Trace:
I20260709 13:09:12.310299 26686 rpcz_store.cc:276] 0709 13:09:11.249734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.259867 (+1010133us) service_pool.cc:224] Handling call
0709 13:09:12.309673 (+ 49806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.267803 31882 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:12.312091 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.333244 31915 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:12.307349 31697 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.032s	user 0.012s	sys 0.000s
W20260709 13:09:11.926868 31902 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
W20260709 13:09:11.895550 31905 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:09:11.951223 31897 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:09:12.004554 31818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.015s	sys 0.007s
I20260709 13:09:12.335944 26686 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:12.306085 31719 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:12.269361 31795 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.005s
I20260709 13:09:12.264575 31889 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:11.792866 31692 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:12.313299 31867 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.002s
I20260709 13:09:12.309269 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:12.341218 26680 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:12.312772 31542 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.333506 31891 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:12.333752 31916 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.335711 31883 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:12.346522 31818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.016s	sys 0.007s
I20260709 13:09:12.357007 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.362896 26686 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:11.798310 31819 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.312587 31755 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.364971 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:12.376210 31914 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:11.789342 31683 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.351157 31911 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.364797 31795 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:12.337584 31915 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.413839 31867 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.414568 31867 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.417517 31867 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:12.353931 31542 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.374769 31889 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:12.394479 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1984) took 1319 ms. Trace:
I20260709 13:09:12.445703 26605 rpcz_store.cc:276] 0709 13:09:11.074950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.075095 (+   145us) service_pool.cc:224] Handling call
0709 13:09:11.075535 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:11.077292 (+  1757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.077334 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:11.093897 (+ 16563us) log.cc:844] Serialized 52 byte log entry
0709 13:09:11.218643 (+124746us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.218685 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.218762 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.394114 (+1175352us) raft_consensus.cc:1685] finished
0709 13:09:12.394158 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.394393 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16045,"raft.queue_time_us":26658,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":30764,"thread_start_us":124373,"threads_started":1,"wal-append.queue_time_us":370439}
W20260709 13:09:12.433682 26683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1956) took 1520 ms (client timeout 1672 ms). Trace:
I20260709 13:09:12.437105 31542 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:12.439404 31912 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:12.348291 31719 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:12.447916 26683 rpcz_store.cc:269] 0709 13:09:10.913684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.914985 (+  1301us) service_pool.cc:224] Handling call
0709 13:09:12.433166 (+1518181us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b54001da7a8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f906d924 00007f40f8256227 00007f40f8255ab8 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:12.433603 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6790528}
W20260709 13:09:12.455197 26650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.196:34653 timed out after 1.562s (SENT) [suppressed 33 similar messages]
I20260709 13:09:12.362445 31916 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.365655 31883 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.449318 31919 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.449935 31867 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.375065 31818 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.475411 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.477509 31795 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:12.394825 31914 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.483937 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:12.475488 31891 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.489707 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3199) took 1208 ms. Trace:
I20260709 13:09:12.490101 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3200) took 1208 ms. Trace:
I20260709 13:09:12.478505 31852 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.481423 31618 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.468844 31911 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.688714 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.524083 26685 rpcz_store.cc:276] 0709 13:09:11.281510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.461832 (+180322us) service_pool.cc:224] Handling call
0709 13:09:11.462150 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.462624 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.462664 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.463229 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.905809 (+442580us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:11.905870 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.905974 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.489895 (+583921us) raft_consensus.cc:1685] finished
0709 13:09:12.489917 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.490043 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1148,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13523,"thread_start_us":430938,"threads_started":1,"wal-append.queue_time_us":860955}
I20260709 13:09:12.782444 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:12.623493 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 1991) took 1497 ms (client timeout 1612 ms). Trace:
I20260709 13:09:12.648751 31927 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.690400 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3204) took 1279 ms. Trace:
I20260709 13:09:12.780529 31915 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:12.485241 31829 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:12.682701 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 227527us
W20260709 13:09:12.794226 26609 rpcz_store.cc:269] 0709 13:09:11.126339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.126448 (+   109us) service_pool.cc:224] Handling call
0709 13:09:12.623257 (+1496809us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400285ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:12.623411 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572042496}
W20260709 13:09:12.616026 31913 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:09:12.797055 31927 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.688104 31924 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.794938 31852 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.652675 31642 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.802474 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 2.37136e+06us
I20260709 13:09:12.796155 26678 rpcz_store.cc:276] 0709 13:09:11.411235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.799423 (+388188us) service_pool.cc:224] Handling call
0709 13:09:11.799820 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.800275 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:11.800646 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.313988 (+513342us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.314602 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.314803 (+   201us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:12.689629 (+374826us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.690002 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.690105 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.690158 (+    53us) raft_consensus.cc:1685] finished
0709 13:09:12.690176 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.690330 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11204,"prepare.queue_time_us":274529,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":105,"raft.queue_time_us":44440,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":19906,"thread_start_us":874689,"threads_started":2,"wal-append.queue_time_us":459904}
I20260709 13:09:12.798035 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.784268 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.803993 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:12.731384 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.524384 26684 rpcz_store.cc:276] 0709 13:09:11.281169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.461468 (+180299us) service_pool.cc:224] Handling call
0709 13:09:11.461739 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.461955 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:11.478886 (+ 16931us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.488730 (+1009844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.489368 (+   638us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.489429 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.489510 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.489642 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22322,"prepare.queue_time_us":19358,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":33369,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3297,"thread_start_us":988303,"threads_started":2,"wal-append.queue_time_us":881169}
I20260709 13:09:12.485266 31882 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.646373 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1943) took 2628 ms. Trace:
I20260709 13:09:12.804514 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.818992 26681 rpcz_store.cc:276] 0709 13:09:10.018132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.222105 (+203973us) service_pool.cc:224] Handling call
0709 13:09:10.226026 (+  3921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.420448 (+194422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.646041 (+2225593us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54000c49d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:12.646261 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213750528}
W20260709 13:09:12.805213 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 318512us
W20260709 13:09:12.585105 31696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.872s	user 0.017s	sys 0.040s
I20260709 13:09:12.817678 26678 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:12.793304 31755 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:12.801162 31618 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.796710 31829 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.519775 31818 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.793368 31892 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:12.838083 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.726045 31731 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:12.823426 26684 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:12.647444 31900 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.184s	user 0.010s	sys 0.002s
I20260709 13:09:12.821954 26724 leader_election.cc:400] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17.
I20260709 13:09:12.488094 31867 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:12.837893 27285 connection.cc:256] RPC call timeout handler was delayed by -1.6238843469999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:09:12.907995 26724 leader_election.cc:403] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:12.833856 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 350012us
I20260709 13:09:12.909744 26685 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:12.802170 31889 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:12.826076 31696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.142s	user 0.021s	sys 0.048s
W20260709 13:09:12.910795 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 89037.3us
I20260709 13:09:12.825148 31708 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.923243 31927 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:12.923175 31708 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.924293 31883 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:12.924934 31747 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.925370 31708 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:12.925441 31747 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.722404 31795 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.928027 31774 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.928555 31774 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.929658 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3203) took 1590 ms. Trace:
I20260709 13:09:12.930583 31774 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:12.931337 31774 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.820840 31924 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.921345 26678 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:12.915391 26682 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:12.482604 31919 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.930117 26679 rpcz_store.cc:276] 0709 13:09:11.339571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.667171 (+327600us) service_pool.cc:224] Handling call
0709 13:09:11.667512 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.305124 (+637612us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:12.364163 (+ 59039us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.478228 (+114065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.478289 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:12.478339 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.928804 (+450465us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18003571c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419
0709 13:09:12.929397 (+   593us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54001261d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:12.929449 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.929587 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":177582,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2445,"raft.queue_time_us":106,"raft.run_wall_time_us":5126,"spinlock_wait_cycles":1471484800,"thread_start_us":172385,"threads_started":2,"wal-append.queue_time_us":250077}
I20260709 13:09:12.868947 31759 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.933365 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:12.944161 26760 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:12.933352 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:12.944801 26757 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:12.837110 31926 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.829206 31890 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:12.931988 31911 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:12.824914 31799 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.843815 31923 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:12.878305 31887 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:12.987579 31940 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.875151 31768 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.999562 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:12.560369 31891 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.949082 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:12.956398 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.956941 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:13.004201 26678 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:13.005681 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:13.006516 26678 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:12.958179 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.976171 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:12.828963 31697 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.916647 31731 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:12.917984 31746 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.986127 26757 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:12.918769 31756 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.820472 31642 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:12.990932 27286 connection.cc:256] RPC call timeout handler was delayed by -1.2506201480000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 13:09:12.921214 31696 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:12.833348 31775 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.832917 31882 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.844537 31752 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.000423 26756 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:13.004245 26685 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:13.087307 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.959702 31774 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.008271 26683 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:12.980451 31708 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.982017 31548 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.010490 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:12.980394 31755 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:12.932940 31937 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17.
I20260709 13:09:12.994607 31887 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.010578 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:13.051611 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:13.051751 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:12.940259 31889 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.009313 31768 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.020957 31697 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.019632 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:13.096575 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.204310 31887 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:13.204548 26686 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:13.185900 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.205809 26605 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:13.205856 27313 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:13.170468 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.206777 26678 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:12.984382 31926 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.019270 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.011312 31594 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:12.987810 31759 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.997306 31933 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:12.937683 31900 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:12.995056 31747 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:13.053504 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 135629us
W20260709 13:09:13.071259 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.229398 26575 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:13.077351 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.088096 26685 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:12.957147 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:13.233763 26682 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:13.053552 31793 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.090389 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:12.989246 31890 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:12.996780 31923 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.093495 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:12.996443 31940 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.014745 31938 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:13.212298 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 201818us
I20260709 13:09:13.020270 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.243553 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:13.214692 26609 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:12.996615 31799 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.133179 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:13.245229 27319 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:13.218721 31889 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:13.054493 31944 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.018333 31945 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:13.086063 31915 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.155s
I20260709 13:09:13.260478 26753 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:13.148947 31683 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:09:13.223418 31548 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.092823 31946 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.224094 31957 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:13.236294 31618 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.284726 31738 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.132095 31611 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.097004 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:13.234647 31793 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.224653 31594 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.086226 31756 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.225370 31696 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.225960 31882 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.062049 31746 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.221230 31531 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:13.235776 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 142382us
I20260709 13:09:13.209132 27318 raft_consensus.cc:2410] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:13.086014 31819 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.237483 26686 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:13.238040 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.172883 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.210515 31924 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.305429 27314 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:13.253280 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.254141 31938 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.221589 31914 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.088783 31775 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.262146 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:13.329474 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.236773 31927 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.282366 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.210901 31755 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:13.288929 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 198662us
I20260709 13:09:13.135391 31708 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.247839 31939 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:13.097116 31752 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.284672 31957 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.295359 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:13.300118 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.274322 31901 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:13.300555 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 249035us
I20260709 13:09:13.305488 26608 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:13.251827 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.284701 31936 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:13.282502 31829 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.235625 31933 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.224838 31950 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.206s
I20260709 13:09:13.306027 31867 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:13.342322 27317 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:13.349377 26603 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:13.350694 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.283146 31945 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.305586 31531 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:13.276176 31944 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.364256 26610 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:13.336256 31939 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.336810 31618 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.352190 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:13.381170 31932 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:13.383162 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50648.9us
I20260709 13:09:13.299808 31611 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.386353 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:13.394297 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.395785 27313 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:13.386627 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:13.396214 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:13.396451 26756 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:13.358966 31901 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.401027 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:13.388455 26761 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:13.344606 31891 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.386822 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:13.387936 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.401297 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:13.382941 31531 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:13.410861 26760 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:13.383783 31867 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.407789 31950 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:13.408733 31933 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.327606 31819 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.400887 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.432801 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:13.412328 27319 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:13.406792 26757 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:13.339366 31927 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.389043 31939 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:13.338250 31943 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.427000 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.292119 31946 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:13.305033 31941 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.344s
I20260709 13:09:13.399219 31618 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.440894 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:13.392589 31958 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:13.341858 31956 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:13.409674 31954 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.438720 31926 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.410069 31901 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:13.448467 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 241457us
I20260709 13:09:13.704870 27313 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:09:13.445832 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.750775 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:13.751533 27319 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:13.703394 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.752992 27312 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:13.752825 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.754199 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.754570 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.416896 31774 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.413823 31814 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.760918 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:13.781642 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.799448 27319 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:09:13.475864 31942 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:09:13.799564 27312 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:13.445431 31697 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.488466 31594 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.460667 31708 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.506879 31923 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.836711 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:13.430934 31867 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.490085 31949 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:13.850921 27321 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 10: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:13.485993 31966 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.491621 31611 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:13.488816 31900 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.490893 31961 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:13.491060 31929 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:13.661922 31967 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:13.743770 31775 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.506176 31940 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.888140 31819 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:13.744992 31944 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.454016 31938 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.649529 31945 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:13.433917 31932 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.811611 31814 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.665390 31793 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.765604 31756 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.921226 31927 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.870137 31799 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.850821 31956 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:13.890165 31958 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:13.896198 31949 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:13.930660 31946 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.870478 31755 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.461560 31943 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.914304 31966 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:13.961239 31969 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:13.931713 31967 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:13.952507 31958 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:13.760003 31954 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.993415 31932 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:13.995879 31967 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:13.991415 31939 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 13:09:14.004422 31954 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:13.932379 31929 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:13.998481 31939 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.010957 31939 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.012931 31943 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.014815 31966 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.008363 31929 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:14.048184 26577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.004s
W20260709 13:09:14.049063 26577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.000s	sys 0.004s
W20260709 13:09:14.051550 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 655304us
I20260709 13:09:14.055676 26607 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:14.062903 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.075100 26609 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:14.077991 26609 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:14.099956 26652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.002s	sys 0.002s
W20260709 13:09:14.100605 26652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.003s	sys 0.003s
W20260709 13:09:14.107944 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.118068 26609 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:14.160856 26605 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:14.162685 26605 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:14.131750 26726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.003s
I20260709 13:09:14.139429 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 1991) took 2702 ms. Trace:
I20260709 13:09:14.143896 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:14.176645 26753 rpcz_store.cc:276] 0709 13:09:11.437305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.437893 (+   588us) service_pool.cc:224] Handling call
0709 13:09:11.438184 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.260932 (+1822748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.138856 (+877924us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400225454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:14.139219 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4190433664}
I20260709 13:09:14.177754 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:14.179056 31943 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:14.149189 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.150059 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 399369us
I20260709 13:09:14.173990 31961 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:13.985986 31956 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.152339 26679 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:14.153079 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 1969) took 1468 ms. Trace:
W20260709 13:09:14.154451 26680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3191) took 2914 ms (client timeout 2008 ms). Trace:
I20260709 13:09:14.156435 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:13.888041 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.158594 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:13.883656 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.165438 31606 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.207543 27319 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:14.207213 31606 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.209313 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.166879 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.171118 31683 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:14.210731 27315 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:14.210884 31683 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.180104 31943 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.211870 31932 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:14.212034 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.000563 31958 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.213552 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.126456 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.042673 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.162201 26504 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 11, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 11 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:14.217177 31683 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.190410 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:14.185812 26726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.004s	sys 0.004s
I20260709 13:09:14.192016 31708 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:14.182966 26686 rpcz_store.cc:276] 0709 13:09:12.684180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.807338 (+123158us) service_pool.cc:224] Handling call
0709 13:09:14.151441 (+1344103us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54003133d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.152823 (+  1382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769297664}
I20260709 13:09:13.445856 31768 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.199281 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1993) took 3069 ms. Trace:
W20260709 13:09:14.199872 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.157426 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:13.978597 31887 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.771s	user 0.004s	sys 0.010s
I20260709 13:09:14.219580 31708 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.218578 26612 rpcz_store.cc:276] 0709 13:09:11.129412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.129558 (+   146us) service_pool.cc:224] Handling call
0709 13:09:11.129957 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.130330 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.130356 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.130832 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.353219 (+222387us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.353270 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.353342 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.965343 (+2612001us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b2400139a18. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:09:14.198604 (+233261us) raft_consensus.cc:1685] finished
0709 13:09:14.198645 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.199053 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":742,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2104,"spinlock_wait_cycles":5771008,"thread_start_us":117346,"threads_started":1,"wal-append.queue_time_us":340967}
I20260709 13:09:14.221496 27312 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:14.221333 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 729201us
I20260709 13:09:14.222726 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.222981 31708 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.223138 31877 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:14.223932 27313 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:14.201293 31961 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:14.205283 31924 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.205840 31966 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.211088 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.223475 27312 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:14.183287 26680 rpcz_store.cc:269] 0709 13:09:11.240219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.240386 (+   167us) service_pool.cc:224] Handling call
0709 13:09:14.153843 (+2913457us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540002a3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.154188 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529004800}
W20260709 13:09:14.227833 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 101787us
I20260709 13:09:13.987139 31949 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.233009 27313 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:14.233119 31967 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:14.233646 31949 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:14.236532 31867 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.237454 31697 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.237929 31697 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:14.238317 31697 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.219523 31887 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.217741 26504 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 14, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.242311 31887 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.248005 27315 raft_consensus.cc:2368] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
W20260709 13:09:14.249203 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66941.1us
I20260709 13:09:14.242455 26504 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:14.233981 31967 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.247376 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.228364 31770 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:14.224000 31877 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.226294 31961 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:14.266623 31593 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:14.267156 31924 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.268657 26755 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:14.270830 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.271764 31618 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.265977 31770 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:14.306528 31770 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.307919 31770 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.273234 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.274040 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.274137 31759 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.299516 31877 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.274646 31966 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.356912 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 715) took 1262 ms. Trace:
I20260709 13:09:14.357501 27320 rpcz_store.cc:276] 0709 13:09:13.094499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.094871 (+   372us) service_pool.cc:224] Handling call
0709 13:09:13.170491 (+ 75620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.336573 (+166082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.336602 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.336644 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:13.336672 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.356014 (+1019342us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54008516d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:14.356398 (+   384us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.356644 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381471872}
I20260709 13:09:14.360142 31957 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.357537 31593 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.363839 31719 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.366721 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 590) took 1291 ms. Trace:
I20260709 13:09:14.367177 26607 rpcz_store.cc:276] 0709 13:09:13.075550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.077023 (+  1473us) service_pool.cc:224] Handling call
0709 13:09:14.366453 (+1289430us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400324954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.366640 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890185088}
I20260709 13:09:14.282195 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:14.282989 31779 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.285215 26759 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:14.285145 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.285622 31795 raft_consensus.cc:1064] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:09:14.293267 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 137135us
I20260709 13:09:14.297106 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.299748 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.301550 31746 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.302778 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:14.303066 31967 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.321825 31961 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:14.330487 31738 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.033s	user 0.013s	sys 0.008s
I20260709 13:09:14.332578 26684 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 8.
I20260709 13:09:14.340601 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.344411 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:14.319389 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 126913us
I20260709 13:09:14.327270 31924 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.523551 31697 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:14.459942 31531 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.026s	user 0.011s	sys 0.007s
I20260709 13:09:14.609510 31531 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.610967 31697 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.612066 31921 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:14.427981 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.613049 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.612589 26680 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:14.613857 26686 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:14.434621 31814 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:14.603430 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.615291 26761 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:14.615769 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.616181 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.616647 26683 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:14.616909 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.616199 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.617740 26761 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:14.618338 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:14.476794 31909 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 2.043s	user 0.007s	sys 0.009s
I20260709 13:09:14.458436 31752 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.475334 27321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 584) took 1107 ms. Trace:
I20260709 13:09:14.620047 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.620414 31752 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:14.475373 27313 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:14.621474 27321 rpcz_store.cc:276] 0709 13:09:13.367650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.367823 (+   173us) service_pool.cc:224] Handling call
0709 13:09:14.474911 (+1107088us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400570154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.475132 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013662720}
I20260709 13:09:14.622946 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.623489 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.623783 26680 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:14.618062 26686 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:14.471014 31818 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.473567 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3208) took 1517 ms. Trace:
I20260709 13:09:14.382622 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:14.608738 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 326849us
I20260709 13:09:14.613271 27312 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:14.630051 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:14.630752 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.469504 31904 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 2.993s	user 0.019s	sys 0.022s
I20260709 13:09:14.631119 31697 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:14.631737 31697 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.632190 31697 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.633216 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1893) took 3402 ms. Trace:
I20260709 13:09:14.633596 26758 rpcz_store.cc:276] 0709 13:09:11.230523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.230655 (+   132us) service_pool.cc:224] Handling call
0709 13:09:11.230969 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.231181 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.231214 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.235167 (+  3953us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.340407 (+105240us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.340521 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.340659 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.468395 (+3127736us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:14.632697 (+164302us) raft_consensus.cc:1685] finished
0709 13:09:14.632720 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.633020 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9805184,"thread_start_us":104764,"threads_started":1,"wal-append.queue_time_us":188248}
W20260709 13:09:14.463243 31901 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.006s
I20260709 13:09:14.631119 31961 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.635885 31901 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.637687 31642 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.638530 31901 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.524063 31881 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:14.640601 31881 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:14.641158 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 338451us
I20260709 13:09:14.612586 31921 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.474308 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.644513 31921 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.645057 27316 raft_consensus.cc:2368] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:14.645620 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 585) took 1274 ms. Trace:
I20260709 13:09:14.645983 27316 rpcz_store.cc:276] 0709 13:09:13.371478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.371613 (+   135us) service_pool.cc:224] Handling call
0709 13:09:14.474025 (+1102412us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:14.645555 (+171530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7678720}
I20260709 13:09:14.646811 31813 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:14.648409 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.603152 31097 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:14.619987 26684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3211) took 1661 ms (client timeout 2104 ms). Trace:
I20260709 13:09:14.648447 31548 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.459021 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:14.657771 26684 rpcz_store.cc:269] 0709 13:09:12.958965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.008542 (+ 49577us) service_pool.cc:224] Handling call
0709 13:09:14.156914 (+1148372us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:14.619929 (+463015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5425920}
W20260709 13:09:14.663388 31979 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
I20260709 13:09:14.663899 31746 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:14.664373 26755 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:14.664551 31746 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:14.665792 31746 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.666870 26683 raft_consensus.cc:2368] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:14.668542 31097 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.626349 26679 rpcz_store.cc:276] 0709 13:09:12.956278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.957616 (+  1338us) service_pool.cc:224] Handling call
0709 13:09:14.151707 (+1194091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.195419 (+ 43712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.473268 (+277849us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003133d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.473463 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745234688}
W20260709 13:09:14.671912 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.671598 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:14.679821 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.629056 31531 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.584981 31966 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:14.683732 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117116us
I20260709 13:09:14.523110 31877 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.521267 31719 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:14.696473 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:14.699433 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.702584 26752 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:14.703866 31719 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.704461 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.705649 31548 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:14.706406 31719 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:14.707026 31908 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 2.267s	user 0.015s	sys 0.020s
I20260709 13:09:14.699332 27318 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 8.
I20260709 13:09:14.706434 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:14.709060 27318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 579) took 1356 ms (client timeout 1562 ms). Trace:
I20260709 13:09:14.709393 26757 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:14.703924 31634 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.614809 31795 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.716156 31634 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:14.713474 27318 rpcz_store.cc:269] 0709 13:09:13.352797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.352957 (+   160us) service_pool.cc:224] Handling call
0709 13:09:14.296664 (+943707us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b58000d7d98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:14.709010 (+412346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7192320}
I20260709 13:09:14.694788 31881 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:14.722265 31755 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:14.724534 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.724850 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.720341 31548 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:14.725685 31877 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:14.726190 31548 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.727984 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.728487 31548 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.732875 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.734225 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.735970 26758 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:14.736109 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.739375 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:14.740053 26759 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:09:14.751995 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 331595us
I20260709 13:09:14.717379 31966 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:14.754688 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.756089 31881 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.757234 31967 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:14.756821 31881 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.759649 31881 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:14.759795 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53482.4us
I20260709 13:09:14.760742 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:14.761229 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.766741 31921 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.768940 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 1995) took 3614 ms. Trace:
I20260709 13:09:14.736027 31890 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.771775 31755 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:14.813859 31755 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:14.772266 31966 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:14.774169 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:14.774724 26752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 568) took 4910 ms (client timeout 1741 ms). Trace:
I20260709 13:09:14.774933 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.775556 31548 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:14.776039 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.778190 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.781474 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2001) took 3541 ms. Trace:
I20260709 13:09:14.781908 26504 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.786381 31916 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:14.787428 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 85656.6us
I20260709 13:09:14.789070 31919 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:14.793265 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 68517.6us
I20260709 13:09:14.793396 31731 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:14.794250 31815 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.797775 31818 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:14.800187 31852 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.800594 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:14.784722 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.802524 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.803095 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.756733 31814 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:14.806106 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:14.806886 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.809486 31947 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:14.812485 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.815934 27314 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:14.837194 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.857215 26608 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:14.818456 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:14.867274 26509 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 115) took 36012 ms (client timeout 15000 ms). Trace:
I20260709 13:09:14.815296 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 720) took 1627 ms. Trace:
I20260709 13:09:14.919653 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.845116 26611 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:14.936784 27317 rpcz_store.cc:276] 0709 13:09:13.187885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.188077 (+   192us) service_pool.cc:224] Handling call
0709 13:09:13.188468 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.361318 (+172850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.814834 (+1453516us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:14.815119 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344719616}
I20260709 13:09:14.953503 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.948094 26755 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:14.911448 26752 rpcz_store.cc:269] 0709 13:09:09.864795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.865304 (+   509us) service_pool.cc:224] Handling call
0709 13:09:14.774498 (+4909194us) spinlock_profiling.cc:243] Waited 4.81 s on lock 0x7b54002db9d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.774644 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11053267200}
I20260709 13:09:14.957103 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:14.838658 31606 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.961685 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:14.962301 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 188220us
W20260709 13:09:14.962046 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 161651us
I20260709 13:09:14.814538 31634 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.911586 26604 rpcz_store.cc:276] 0709 13:09:11.241947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.300217 (+ 58270us) service_pool.cc:224] Handling call
0709 13:09:11.300640 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.316460 (+ 15820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.316489 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.325788 (+  9299us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.310016 (+984228us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.310069 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.310163 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.653177 (+2343014us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:14.780895 (+127718us) raft_consensus.cc:1685] finished
0709 13:09:14.780919 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.781253 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18823,"raft.queue_time_us":31503,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2304,"spinlock_wait_cycles":9268096,"thread_start_us":916224,"threads_started":1,"wal-append.queue_time_us":1020377}
I20260709 13:09:14.964977 26756 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:14.910774 31947 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:14.914844 31548 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:14.972545 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.813510 26606 rpcz_store.cc:276] 0709 13:09:11.154509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.154643 (+   134us) service_pool.cc:224] Handling call
0709 13:09:11.154977 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.311889 (+156912us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:11.312160 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.334339 (+ 22179us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.344051 (+  9712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.344114 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:11.344176 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.519579 (+3175403us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b18003e4ee0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:14.721214 (+201635us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001f6154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:14.739389 (+ 18175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.768727 (+ 29338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19282,"prepare.queue_time_us":3499,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":35061,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13410,"spinlock_wait_cycles":364613248}
I20260709 13:09:14.976837 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.977649 26760 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:14.970338 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:14.975950 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:14.829460 31877 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:14.975972 31548 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:14.983459 31824 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:14.984123 31824 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:14.984329 26754 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:14.984972 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3136) took 1747 ms (client timeout 2057 ms). Trace:
I20260709 13:09:14.985168 31824 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:14.985409 26611 rpcz_store.cc:269] 0709 13:09:13.237266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.237396 (+   130us) service_pool.cc:224] Handling call
0709 13:09:14.984732 (+1747336us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400100ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.984907 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3538798976}
I20260709 13:09:14.987547 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:14.987763 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:14.916276 31697 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:14.988948 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 265008us
I20260709 13:09:14.990520 26759 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.990180 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 580) took 1630 ms. Trace:
I20260709 13:09:14.990239 26753 raft_consensus.cc:2410] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:14.992599 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:14.992970 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:14.991102 27314 rpcz_store.cc:276] 0709 13:09:13.353105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.353254 (+   149us) service_pool.cc:224] Handling call
0709 13:09:14.815504 (+1462250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.953039 (+137535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.982791 (+ 29752us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54006f2f50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:14.982972 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3286569472}
I20260709 13:09:14.991093 26757 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:09:14.999101 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 193163us
I20260709 13:09:15.003854 26760 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:09:14.815222 31755 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.000425 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:14.990389 31916 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.008354 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:15.011754 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:14.976432 31966 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.002318 31731 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.014803 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.015535 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:14.993822 31813 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:09:15.008282 31916 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.016618 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.017545 26680 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:15.006501 31877 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:14.987865 31815 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:09:15.017910 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.021060 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.026898 26679 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:15.025153 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.022090 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.027854 31960 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.009131 31852 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.022815 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:15.016964 31634 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:15.023159 31967 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:15.036499 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.025563 31916 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.026010 31877 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.035635 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.040192 26681 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 9: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:15.040689 26684 raft_consensus.cc:2410] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:15.040591 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.043071 27318 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:15.043200 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.044934 31966 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.046126 26650 leader_election.cc:400] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:15.047957 31852 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.049161 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.050186 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.050590 31852 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.051045 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.051456 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.051311 31658 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:09:15.052093 31889 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.052240 27317 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:15.052532 31889 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:14.936265 26509 rpcz_store.cc:269] 0709 13:08:38.854494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.896450 (+ 41956us) service_pool.cc:224] Handling call
0709 13:09:14.866809 (+35970359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.155277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.212200 (+ 56923us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.212254 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:09:04.212277 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:04.213439 (+  1162us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.213542 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.213568 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:04.214440 (+   872us) tablet.cc:701] Row locks acquired
0709 13:09:04.214485 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:09:04.214653 (+   168us) write_op.cc:270] Start()
0709 13:09:04.214799 (+   146us) write_op.cc:276] Timestamp: P: 1783602544214592 usec, L: 0
0709 13:09:04.214834 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.239694 (+ 24860us) log.cc:844] Serialized 4078 byte log entry
0709 13:09:04.834964 (+595270us) op_driver.cc:464] REPLICATION: finished
0709 13:09:05.700622 (+865658us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f6cc6ef0
0709 13:09:05.785033 (+ 84411us) write_op.cc:301] APPLY: starting
0709 13:09:05.796198 (+ 11165us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:06.068196 (+271998us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:06.068292 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:07.024347 (+956055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:07.042366 (+ 18019us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:09:07.042418 (+    52us) write_op.cc:312] APPLY: finished
0709 13:09:07.042837 (+   419us) log.cc:844] Serialized 97 byte log entry
0709 13:09:07.158625 (+115788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.176122 (+ 17497us) write_op.cc:454] Released schema lock
0709 13:09:07.184700 (+  8578us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:07.251685 (+ 66985us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:07.245160 (+ -6525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.256393 (+ 11233us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6407069,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":945555,"apply.run_cpu_time_us":42587,"apply.run_wall_time_us":1439455,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45907,"num_ops":10,"prepare.queue_time_us":249312,"prepare.run_cpu_time_us":15794,"prepare.run_wall_time_us":190285,"raft.queue_time_us":87474,"raft.run_cpu_time_us":19378,"raft.run_wall_time_us":1230347,"replication_time_us":574481,"spinlock_wait_cycles":24299520,"thread_start_us":1348592,"threads_started":5,"wal-append.queue_time_us":135749,"wal-append.run_cpu_time_us":27150,"wal-append.run_wall_time_us":2623230}]]}
I20260709 13:09:15.053022 31877 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:15.053398 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45560.1us
I20260709 13:09:15.053822 31542 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.054380 31890 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:15.054911 31890 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.054513 31542 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.055346 31890 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.052948 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.056032 26603 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:15.035547 31960 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.041204 31642 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.057575 31642 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.059051 31960 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.041028 31606 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.059952 31525 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:15.060335 31525 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.060684 31525 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:15.052973 31889 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.064167 31941 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.064685 31941 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.066977 31941 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.025615 31814 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:15.068069 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:15.041962 31929 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.051349 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.071894 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.071770 31759 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:15.072849 31759 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:15.073220 31759 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:15.073966 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.074156 31759 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.074645 26681 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:15.056870 31542 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:15.075881 31947 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.080914 31877 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.081537 31947 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.082844 26726 leader_election.cc:400] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:15.082634 31881 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:15.083173 26726 leader_election.cc:403] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.068615 26680 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:15.078191 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:15.053833 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.084928 26679 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
W20260709 13:09:15.085191 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.076229 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:15.086242 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72039.9us
I20260709 13:09:15.084794 27317 raft_consensus.cc:2376] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13. Re-sending same reply.
I20260709 13:09:15.114542 31507 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:15.115269 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47620.6us
W20260709 13:09:15.118453 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.119263 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.119625 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.117542 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49873.8us
I20260709 13:09:15.118430 31507 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.121919 31542 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.122244 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.036947 31634 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.124552 26756 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:15.122510 31542 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.075656 31759 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:15.132061 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.132359 31814 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:15.131536 31960 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:15.134102 31960 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:15.134513 31960 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:15.134915 31606 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.080348 31779 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:15.136113 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64421.5us
I20260709 13:09:15.129293 31877 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.115200 31889 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.140017 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.130090 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.126646 31507 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.130548 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 1962) took 4103 ms. Trace:
W20260709 13:09:15.130859 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59393.4us
I20260709 13:09:15.143054 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.125063 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.131187 31468 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:15.076231 31642 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:15.132735 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.100518 31818 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.130493 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:15.130345 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 114876us
I20260709 13:09:15.141510 26753 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:15.119834 31755 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.149057 31507 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:15.149868 31916 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.130509 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.142705 31779 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:09:15.151892 26685 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:15.151959 31468 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.153505 26760 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:15.128233 31634 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.125365 31921 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.170035 31719 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:15.169979 26757 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:15.171295 31531 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:15.139595 31890 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.142717 26687 rpcz_store.cc:276] 0709 13:09:10.915191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.360502 (+3445311us) service_pool.cc:224] Handling call
0709 13:09:14.394656 (+ 34154us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.444819 (+ 50163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.444857 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.568495 (+123638us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.676340 (+107845us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:15.016047 (+339707us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.016281 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.018253 (+  1972us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.018308 (+    55us) raft_consensus.cc:1685] finished
0709 13:09:15.018321 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.018462 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":1996,"thread_start_us":411018,"threads_started":2,"wal-append.queue_time_us":164215}
I20260709 13:09:15.156934 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:15.184536 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54155.5us
W20260709 13:09:15.185321 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44054.3us
I20260709 13:09:15.163417 31818 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:15.192786 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.199473 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:15.202715 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74285.8us
I20260709 13:09:15.188297 31531 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.205243 31921 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:15.165136 31525 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.197554 31818 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.195957 31697 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.214426 31795 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:15.216536 31932 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.218869 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.167977 31548 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.189731 31719 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.204355 31967 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.028048 26504 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 7, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 7 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:09:15.225714 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.202235 31771 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:09:15.217783 31961 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:15.218550 31889 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.235241 26686 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:15.239454 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:15.235152 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.222102 31921 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.243026 31531 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.253271 31813 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:15.255683 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.256556 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.256685 31932 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:15.257098 31719 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:15.257392 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.260402 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.189841 31468 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.226712 31697 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:15.256901 26504 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 7 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.261343 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.224496 31967 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.259610 31813 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:15.265983 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59474.9us
I20260709 13:09:15.273095 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.268355 31967 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.275818 26603 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:15.276149 26504 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 11, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.278244 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.281457 26753 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:15.281369 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.287853 26608 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:15.289479 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.293254 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.293694 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.294502 31932 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:15.294577 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:15.295104 31932 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.292804 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.296921 31890 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.297122 31941 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.297585 31941 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.297930 31941 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.298038 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.298785 31548 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:15.299849 31892 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.300000 31932 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.300520 31892 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.301867 26755 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:09:15.302181 26755 pending_rounds.cc:85] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 9
I20260709 13:09:15.302407 26755 pending_rounds.cc:107] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:09:15.302675 26755 raft_consensus.cc:2889] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.278035 26504 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 11, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 11 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.303450 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.304348 26606 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:15.304204 26504 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.306262 26504 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 12, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 12 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.308815 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.309613 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.268292 31824 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:15.311477 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.290592 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.265480 31697 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:15.313987 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 99984.2us
I20260709 13:09:15.278363 31813 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:15.315717 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76283.8us
W20260709 13:09:15.299942 31985 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:15.284006 31752 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:15.320370 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:15.324335 26650 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.612s (SENT)
I20260709 13:09:15.317836 31697 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:15.328445 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:15.330273 26756 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:15.314440 31824 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:15.332455 31824 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.333069 26756 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:15.334201 31658 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.334681 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.335314 26678 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:15.335711 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.336139 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.336680 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.337263 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.337769 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:15.337976 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.338291 26682 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.338492 26678 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:15.339342 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.330687 26760 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:15.331084 26757 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:15.340304 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.325955 31957 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:15.340996 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:15.341451 31988 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:09:15.341696 31957 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:15.342082 31957 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.342098 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.344936 26680 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.345829 26678 raft_consensus.cc:2368] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:15.351164 26759 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:15.354367 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.355057 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.355858 26684 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:15.356765 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.357152 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 634) took 1091 ms. Trace:
I20260709 13:09:15.357769 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.358088 31941 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.358867 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.355914 31525 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.322175 31752 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.361544 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:15.359417 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 158652us
I20260709 13:09:15.297183 31960 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.366775 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.370576 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.370672 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.367152 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.366639 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.371325 26754 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.371235 26678 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.366490 31752 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.373692 26684 raft_consensus.cc:2410] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:15.375748 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.379050 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.357511 27319 rpcz_store.cc:276] 0709 13:09:14.265211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.651387 (+386176us) service_pool.cc:224] Handling call
0709 13:09:14.660559 (+  9172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.688846 (+ 28287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.688912 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.712214 (+ 23302us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.185436 (+473222us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:15.194416 (+  8980us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.356619 (+162203us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b180049eca0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:15.356790 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.356855 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.356907 (+    52us) raft_consensus.cc:1685] finished
0709 13:09:15.356986 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.357099 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2637,"prepare.queue_time_us":11396,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":8677,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":16997,"spinlock_wait_cycles":3705088,"thread_start_us":364927,"threads_started":1,"wal-append.queue_time_us":523753}
I20260709 13:09:15.384292 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.389058 26609 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:15.393049 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.371567 31642 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.365438 31881 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:15.401672 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.372962 31795 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:15.400730 26611 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:15.402282 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.400363 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.404403 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.405584 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.407951 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.387354 31952 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.441355 26684 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.446298 26756 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:15.447796 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54884.7us
W20260709 13:09:15.412231 31991 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:15.402017 31642 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:15.452904 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 144151us
W20260709 13:09:15.449401 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 45068.5us
I20260709 13:09:15.402926 31548 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:15.385156 31525 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:09:15.403389 31731 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.419508 31719 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:15.454376 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 43601.8us
I20260709 13:09:15.405934 31747 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:15.466336 26685 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:15.447618 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.388806 31746 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:09:15.412154 31771 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:15.404359 31795 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.457769 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.413053 31916 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:15.407773 31542 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.373104 31921 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.449952 31919 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:15.456250 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146849us
I20260709 13:09:15.468508 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.466841 26685 pending_rounds.cc:85] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:15.328764 26504 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 7 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 9 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.457417 31731 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.465739 31747 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:15.378209 31957 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.495992 26685 pending_rounds.cc:107] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:15.460199 31890 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.456295 31642 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:15.476238 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.504762 26650 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.982s (SENT)
I20260709 13:09:15.513249 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:15.513537 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.506085 26685 raft_consensus.cc:2889] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:15.507237 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44244.7us
I20260709 13:09:15.514884 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.509200 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:15.468878 31548 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:15.516716 26761 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.519729 31958 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:15.520684 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.494745 31771 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.504730 31731 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:15.547876 31996 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:09:15.555485 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:15.556198 26685 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:15.534432 31958 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:15.527644 26682 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:15.469237 31889 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.531188 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.495468 31919 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.533552 26679 raft_consensus.cc:2410] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:15.511806 31747 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.534789 26760 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:15.494622 31795 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:15.540208 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.540542 31999 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.524556 31941 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.596227 31768 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.561211 31771 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.539445 31947 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:15.524061 31658 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:15.616792 31998 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:15.617189 31934 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:15.617370 31998 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.617641 31934 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.617816 31998 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.618546 31934 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.561650 31929 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:15.621716 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.631044 26682 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:15.652467 26760 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:15.652694 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.592386 31919 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.734359 31993 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:15.734961 31993 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.735978 26504 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.740825 31941 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.741494 31941 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.744671 26757 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:15.770378 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.771296 26756 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:09:15.771492 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 275727us
I20260709 13:09:15.654266 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.772305 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.777897 26760 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.779502 26678 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:15.784624 26680 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
W20260709 13:09:15.784785 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 286865us
I20260709 13:09:15.785827 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.786365 31993 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.787585 31993 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.792084 31548 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.613297 31889 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:15.794549 31889 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:15.787496 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.795994 31934 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.797070 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.797698 31097 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:15.798285 31097 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.798491 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.799865 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:15.800216 32005 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:09:15.803221 31731 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:15.806476 31818 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.587s	user 0.014s	sys 0.015s
I20260709 13:09:15.809682 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2014) took 1034 ms. Trace:
I20260709 13:09:15.810779 26685 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:15.810932 26755 rpcz_store.cc:276] 0709 13:09:14.774907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.979789 (+204882us) service_pool.cc:224] Handling call
0709 13:09:14.980165 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.303077 (+322912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.807931 (+504854us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540014f5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:15.809610 (+  1679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739012992}
W20260709 13:09:15.814028 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.817875 31097 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:15.821215 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48634.8us
W20260709 13:09:15.821038 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 360381us
I20260709 13:09:15.822984 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:15.824029 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 284269us
I20260709 13:09:15.824498 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.825095 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:15.828603 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.830857 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.831740 31929 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.832147 31929 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.832477 31929 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:15.832835 31967 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.557s	user 0.004s	sys 0.013s
I20260709 13:09:15.833273 31967 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.835239 31967 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.836905 26726 leader_election.cc:400] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:15.837232 26726 leader_election.cc:403] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.829478 26603 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:15.841737 31097 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:15.849156 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.836055 31999 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.853106 31999 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:15.853554 31999 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:15.854667 31755 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.003s
I20260709 13:09:15.855584 31877 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:15.856029 31877 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.856904 31877 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.858146 31877 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.859853 31746 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:15.860282 31746 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:15.847528 31097 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:15.842648 31961 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:15.852506 31468 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:15.862454 26754 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:15.866001 26681 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:15.870805 31889 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:15.861441 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:15.873147 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.872850 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.869554 31468 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:15.875842 31468 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.877178 31468 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.880200 27321 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:15.880595 27320 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:15.884954 31642 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.888082 32006 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:15.888711 32006 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.889770 32006 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:15.892552 31634 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.007s
I20260709 13:09:15.892995 31634 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.894150 26752 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:15.894519 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.895272 31993 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:15.895516 26753 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:15.874225 31941 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.896838 31731 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.897687 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.898492 26608 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:15.898650 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.899231 26611 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:15.896221 31993 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.900168 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:15.900648 31993 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:15.903915 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79510.9us
I20260709 13:09:15.905294 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:15.866019 31759 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.734s	user 0.004s	sys 0.017s
I20260709 13:09:15.906574 31759 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:15.906930 31759 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.907227 31759 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.908207 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.909173 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:15.909289 31606 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:15.908488 31642 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:15.909902 31606 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.910805 31606 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.911430 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:15.912220 31892 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:15.872844 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.914505 26754 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:15.915066 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90065.6us
I20260709 13:09:15.915683 26610 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:15.915823 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:15.918120 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.918234 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:15.918838 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.919037 26678 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:15.919298 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.919697 26682 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:15.899251 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.860677 31746 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.924188 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.860692 31768 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:15.920463 26608 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:15.914156 26603 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:15.930450 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:15.931223 26603 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:15.932416 26682 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:15.932840 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.934005 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.873946 31779 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:09:15.843568 31967 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:09:15.821653 31818 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.935145 31768 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:15.935714 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.936102 31731 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:15.936908 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:15.940677 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:15.952452 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.966097 26685 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:15.941365 26603 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:15.949590 26755 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:15.935014 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:15.950043 26760 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:15.738185 26504 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 12, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 12 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.909895 31881 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:15.969169 31881 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:15.969611 26760 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:15.969504 26504 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 11, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 11 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:15.970444 31881 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:15.972738 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.973949 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.975297 31768 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:15.952991 31752 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.013s
I20260709 13:09:15.984431 26609 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:15.984900 26757 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:15.993055 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.993824 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.950060 31642 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.004886 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:16.006392 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.011574 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.013796 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.006279 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 76721us
I20260709 13:09:16.017992 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.952822 31998 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.020012 31921 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:16.020309 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.020066 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.021622 31998 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:16.022576 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:15.978948 32009 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:16.023576 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 110641us
I20260709 13:09:16.018874 26612 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:16.027596 27319 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:16.016224 31960 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:16.032881 26684 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.587s	user 0.003s	sys 0.016s
I20260709 13:09:16.069752 26684 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:16.079654 31795 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.083214 31818 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.026652 32009 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:16.000442 31752 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.103864 26683 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:16.104153 31952 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:16.105525 31468 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:16.105923 31468 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.106793 31468 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.108719 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:16.102777 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.112505 31824 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.000s
I20260709 13:09:16.112951 31824 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.113953 31747 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.115083 31824 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.130610 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.117559 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 201799us
W20260709 13:09:16.131368 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.131460 26612 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.064586 31921 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:16.152069 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.153446 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.159299 32015 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:16.161887 32015 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:16.163031 31747 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.108091 31468 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:16.062909 31642 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.169680 31642 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.134305 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.171453 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.172184 26610 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:16.135602 31634 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:16.136801 31999 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:16.140798 31697 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.775s	user 0.019s	sys 0.001s
I20260709 13:09:16.116439 31812 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:16.144222 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.145147 31799 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.101791 32009 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:16.148095 31771 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.004s
W20260709 13:09:16.149605 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 536309us
W20260709 13:09:16.150390 31813 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.009s
I20260709 13:09:16.154996 31929 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.193414 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.196702 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.197535 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.198035 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.198216 26610 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:16.199203 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.200034 26610 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:16.201404 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 176619us
W20260709 13:09:16.202867 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70923us
I20260709 13:09:16.204741 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:16.211560 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.212342 27321 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:16.212703 27318 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:16.213459 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.214744 27318 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:09:16.215343 27321 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:16.217376 27320 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:16.199203 31813 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.218233 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.218501 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:16.195603 31921 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:09:16.225522 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.236791 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.237926 26611 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:16.225943 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.226200 26612 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.226203 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.227555 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.229460 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:16.232112 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:16.233069 31929 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:16.233795 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.242659 26679 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.243738 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:16.234337 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.234642 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.240289 26754 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:16.195761 31697 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.241976 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.197566 31759 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.250787 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.251058 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:16.247797 26606 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.234571 31999 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:16.249169 32010 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.246187 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:16.256009 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.201879 31812 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.263731 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.267836 26681 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.268299 26607 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.204221 31771 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.257396 31731 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.259351 31929 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:16.273528 31779 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:16.274837 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.275159 31697 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.275636 26608 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:16.276979 31919 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.006s
I20260709 13:09:16.277909 31813 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:16.280134 31759 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:16.281767 31768 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.283839 26609 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:16.382437 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:16.383157 27313 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:16.271471 32009 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.384099 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:16.385387 32009 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.284152 31812 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.257664 31746 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.285027 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.285454 27320 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:16.270888 31958 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.287003 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:16.287695 32010 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.290921 27312 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:16.339627 27321 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:16.316656 26679 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:16.386843 27319 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:16.395902 26609 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:16.397032 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:16.399423 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.400059 26682 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.401114 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.401801 26678 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:16.403644 26681 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:16.394516 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 131780us
I20260709 13:09:16.407524 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:16.409123 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.409777 26683 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:16.412388 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 137631us
I20260709 13:09:16.414755 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.415344 26686 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.417829 27314 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:16.418617 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:16.419899 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:16.420475 27321 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.421243 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:16.422202 26761 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12.
I20260709 13:09:16.387169 31929 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:16.439924 27318 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:16.449179 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.495151 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.436439 27285 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12.
I20260709 13:09:16.502663 27285 leader_election.cc:403] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:09:16.503194 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77345.3us
I20260709 13:09:16.495767 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.495529 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.507058 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.512187 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.513319 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:16.429134 31642 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:16.519516 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112063us
I20260709 13:09:16.515528 26752 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:16.519511 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 85769.4us
I20260709 13:09:16.414477 31779 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:16.434962 31932 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:16.517216 32010 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.433866 31958 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.504694 31877 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.316787 32022 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.214s
I20260709 13:09:16.388489 31919 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.503319 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.529505 31815 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:09:16.496762 31929 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.560362 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:16.531903 31932 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.540205 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.498188 31634 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:16.546974 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 150023us
I20260709 13:09:16.542893 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.415830 31747 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:09:16.552662 26612 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:16.517588 31759 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.516651 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.512507 31468 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:09:16.610742 27321 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:16.628595 26684 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.512881 31934 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:09:16.622411 26682 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
W20260709 13:09:16.623754 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.627187 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.669974 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:16.630826 26605 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:16.631335 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.636960 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.672623 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.673579 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:16.681872 31746 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.682901 31799 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.687274 31795 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:16.705570 26605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 592) took 1450 ms (client timeout 1843 ms). Trace:
I20260709 13:09:16.696470 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.736879 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.703974 31531 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.698485 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.738467 26609 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.649899 31634 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:16.671947 26610 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
W20260709 13:09:16.735713 26605 rpcz_store.cc:269] 0709 13:09:15.254949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.261608 (+  6659us) service_pool.cc:224] Handling call
0709 13:09:15.652496 (+390888us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:16.705320 (+1052824us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540003e3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:16.705491 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227614720}
I20260709 13:09:16.742910 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.675309 31525 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:16.716836 31919 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:16.717674 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.751324 26611 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
W20260709 13:09:16.632867 32028 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:09:16.724402 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 54523.4us
I20260709 13:09:16.753545 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.735525 31468 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:16.726034 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.764842 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.679908 26606 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:16.767393 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.768105 26606 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.729642 26684 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
W20260709 13:09:16.731137 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57673us
I20260709 13:09:16.770071 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:16.739590 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 179333us
I20260709 13:09:16.771394 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:16.741175 27321 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:16.743834 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.744459 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.697530 31779 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.747208 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.696213 31768 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.774070 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.743917 31697 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:16.688969 31771 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:16.738039 31642 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:16.750150 26686 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:16.765910 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:16.775885 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:16.778097 26610 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:16.725803 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 593) took 1470 ms. Trace:
I20260709 13:09:16.778275 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.664077 31759 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.791951 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.781064 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:16.781847 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.782126 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.782195 26604 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:16.795644 26608 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:16.795840 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3172) took 1219 ms. Trace:
I20260709 13:09:16.789947 26607 rpcz_store.cc:276] 0709 13:09:15.255247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.255385 (+   138us) service_pool.cc:224] Handling call
0709 13:09:16.725530 (+1470145us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b5400285ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:16.725715 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283589888}
I20260709 13:09:16.796468 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.796303 26604 rpcz_store.cc:276] 0709 13:09:15.576362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.736229 (+1159867us) service_pool.cc:224] Handling call
0709 13:09:16.795779 (+ 59550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.792904 26610 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:16.798978 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.798871 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.798906 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.807112 26609 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.807091 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.807977 26611 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.810786 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:16.806394 31634 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.812882 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.813542 26608 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:16.814409 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.815459 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.815727 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.816028 26608 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:16.816942 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.817039 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.817476 31961 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:16.817641 26608 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:16.817953 31961 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.818598 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.819831 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.820397 26608 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:16.821161 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.822134 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.823143 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.823638 26608 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.825044 31824 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:16.825476 31824 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.807163 31919 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:09:16.827785 31593 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:16.828128 31593 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.782606 31795 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:16.783134 31697 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.826429 31824 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.817677 26605 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:16.807832 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.700328 31932 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.818876 31961 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:16.835314 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 352981us
I20260709 13:09:16.840058 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.807111 31525 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:16.831902 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:16.789004 31642 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.788434 31468 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.840438 26610 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:16.829797 31952 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:16.842535 31697 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.869650 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.873351 26610 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:16.874467 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.853587 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 43479.1us
I20260709 13:09:16.855228 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:16.875273 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64568.6us
I20260709 13:09:16.880185 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:09:16.881953 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.867220 27316 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:16.888356 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.829006 31593 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:16.898447 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.899400 26610 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:16.865216 31642 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.852378 31525 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:16.908756 31548 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:16.911362 31525 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:16.911634 31548 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:16.912642 31548 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:16.917263 31795 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:16.902841 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:16.945868 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:16.865985 31934 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:16.872277 31932 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.909147 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.868139 31824 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.909873 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.917608 31812 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:16.864431 31877 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:16.918668 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.920717 31759 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:16.928011 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.931595 26683 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:09:16.983989 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.983901 26683 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:16.905083 31961 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.892963 31952 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:16.915311 26608 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:16.945698 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.903142 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:16.962743 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 192756us
I20260709 13:09:16.991382 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.966524 26609 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:16.898386 31919 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:09:16.995373 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 258628us
I20260709 13:09:16.993041 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:16.980484 31593 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:16.963372 31795 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:16.992903 26610 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:16.993587 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:16.997386 26608 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:16.998068 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:16.974084 31812 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:17.009553 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.014328 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:17.014357 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.016072 26610 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:17.017014 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.023175 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:17.023908 26610 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:17.027580 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.028455 26608 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:17.037261 26608 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:17.040268 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.044936 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2002) took 1742 ms. Trace:
I20260709 13:09:17.034399 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.022586 31795 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.084040 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:17.085140 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 51334.3us
I20260709 13:09:17.087447 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.029373 32022 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:17.045495 26608 rpcz_store.cc:276] 0709 13:09:15.295313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.036623 (+1741310us) service_pool.cc:224] Handling call
0709 13:09:17.037029 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.037835 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.038089 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.087250 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.094506 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.095554 26608 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:17.096973 31812 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:17.098017 32034 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:09:17.106086 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.988519 31468 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.110888 26758 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:17.114219 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:17.115232 26760 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:17.100374 31929 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.006s
I20260709 13:09:17.036504 32042 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:17.130749 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.131224 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.124300 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.035349 31759 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:17.107924 31634 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:17.121411 26754 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:17.139775 26761 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:17.118012 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:17.142330 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.143388 31746 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.145576 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:17.145483 31634 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.146370 26757 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.148013 31634 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.148857 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:17.047096 31952 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.139587 31779 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.154026 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 275827us
I20260709 13:09:17.154503 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.154597 26757 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:17.154801 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.155191 26608 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:17.156051 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.156677 26608 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:17.118680 32035 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:09:17.146176 32033 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:09:17.147836 32041 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:17.135888 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:17.163331 26610 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:17.166006 26606 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
W20260709 13:09:17.168678 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.175348 26757 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:17.169250 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2026) took 1021 ms. Trace:
I20260709 13:09:17.176565 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:17.169564 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.178987 26606 rpcz_store.cc:276] 0709 13:09:16.147444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.767094 (+619650us) service_pool.cc:224] Handling call
0709 13:09:17.169173 (+402079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.179452 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.180051 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:17.164532 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.115862 32022 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:17.158195 32010 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 13:09:17.215354 26608 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:17.166664 31919 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.216626 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:17.217440 26610 raft_consensus.cc:2376] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15. Re-sending same reply.
I20260709 13:09:17.174505 31634 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.167516 32051 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.179651 32042 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:17.174355 32041 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.223623 26606 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:17.227985 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2003) took 1932 ms. Trace:
I20260709 13:09:17.228468 26606 rpcz_store.cc:276] 0709 13:09:15.295636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.188218 (+1892582us) service_pool.cc:224] Handling call
0709 13:09:17.189072 (+   854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.227627 (+ 38555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.227912 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.230062 26606 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:17.174855 31759 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:17.224989 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3163) took 1916 ms. Trace:
I20260709 13:09:17.230774 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3166) took 1884 ms. Trace:
I20260709 13:09:17.223220 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.238528 26608 rpcz_store.cc:276] 0709 13:09:15.299476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.186992 (+1887516us) service_pool.cc:224] Handling call
0709 13:09:17.187333 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.215917 (+ 28584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.216194 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.220054 26758 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.128993 31929 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.238593 26606 rpcz_store.cc:276] 0709 13:09:15.346469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.229448 (+1882979us) service_pool.cc:224] Handling call
0709 13:09:17.229842 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.230510 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.230712 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.153422 31779 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.242787 26608 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:17.214035 32015 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:17.248087 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2008) took 1792 ms. Trace:
W20260709 13:09:17.244704 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65311.1us
I20260709 13:09:17.216020 32010 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12.
I20260709 13:09:17.248596 26608 rpcz_store.cc:276] 0709 13:09:15.455589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.239767 (+1784178us) service_pool.cc:224] Handling call
0709 13:09:17.240151 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.247757 (+  7606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.248025 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.249857 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3164) took 1931 ms. Trace:
W20260709 13:09:17.247292 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 160119us
I20260709 13:09:17.250850 26610 rpcz_store.cc:276] 0709 13:09:15.318887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.218247 (+1899360us) service_pool.cc:224] Handling call
0709 13:09:17.243293 (+ 25046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.243512 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.243547 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.249533 (+  5986us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.249584 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.249645 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.249786 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.255312 26606 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:17.256390 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3173) took 1604 ms. Trace:
I20260709 13:09:17.256985 26606 rpcz_store.cc:276] 0709 13:09:15.651627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.250044 (+1598417us) service_pool.cc:224] Handling call
0709 13:09:17.250436 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.256028 (+  5592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.256316 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.259253 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2014) took 1332 ms. Trace:
I20260709 13:09:17.259935 26606 rpcz_store.cc:276] 0709 13:09:15.926626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.258144 (+1331518us) service_pool.cc:224] Handling call
0709 13:09:17.258546 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.258785 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.258826 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.258892 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.258961 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.259039 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.259181 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.221763 31548 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.237461 32041 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.270838 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.243199 32046 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.278514 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3183) took 1392 ms. Trace:
W20260709 13:09:17.278468 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 55327.6us
I20260709 13:09:17.279126 26608 rpcz_store.cc:276] 0709 13:09:15.885789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.254956 (+1369167us) service_pool.cc:224] Handling call
0709 13:09:17.255357 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.278192 (+ 22835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.278444 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.281605 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3196) took 1081 ms. Trace:
I20260709 13:09:17.282166 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3192) took 1356 ms. Trace:
I20260709 13:09:17.281985 26608 rpcz_store.cc:276] 0709 13:09:16.200737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.280767 (+1080030us) service_pool.cc:224] Handling call
0709 13:09:17.281093 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.281269 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.281304 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.281351 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:17.281383 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.281450 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.281552 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.282716 26610 rpcz_store.cc:276] 0709 13:09:15.926173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.262395 (+1336222us) service_pool.cc:224] Handling call
0709 13:09:17.281669 (+ 19274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.281848 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.281874 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.281927 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.281959 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.282017 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.282115 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.283957 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3197) took 1082 ms. Trace:
I20260709 13:09:17.284511 26608 rpcz_store.cc:276] 0709 13:09:16.201056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.283131 (+1082075us) service_pool.cc:224] Handling call
0709 13:09:17.283398 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.283563 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.283587 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.283627 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.283689 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.283748 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.283898 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.237056 31919 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.261284 32040 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:17.279052 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.258301 32042 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:17.294828 26610 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:17.295549 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3200) took 1093 ms. Trace:
I20260709 13:09:17.295955 26610 rpcz_store.cc:276] 0709 13:09:16.202579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.283657 (+1081078us) service_pool.cc:224] Handling call
0709 13:09:17.294645 (+ 10988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.295284 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.295490 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:17.299103 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66354.2us
I20260709 13:09:17.239832 32051 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.303642 26605 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:17.303858 26610 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:17.292477 32040 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.256655 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:17.306912 26757 raft_consensus.cc:606] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.307194 26757 raft_consensus.cc:614] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:17.269688 31952 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:17.286366 32046 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.304569 32047 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.287887 31548 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:17.312505 32039 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:09:17.322854 32045 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:17.325475 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 641) took 1114 ms. Trace:
I20260709 13:09:17.356384 27319 rpcz_store.cc:276] 0709 13:09:16.210772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.210932 (+   160us) service_pool.cc:224] Handling call
0709 13:09:17.325320 (+1114388us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400632754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:17.325419 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343061376}
I20260709 13:09:17.327507 31934 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:17.328872 26756 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:17.329667 32021 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:17.330962 31958 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.002s
I20260709 13:09:17.333288 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 605) took 1114 ms. Trace:
I20260709 13:09:17.366284 27316 rpcz_store.cc:276] 0709 13:09:16.218850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.218979 (+   129us) service_pool.cc:224] Handling call
0709 13:09:17.333093 (+1114114us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54002b8754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:17.333221 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164393216}
I20260709 13:09:17.334332 27315 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:17.308768 32040 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.345794 31606 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:17.347069 31919 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:17.354485 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.354748 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182860us
I20260709 13:09:17.316419 32052 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:17.373858 32043 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:09:17.359184 31934 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:17.313799 32056 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:09:17.396471 32061 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.397083 32061 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.401022 32051 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.302160 32022 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.403997 26756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:17.404652 26756 raft_consensus.cc:606] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:09:17.406154 32054 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.133s	user 0.003s	sys 0.000s
I20260709 13:09:17.381497 31525 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.411285 31642 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.414130 31642 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.382074 32052 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.416066 32052 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.416694 32059 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:17.417155 32059 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:17.418565 31548 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.419135 31746 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.420873 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 737) took 1164 ms. Trace:
I20260709 13:09:17.421285 27315 rpcz_store.cc:276] 0709 13:09:16.256145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.256358 (+   213us) service_pool.cc:224] Handling call
0709 13:09:17.334128 (+1077770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.367527 (+ 33399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.420667 (+ 53140us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002b8750. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:17.420811 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451476352}
W20260709 13:09:17.421977 31531 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.003s
I20260709 13:09:17.422515 31889 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.390209 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:17.423034 31889 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.423838 32049 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:17.424351 32049 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:17.425228 32049 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.426981 31889 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:17.427937 32020 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.428568 32020 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.304320 31759 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.364127 32021 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:17.423050 31779 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:17.376446 31771 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.390228 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 101173us
I20260709 13:09:17.440450 31771 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.441967 31752 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.443655 32067 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.444576 31929 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.444389 32067 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.448163 31934 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.452373 26683 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.452986 31634 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.453850 27316 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:17.358114 32047 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.454195 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.454927 26686 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:17.453799 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.456014 32047 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:17.456280 26680 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:17.392089 32042 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.457000 32021 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.458431 32021 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.458617 26607 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:17.456137 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:17.459859 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.460216 26682 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:17.460868 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:17.461189 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 168789us
I20260709 13:09:17.462759 26679 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:09:17.462760 26604 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:17.464115 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.464401 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.478142 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:17.461748 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.474915 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:17.479537 26758 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:17.480270 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.481758 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.483150 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:17.472164 26650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.716s (SENT) [suppressed 58 similar messages]
I20260709 13:09:17.485937 26681 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 15. Ops: []
I20260709 13:09:17.428985 31999 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:17.491614 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:17.492581 26760 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:17.489437 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.494306 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:17.494843 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.496269 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.496971 26610 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:17.498951 26607 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:17.500113 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.500896 26607 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:17.501789 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.515275 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.479067 31752 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.488667 32058 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:09:17.503753 26684 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:17.520042 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.518774 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:17.519263 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:17.504685 26756 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:17.517751 26678 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:17.502466 26724 connection.cc:256] RPC call timeout handler was delayed by -1.1439417990001175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 13:09:17.491704 31958 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:17.543392 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.544072 26684 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:17.536177 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:17.548007 27316 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:17.548903 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 606) took 1249 ms. Trace:
I20260709 13:09:17.549305 26608 rpcz_store.cc:276] 0709 13:09:16.299378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.289612 (+990234us) service_pool.cc:224] Handling call
0709 13:09:17.289985 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:17.290449 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.290487 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:17.294354 (+  3867us) log.cc:844] Serialized 52 byte log entry
0709 13:09:17.529821 (+235467us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:17.546830 (+ 17009us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.548569 (+  1739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.548643 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.548700 (+    57us) raft_consensus.cc:1685] finished
0709 13:09:17.548711 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.548827 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15935,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":62759,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"thread_start_us":211397,"threads_started":1,"wal-append.queue_time_us":236506}
I20260709 13:09:17.551115 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.552654 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.537554 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:17.554541 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:17.538136 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.479826 32067 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:17.539985 26678 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:17.555425 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.555636 32067 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:17.556288 32067 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:17.557531 32067 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.491977 31998 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:17.560048 31998 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:17.558971 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.561384 32066 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.562027 32066 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:17.562077 26608 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:17.542311 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:17.535146 27319 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:17.561445 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67130.5us
I20260709 13:09:17.562446 32066 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.491537 31548 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.561246 31998 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.563803 31548 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.566008 31548 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.520287 26681 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:17.568540 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.569428 31548 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:17.569795 31548 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:17.570151 31548 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.570802 27315 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:17.571997 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.572968 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.576335 32064 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.580708 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2022) took 1434 ms. Trace:
I20260709 13:09:17.580793 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.504283 31634 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:17.584899 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.575971 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.585341 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.585721 26608 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:17.586051 26679 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:17.586627 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:17.504043 31531 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:17.583354 26684 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:17.584339 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:17.581208 26606 rpcz_store.cc:276] 0709 13:09:16.146034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.261300 (+1115266us) service_pool.cc:224] Handling call
0709 13:09:17.261692 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.270170 (+  8478us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:17.555311 (+285141us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.578927 (+ 23616us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.580396 (+  1469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.580442 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.580486 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.580560 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.580660 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120580,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":1236,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":163,"thread_start_us":291676,"threads_started":2,"wal-append.queue_time_us":21557}
I20260709 13:09:17.496528 31877 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:17.570876 32066 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.575093 32072 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:17.590554 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:17.491701 31779 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:09:17.592049 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.593494 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.621729 26679 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:17.593839 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.594187 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.622905 26680 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.622802 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.593312 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.624251 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.624750 26684 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:17.533582 31999 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:17.592576 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:17.587328 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.603828 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.626906 26682 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
W20260709 13:09:17.583488 31697 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.001s
I20260709 13:09:17.623592 26685 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:09:17.623960 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.628214 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:17.629101 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:17.629881 26607 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:17.516716 31889 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:09:17.600203 31468 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.636346 26757 raft_consensus.cc:606] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:17.637396 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.591830 31771 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.588496 31958 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:17.639833 26679 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:17.536309 31752 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.641433 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:17.650671 26756 raft_consensus.cc:2410] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:09:17.643319 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90714.6us
I20260709 13:09:17.653131 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.644465 26686 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:17.659073 26680 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:17.660894 26679 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:17.645514 31961 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.005s
I20260709 13:09:17.662684 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.638639 32072 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:17.691027 26611 raft_consensus.cc:2410] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:17.646284 31999 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:17.633378 31746 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:17.691273 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 104976us
I20260709 13:09:17.710423 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:17.692287 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95972.5us
W20260709 13:09:17.706981 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44387.5us
W20260709 13:09:17.714972 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 101239us
I20260709 13:09:17.715638 26724 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.716228 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.707818 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.634630 31697 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.648353 31468 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.812855 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:17.652385 32052 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.824492 26679 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:09:17.826505 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:17.716104 31889 raft_consensus.cc:993] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:17.837972 26679 pending_rounds.cc:85] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:17.694398 32020 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.718798 31877 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:17.847553 26679 pending_rounds.cc:107] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:09:17.851293 26679 raft_consensus.cc:2889] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.719055 31998 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.785830 31542 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.750695 31771 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:09:17.719357 31746 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.770059 31642 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:17.768489 32040 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.852861 32083 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.854506 26754 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:17.862135 26679 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:17.778599 31752 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.774209 32049 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:17.781220 32047 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.841336 31957 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:17.858641 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.832805 31747 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:17.841789 32009 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.857349 32020 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:17.884568 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.884835 26679 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:09:17.867120 31795 consensus_meta.cc:287] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.003s
I20260709 13:09:17.887104 31795 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.889351 31746 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.889787 31795 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:17.876382 32072 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:17.891258 32078 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:09:17.891824 31468 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.892166 32040 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:17.892876 32040 raft_consensus.cc:1081] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:17.893885 31812 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.878440 32049 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:17.895984 32049 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.896044 31746 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:17.897261 32055 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
I20260709 13:09:17.896826 31746 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.883819 32047 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.899613 32059 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.900089 32047 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.900645 31746 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.900975 32059 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:17.859503 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 149249us
W20260709 13:09:17.850277 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 134712us
I20260709 13:09:17.908644 26724 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.851011 31877 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:17.848611 32081 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:17.879818 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.842005 31958 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.918586 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.880671 32009 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.919191 26679 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:17.921510 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:17.884090 32020 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.927809 32009 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.916123 32047 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:17.927928 32020 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.860544 31542 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.952962 26686 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:17.953397 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:17.903607 32041 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.004s
W20260709 13:09:17.944321 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.954567 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:17.958804 26678 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
W20260709 13:09:17.961658 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.020s
W20260709 13:09:17.962082 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.011s	sys 0.020s
W20260709 13:09:17.962395 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 662448us
W20260709 13:09:17.963502 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.964298 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:17.964718 26679 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
W20260709 13:09:17.964205 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 137785us
I20260709 13:09:17.918464 32081 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:17.967803 32088 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:17.968587 32081 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.968670 26687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55252
I20260709 13:09:17.969358 26687 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.969720 26687 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.971797 32060 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.972283 32060 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:17.973349 26603 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:17.973169 32040 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:17.974558 32052 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.975255 32066 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:17.933681 32074 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.977129 26680 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:17.884771 31747 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:17.967314 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:17.975334 32040 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:17.967202 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.022867 26679 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:17.964178 32047 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:17.886559 31999 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.026327 26683 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:09:18.027318 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60101.6us
I20260709 13:09:17.966353 31901 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.966634 31634 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:18.021373 31932 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.039s	user 0.005s	sys 0.006s
I20260709 13:09:17.964691 32041 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:18.036576 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57374.3us
I20260709 13:09:18.038475 26609 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
W20260709 13:09:18.039288 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.041344 26683 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.965267 31548 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.025398 32047 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:18.046288 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 73636.1us
W20260709 13:09:18.048702 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 84298.8us
I20260709 13:09:18.029241 31531 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:18.056697 26685 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:18.050840 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.029884 32010 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:18.115561 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65869.7us
W20260709 13:09:18.126327 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.137147 31747 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.025966 31877 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.141566 31548 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.141983 31542 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.143486 26679 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:18.149892 31634 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.154023 26685 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:18.158280 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.230095 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.229067 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.238135 26679 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:18.049379 32047 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.191155 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.248113 26682 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:18.249125 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.249727 26682 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.191469 26681 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:18.047650 31697 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.239650 31812 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.227221 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 176453us
I20260709 13:09:18.239888 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.254057 31812 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.254743 26685 raft_consensus.cc:2368] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
I20260709 13:09:18.256101 26685 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:18.257407 26685 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:18.258653 26685 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:18.240422 26686 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:18.244333 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.246539 32084 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.261740 26684 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:18.262368 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.190675 32066 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:18.263790 26685 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:18.268973 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.252911 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.321475 26686 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:18.321727 26681 raft_consensus.cc:2410] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:18.262969 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:18.187219 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.324148 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.325345 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.197144 32010 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:18.259505 26687 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.329397 26682 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:18.304518 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2059) took 1393 ms. Trace:
I20260709 13:09:18.191817 31932 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:09:18.339412 26611 rpcz_store.cc:276] 0709 13:09:16.910741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.945440 (+ 34699us) service_pool.cc:224] Handling call
0709 13:09:18.304255 (+1358815us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002850d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:18.304442 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607916800}
I20260709 13:09:18.338971 27320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 736) took 2108 ms. Trace:
I20260709 13:09:18.340674 27320 rpcz_store.cc:276] 0709 13:09:16.220058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.220201 (+   143us) service_pool.cc:224] Handling call
0709 13:09:16.249553 (+ 29352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.393800 (+144247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.328337 (+1934537us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:18.328520 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81944320}
I20260709 13:09:18.231420 32083 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:09:18.304647 32090 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:18.347565 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 84674.7us
I20260709 13:09:18.304421 31747 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:18.354988 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 306420us
I20260709 13:09:18.359210 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.363499 26687 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:18.358319 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:18.339937 31548 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.360785 31747 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.401150 32093 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.401947 32093 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.402388 31747 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.404013 31812 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:18.412997 32085 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
W20260709 13:09:18.418138 32091 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 13:09:18.320958 32066 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.353420 32090 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:18.454811 32090 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.457337 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.458139 26687 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:18.459033 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.460340 26684 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:18.406210 32092 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:18.421171 32095 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:18.336297 32074 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:09:18.450146 32097 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:09:18.450276 26604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2056) took 1583 ms (client timeout 1998 ms). Trace:
I20260709 13:09:18.452173 32060 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.454326 32066 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:18.460204 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.381866 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:18.461457 26687 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:18.465229 26604 rpcz_store.cc:269] 0709 13:09:16.866618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.872874 (+  6256us) service_pool.cc:224] Handling call
0709 13:09:18.450058 (+1577184us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:18.450203 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967214464}
I20260709 13:09:18.370549 31548 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:18.466867 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112566us
I20260709 13:09:18.443517 31642 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.471488 31548 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.476372 31815 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:18.479786 31815 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:18.480697 31815 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.481950 31815 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:18.482528 32009 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
I20260709 13:09:18.471176 26683 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:18.367475 31531 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.483968 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 592) took 2280 ms. Trace:
I20260709 13:09:18.484404 26753 rpcz_store.cc:276] 0709 13:09:16.203247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.203365 (+   118us) service_pool.cc:224] Handling call
0709 13:09:16.208022 (+  4657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.220545 (+ 12523us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:16.232177 (+ 11632us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.294635 (+ 62458us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180044f2c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:17.332581 (+1037946us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b180044f2c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:17.832935 (+500354us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b180044f2c0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e3023a 00007f40f329aa2a
0709 13:09:17.880364 (+ 47429us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.961530 (+ 81166us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.961681 (+   151us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:17.961719 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.961805 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.483757 (+521952us) raft_consensus.cc:1685] finished
0709 13:09:18.483778 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.483912 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19567,"prepare.queue_time_us":11887,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":11700,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7279,"spinlock_wait_cycles":60800000,"thread_start_us":47266,"threads_started":1,"wal-append.queue_time_us":1670401}
I20260709 13:09:18.478621 31525 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.483078 32009 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:18.470350 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 434577us
I20260709 13:09:18.470079 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:18.487529 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 105749us
W20260709 13:09:18.487262 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 329077us
I20260709 13:09:18.491206 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.493299 26684 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:09:18.494442 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.496290 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.491729 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:18.474360 32099 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:18.443519 32037 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:18.499984 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:18.499974 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.502346 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:18.483994 32041 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.523061 26683 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:18.524133 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:18.528251 26604 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:18.528733 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:18.525326 26687 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:18.489903 32095 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:18.499423 31752 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:18.523864 32099 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.535230 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:18.483088 32047 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.529686 32092 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.540889 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.522321 32037 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:18.536568 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:18.536516 26724 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.763s (SENT)
W20260709 13:09:18.531010 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.538957 32073 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:18.543829 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:18.545408 26610 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:18.547250 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:18.547984 26610 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:18.540416 32047 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.535491 32074 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.529888 31525 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:18.557050 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:18.557657 26607 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:18.555279 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:18.558475 26604 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:18.551316 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51391us
I20260709 13:09:18.559458 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.541007 32041 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.542538 32092 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.541591 32099 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.561573 26612 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:18.564239 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.554129 32074 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.598529 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.600244 31642 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:18.601047 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.601329 31642 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.601703 31642 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:18.602069 31642 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.602246 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.603932 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:18.605093 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:18.605801 32020 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:09:18.606258 32020 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.502652 32010 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.562422 32041 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:18.609200 32041 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.561407 31752 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:18.612586 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48446us
W20260709 13:09:18.613350 32059 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:09:18.613724 32104 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.614140 32104 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:18.614751 26612 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:09:18.615248 32081 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:09:18.615641 32081 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.616142 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:18.617614 32081 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.618144 31747 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:18.618534 32049 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.000s
I20260709 13:09:18.618968 32049 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.619856 26761 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:18.556932 32102 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.620430 32102 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:18.620795 32102 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.621004 32049 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.564239 32093 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.556911 32009 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.622967 32041 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.657186 32041 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.614157 32037 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.658025 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:18.658475 27314 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:18.658658 27320 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.659071 32037 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.664176 27315 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:18.665794 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.666374 26753 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.672075 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.673467 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.676774 27320 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:18.619611 31747 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:09:18.591804 32092 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.616160 26612 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:18.686014 26752 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:18.597050 32047 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:18.614151 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:18.629179 32048 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.345s	user 0.008s	sys 0.011s
I20260709 13:09:18.557233 31889 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.631332 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.614544 32104 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.631982 31877 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.632131 32066 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.630443 32074 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.632687 32088 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:18.633097 32084 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:18.633780 32020 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:18.614621 32021 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 1.156s	user 0.015s	sys 0.001s
I20260709 13:09:18.633772 31548 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.635392 32090 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:18.636860 32044 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.388s	user 0.003s	sys 0.014s
I20260709 13:09:18.637770 32099 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.638705 26611 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:18.644879 26604 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:18.649580 27286 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:18.652745 31752 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:18.682881 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.725749 26754 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:18.725754 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76294us
I20260709 13:09:18.684814 26759 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:18.726678 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:18.727191 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.688568 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.729127 26684 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.689412 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.691550 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.688840 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.697724 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.730669 26678 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.702260 32084 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:18.698140 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66897us
I20260709 13:09:18.696725 26753 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:18.702898 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88813.5us
W20260709 13:09:18.704430 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 169325us
I20260709 13:09:18.687235 32047 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.708384 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:18.699046 31815 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.690975 31889 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.699445 32041 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:18.735656 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.709964 32088 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:18.742540 26726 leader_election.cc:400] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:18.755373 26726 leader_election.cc:403] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.743561 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.744310 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.756981 26756 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:18.757428 26756 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:18.709120 31999 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:09:18.739109 32047 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.747282 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:18.747860 31542 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:18.749089 32099 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:18.720081 31642 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.770393 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.772070 31642 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.770426 32049 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:18.772733 32066 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.773240 32066 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:18.773782 32103 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:18.774135 32066 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.752889 32010 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.775084 32101 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:18.775768 31799 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 13:09:18.753743 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 46543us
I20260709 13:09:18.740957 31752 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.776548 31815 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.760246 31877 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:09:18.777603 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:18.754130 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.778231 31752 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:18.778743 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.734035 32021 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.779052 32084 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.752113 31934 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.780370 32084 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.762889 26684 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:18.749895 31889 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.756299 32020 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.784206 32020 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.785646 31812 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.786433 32020 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.768661 32073 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.763468 32112 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.787644 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:18.788029 32112 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.788188 31932 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.788429 26612 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:18.788552 32106 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:18.786182 31812 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.789851 26678 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:18.775981 31957 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:18.704262 32095 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:18.792516 26754 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:18.774665 32103 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.768676 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.794975 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:18.790832 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:18.801915 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.804697 32090 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.805202 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.808223 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.825067 27320 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:18.825495 26681 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:18.798203 31818 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:09:18.758385 26756 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.788579 32112 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.816157 31901 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:18.816346 32107 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.829176 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:18.841161 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:18.817155 31606 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:09:18.817299 32040 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:09:18.841352 31901 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.848483 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.849246 32107 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:18.849388 26755 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:18.849677 32107 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:18.849895 26758 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:18.850777 32041 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.850605 32107 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.818311 31812 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:18.835338 31747 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:18.852135 31747 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:18.852406 32107 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.853013 31747 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.857383 32114 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:18.857977 32114 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.788774 31932 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.812958 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.796653 31957 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:18.832896 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:18.814458 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:18.861080 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 46698.2us
I20260709 13:09:18.752890 32102 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:18.837059 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 68448.2us
I20260709 13:09:18.868427 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.821413 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:18.869750 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48441.1us
I20260709 13:09:18.811606 31889 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.840225 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.839497 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.840564 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.878268 26753 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:18.877414 26752 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:18.878800 26685 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:18.831423 32020 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:18.845464 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:18.847934 31919 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.848021 31606 consensus_queue.cc:1243] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:18.818320 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36840 (request call id 34) took 1288 ms. Trace:
I20260709 13:09:18.831384 32060 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:09:18.844214 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.880391 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:18.838055 32037 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.881840 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.919407 26724 leader_election.cc:400] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:18.887508 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:18.858685 31818 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:18.919623 26757 rpcz_store.cc:276] 0709 13:09:17.530296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.536838 (+  6542us) service_pool.cc:224] Handling call
0709 13:09:18.818135 (+1281297us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400138654. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328a853 00007f40f825860a 00007f40f17de7d4 00007f40f17de762 00007f40f17de691 00007f40f17de60c 00007f40f17dd8c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:18.818229 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75989248}
I20260709 13:09:18.925760 32094 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:18.933081 32010 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.883973 32099 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.934182 32099 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.879747 31548 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.882707 32020 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.935600 32020 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:18.828012 32095 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.816131 32088 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.921765 32098 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.940212 32098 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.942055 32060 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:18.942292 32098 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.942466 32060 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:18.832283 32092 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:18.944080 26603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3191) took 3056 ms (client timeout 1763 ms). Trace:
W20260709 13:09:18.944489 26603 rpcz_store.cc:269] 0709 13:09:15.916565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.996368 (+ 79803us) service_pool.cc:224] Handling call
0709 13:09:18.943864 (+2947496us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:18.943985 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4489980800}
I20260709 13:09:18.944959 32047 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.945758 32092 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.947084 32047 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:18.947521 26605 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:18.879539 31877 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:18.934973 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.880391 32093 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:18.954540 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:18.952546 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65101.5us
I20260709 13:09:18.962559 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:18.919596 31642 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.972728 27316 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:18.975561 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:18.976495 27312 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:09:18.982815 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.982923 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:18.983920 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.922937 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50095.6us
I20260709 13:09:18.985952 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:18.991950 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:18.992676 27312 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 10 LEARNER]: Advancing to term 11
W20260709 13:09:18.993111 26650 connection.cc:256] RPC call timeout handler was delayed by -1.1616445310000927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:09:18.994354 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:18.935051 32102 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:18.928462 31818 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:18.955116 32116 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.000365 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.003952 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:18.975176 31877 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.006542 32090 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:19.007267 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.048967 27313 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:18.980660 32050 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:19.009972 32117 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:09:19.010877 32111 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:09:19.012217 32114 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.004562 31957 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:18.980892 32093 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:19.004019 32042 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.999987 32052 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:18.949563 32037 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:18.975023 31752 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:19.043303 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 43785.4us
I20260709 13:09:18.926525 31952 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:18.943305 32060 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.005820 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:19.069015 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63317.8us
I20260709 13:09:19.070073 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:19.071636 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.072801 26757 raft_consensus.cc:2393] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 11: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:19.075949 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.076679 26755 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:19.077425 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.053581 31542 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.079129 27320 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:19.080724 32046 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.084364 32103 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:19.084858 32103 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:19.085693 31812 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:09:19.085868 32103 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.087322 32103 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.087882 31877 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.090564 31542 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.091990 31957 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:19.107550 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54436.2us
I20260709 13:09:19.092630 31818 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.094000 32099 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:19.094015 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:19.057308 32116 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.096489 32040 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:19.098999 32073 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:19.099352 32061 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.076885 32102 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.101403 32037 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.102489 31932 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.092394 32093 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.111460 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.055022 32104 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.076396 31752 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:19.125654 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.126888 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:19.139504 32074 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.116357 31952 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:19.120121 32040 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.113381 32041 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:19.145269 26609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2065) took 2106 ms (client timeout 1840 ms). Trace:
I20260709 13:09:19.148116 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.148298 26608 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:19.164794 26650 leader_election.cc:336] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.840s (SENT)
I20260709 13:09:19.165491 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.166733 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:19.156600 26609 rpcz_store.cc:269] 0709 13:09:17.038804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.041615 (+  2811us) service_pool.cc:224] Handling call
0709 13:09:19.144998 (+2103383us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54001f6654. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:19.145175 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184237952}
W20260709 13:09:19.168718 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104320us
W20260709 13:09:19.171687 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.114089 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44119.3us
I20260709 13:09:19.153007 31818 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.155185 31889 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.148926 31952 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.152244 32084 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:19.178620 31932 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.136624 31901 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.121755 32020 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.173614 32061 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:19.174537 31542 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:19.172681 32102 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:19.150646 32040 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.182139 31952 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:19.149794 31752 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.179698 32021 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.181943 32084 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:19.197248 26607 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.199079 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.199237 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.173938 32073 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:09:19.201763 26603 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.196462 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.185508 32061 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.219944 32061 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:19.220908 32077 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.440s	user 0.009s	sys 0.003s
I20260709 13:09:19.204032 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.206794 32116 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.213143 31901 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.255904 27315 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.255398 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3281) took 1327 ms. Trace:
I20260709 13:09:19.184810 31932 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.218400 32104 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.229709 26609 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.234807 27312 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 LEARNER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:19.248061 26577 leader_election.cc:400] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
I20260709 13:09:19.142408 32074 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.207404 32129 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:09:19.256330 26680 rpcz_store.cc:276] 0709 13:09:17.928042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.929188 (+  1146us) service_pool.cc:224] Handling call
0709 13:09:17.929498 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.000675 (+ 71177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.255162 (+1254487us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54003052d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:19.255333 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108599680}
I20260709 13:09:19.196867 32102 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.222131 31934 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.251380 32040 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:19.281735 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.204228 32084 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:19.260490 32051 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.019s	sys 0.016s
W20260709 13:09:19.296116 32051 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.021s	sys 0.018s
I20260709 13:09:19.265074 26577 leader_election.cc:403] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:19.297535 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49707.1us
I20260709 13:09:19.289954 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.262971 32090 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:19.281064 32126 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:19.251448 32041 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.300040 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.318979 26609 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:19.320148 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.320887 26609 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.301425 32103 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.323964 31642 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:19.331607 26603 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:19.317307 31815 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.332669 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.308204 32104 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:09:19.308295 31468 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:19.310164 32090 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.316489 32041 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.347505 31752 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:19.360074 31752 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:19.360491 26603 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:19.351796 26604 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:19.363251 27312 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:19.369416 31934 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.370908 31932 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:19.376912 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.340857 26609 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:19.382893 32041 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.385471 32102 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.366452 31542 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:19.393491 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.354146 32090 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.353055 32020 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:19.401988 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 232550us
I20260709 13:09:19.400851 32102 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.408645 32102 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.410717 32102 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.412947 31952 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.419730 31952 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.420353 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.421732 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.422807 31606 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:19.423496 31606 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:19.429078 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.431066 26760 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:19.431277 32103 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14.
I20260709 13:09:19.432183 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.432768 26754 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:19.433914 32112 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:09:19.434367 32112 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.435124 26607 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:19.437975 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2058) took 1593 ms. Trace:
I20260709 13:09:19.438333 26761 rpcz_store.cc:276] 0709 13:09:17.844596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.844702 (+   106us) service_pool.cc:224] Handling call
0709 13:09:17.853774 (+  9072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.620250 (+766476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.437719 (+817469us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540014f5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:19.437894 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761371392}
I20260709 13:09:19.352134 32084 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.440476 27285 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.442647 32084 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.445318 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:19.446527 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.448657 26759 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:19.448794 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.450757 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.451568 26684 raft_consensus.cc:2410] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:19.451609 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.452183 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.451635 26680 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [12.11-15.12]
I20260709 13:09:19.452406 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.452809 26682 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.453270 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.453425 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.453946 26680 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.457573 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.459261 26682 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:19.460341 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.460928 26682 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:19.462253 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.462940 26685 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:19.468724 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.469511 26678 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.470989 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.471854 26684 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:19.476362 26686 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:19.480434 26680 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:19.483283 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.485517 26678 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:19.487001 26760 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:09:19.487378 26760 pending_rounds.cc:85] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 10
I20260709 13:09:19.455133 32010 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.487610 26760 pending_rounds.cc:107] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:09:19.492518 26760 raft_consensus.cc:2889] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.488369 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.493247 26754 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.470288 32051 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:19.490232 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.455413 32135 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.477329 32084 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:19.502729 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.507741 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.373517 31752 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.484222 31642 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:19.512698 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.462594 31795 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:19.521147 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:19.484055 32066 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:19.527618 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.527583 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:19.530252 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.513875 32042 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.531023 32041 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:19.535552 26678 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:19.515362 32088 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.495020 31548 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:19.497424 31779 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:09:19.511564 32050 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.491597 32049 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:09:19.535379 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.508868 32061 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.537499 26754 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:19.523154 32067 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:19.503980 31889 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:09:19.543262 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.530099 32084 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:19.551991 32151 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:19.552759 32151 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:19.553115 26678 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:19.553603 26680 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:19.554111 32151 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.554607 32151 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.541389 31731 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:19.558494 32135 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.557487 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.561754 26678 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:19.563005 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:19.542743 32042 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:19.565160 26755 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:19.565487 32151 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:19.544732 32112 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:19.546828 31642 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:19.566898 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.575883 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.564436 32050 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:19.568332 32047 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:19.559278 32099 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:09:19.572685 31642 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:19.587632 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60117.4us
I20260709 13:09:19.588905 26726 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.583359 31795 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:19.580775 31901 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:19.592052 32050 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.567646 32135 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.579541 32146 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.594762 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.600327 26607 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.574272 32151 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:09:19.579746 31731 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.579187 32156 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:19.590795 31877 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:19.614471 26754 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:19.615088 26752 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.615593 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.615720 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.616212 26752 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.617408 26752 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:19.619231 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.591728 31795 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.577564 32148 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:09:19.592895 32061 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:19.621263 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.622536 26752 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:19.595080 32067 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.623194 27314 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:19.625190 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.625886 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.626029 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:19.612205 32156 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.619055 31606 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:19.627993 32040 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:19.627712 31779 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:19.628580 32040 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.628021 31606 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.629419 32040 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.630497 31606 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.630577 31795 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.612699 31901 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.632391 32104 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:19.632848 32104 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:19.632846 31901 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.633978 32135 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.638813 26607 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:19.634063 32104 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.640864 32067 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.642302 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:19.646798 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.620537 32072 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:19.665096 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.617691 31642 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.650571 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.645256 32074 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:19.635794 32156 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.619333 32042 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:19.657195 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 342150us
I20260709 13:09:19.624657 31877 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.606086 32146 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.654947 31731 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.600284 32133 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:09:19.679046 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.687220 26607 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:19.643877 32050 raft_consensus.cc:2764] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:09:19.688370 32148 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:19.689205 32148 consensus_queue.cc:1243] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:19.689698 32148 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:19.690013 32148 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:19.681690 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.693161 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.684934 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.694950 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.695019 31468 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:19.696241 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.697072 26753 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:19.690871 32148 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.666079 32135 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:19.702226 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:19.707297 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:19.709306 26681 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:19.686825 31919 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:19.678272 32159 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.696210 31468 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:19.706465 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.735596 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:19.736720 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.737330 26753 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:19.714228 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.715808 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.717368 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.719113 26682 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:09:19.738246 26685 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:19.738703 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.740091 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.741380 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.680908 32074 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:19.727348 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 192020us
I20260709 13:09:19.743114 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.743361 32074 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.744831 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:19.746068 26682 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:19.746999 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.748230 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:19.749056 26682 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:19.754482 26681 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:19.736006 26576 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:19.784106 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.788771 26753 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:19.789645 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:19.712141 31642 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:19.795475 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52432.9us
I20260709 13:09:19.796231 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:09:19.793267 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57391.6us
I20260709 13:09:19.797765 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.724099 32133 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:19.722729 32135 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:19.807152 27314 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:19.810420 26753 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.808023 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.811398 26607 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:19.754006 32148 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:19.706244 31957 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:09:19.789439 32104 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.795321 31468 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.803860 32133 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.804250 31932 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:19.828619 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.830171 26603 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.812956 31901 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:19.736092 32159 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.833443 32133 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.864527 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:19.864907 26603 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:19.866122 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:19.868906 26607 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:19.879348 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:19.832990 31932 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.884994 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.885993 26603 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.887725 27315 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 LEARNER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:19.837314 31901 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:19.891125 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.891773 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:19.892935 26753 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:19.868673 31818 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:19.881660 32164 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:09:19.898598 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.899076 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:19.813185 31877 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:19.901577 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.902022 27315 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:19.906236 27313 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:19.881374 31731 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.883489 32010 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:19.893236 32084 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.915114 26603 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:19.885227 31932 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.917712 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:19.895509 31901 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.904103 32040 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.922556 27314 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:19.922536 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.922989 32082 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.882462 32147 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:19.913676 32066 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.927832 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:19.924912 26607 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:19.929059 27315 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:19.919555 31731 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.924264 32061 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:19.932488 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3206) took 2436 ms. Trace:
I20260709 13:09:19.937201 26605 rpcz_store.cc:276] 0709 13:09:17.496508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.496661 (+   153us) service_pool.cc:224] Handling call
0709 13:09:18.947168 (+1450507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.947897 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.932266 (+984369us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003f0f50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:19.932414 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335216896}
I20260709 13:09:19.943094 31731 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:19.943534 31818 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:19.944077 31818 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:19.956128 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.960557 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.960763 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.961457 26607 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:19.962522 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:19.961406 26605 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.893652 32135 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.929450 32040 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.970328 32095 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:19.924036 32099 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:09:19.922629 32084 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:19.940949 32010 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.947296 32074 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:19.984941 32174 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:09:19.991986 27315 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:19.939601 32066 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.931143 32082 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:19.974419 32095 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.997557 32074 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:19.997376 32162 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:09:19.990883 32010 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.031554 32010 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.032640 32095 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.038316 26603 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:20.017696 26607 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:20.017704 26605 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:20.021212 32082 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.022746 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.023921 31815 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:20.024664 32156 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.041692 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:20.042685 26678 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:20.026710 31934 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:20.045001 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:20.027401 32066 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.029140 32084 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:20.029264 32052 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:19.973917 32107 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:09:20.072721 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.073493 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.074769 26757 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:20.073536 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.076560 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:20.129045 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.139734 26605 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:20.101401 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:20.077855 31468 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.105017 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.128119 27319 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:20.097962 26603 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 11: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:20.112440 32183 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:09:20.105752 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.122571 32180 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:09:20.073817 31934 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:20.076624 32010 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:20.102543 32060 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.111498 32144 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:20.105152 26754 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:20.107457 32179 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 13:09:20.097607 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.148059 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 657) took 1499 ms. Trace:
I20260709 13:09:20.151194 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.118953 31932 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.075525 31815 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:20.017494 32074 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.289057 31952 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:09:20.294591 31934 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.076407 32052 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:20.234704 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 129767us
I20260709 13:09:20.296154 31934 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.296619 32052 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.191932 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.298434 27319 rpcz_store.cc:276] 0709 13:09:18.648597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.656643 (+  8046us) service_pool.cc:224] Handling call
0709 13:09:18.656948 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.127934 (+1470986us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54001b29a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:09:20.147821 (+ 19887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.148015 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66238208}
I20260709 13:09:20.299937 26611 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:20.300942 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.301196 31932 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:20.152329 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.302275 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.302011 31932 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:20.257870 32095 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.285065 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.276713 26680 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:20.304176 32131 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:20.221500 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.304652 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:20.305254 26603 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.305800 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:20.306404 26680 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:20.156575 31468 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.281098 26682 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:20.192767 32082 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.309438 31468 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.308919 32082 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.309556 26682 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.097616 32040 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.310179 31468 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:20.310542 31468 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:20.311030 26682 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:20.311358 31468 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.295358 26753 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:20.294849 31815 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.192389 26758 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:20.298871 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.266772 26678 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.220028 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.315564 26607 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:20.253191 26686 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:20.298120 32052 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.238598 32084 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:20.299587 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.316185 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:20.322196 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:20.326206 26605 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:20.326241 26678 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:20.313755 26682 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:20.328994 32138 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.337006 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.340040 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.316272 32010 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.394631 26609 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:09:20.399537 26609 pending_rounds.cc:85] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 10
I20260709 13:09:20.340912 26603 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:20.399847 26609 pending_rounds.cc:107] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:09:20.400530 26609 raft_consensus.cc:2889] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.308360 32131 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:09:20.218963 32101 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.449707 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 160596us
I20260709 13:09:20.450508 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.453323 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.454288 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.258180 32102 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:20.423699 26607 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:20.456446 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.457195 26607 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:20.458490 26607 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:09:20.458776 26607 pending_rounds.cc:85] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 7
I20260709 13:09:20.458811 31752 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:20.427981 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.351284 26605 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:09:20.428709 32178 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:09:20.357926 32067 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:20.356892 31877 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:09:20.329874 31731 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:09:20.352113 31815 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.341547 31548 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.421401 32010 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:20.432699 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.434638 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 749) took 1576 ms. Trace:
I20260709 13:09:20.402252 32061 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:20.424808 32162 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:09:20.436533 26759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 603) took 1597 ms (client timeout 1790 ms). Trace:
I20260709 13:09:20.436723 32156 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.445144 26603 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:20.446341 31901 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.002s
I20260709 13:09:20.309702 32130 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:09:20.422770 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:20.459040 26607 pending_rounds.cc:107] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:09:20.498325 26607 raft_consensus.cc:2889] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.428546 32082 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:20.461635 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 162842us
I20260709 13:09:20.503997 32130 consensus_queue.cc:1243] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:20.462368 32102 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.509737 32102 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:20.491739 31548 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.463050 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.462179 32067 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:20.329543 32037 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:09:20.478916 26605 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:20.460245 32148 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:20.462978 32104 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
W20260709 13:09:20.487190 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.487025 27316 rpcz_store.cc:276] 0709 13:09:18.858060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.858180 (+   120us) service_pool.cc:224] Handling call
0709 13:09:18.858489 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.973734 (+115245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.434365 (+1460631us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54004b78d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:20.434570 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262224128}
I20260709 13:09:20.461380 31919 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:20.426837 32138 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:20.496012 26759 rpcz_store.cc:269] 0709 13:09:18.839073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.839246 (+   173us) service_pool.cc:224] Handling call
0709 13:09:20.436315 (+1597069us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:20.436454 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312067456}
I20260709 13:09:20.501072 32166 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:20.501422 26607 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:20.502216 32162 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:20.535419 26605 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:20.501982 32107 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:20.480203 31934 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.431506 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2075) took 1015 ms. Trace:
I20260709 13:09:20.503443 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:20.522953 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59994.7us
I20260709 13:09:20.553349 26755 rpcz_store.cc:276] 0709 13:09:19.416404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.430117 (+ 13713us) service_pool.cc:224] Handling call
0709 13:09:19.430425 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.570013 (+139588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.431254 (+861241us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400081954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:20.431443 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309410560}
W20260709 13:09:20.554244 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50910.8us
I20260709 13:09:20.524013 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:20.554910 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:20.524636 31818 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:09:20.526965 26604 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.448004 32066 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.513504 31901 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.565356 31818 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.577728 31901 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:20.522810 32133 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.003s
I20260709 13:09:20.578687 32133 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.580830 32133 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:20.527254 32067 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:20.554949 32075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.006s
I20260709 13:09:20.528275 32147 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:20.595902 32075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.007s
I20260709 13:09:20.546439 26756 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.531231 31731 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:20.596575 31731 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.555052 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.452312 32101 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.596974 31731 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.598569 32101 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.554915 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:20.599730 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44873.4us
I20260709 13:09:20.568109 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3219) took 2018 ms. Trace:
I20260709 13:09:20.562005 31548 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.600517 26610 rpcz_store.cc:276] 0709 13:09:18.550023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.552408 (+  2385us) service_pool.cc:224] Handling call
0709 13:09:18.552718 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.593376 (+ 40658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.593409 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.628589 (+ 35180us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.769228 (+140639us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:18.820852 (+ 51624us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.821075 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.821149 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.560504 (+1739355us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b1800408b80. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:20.562580 (+  2076us) raft_consensus.cc:1685] finished
0709 13:09:20.567888 (+  5308us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.568031 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40803,"prepare.queue_time_us":51455,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":60658,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":4035,"spinlock_wait_cycles":36635520,"thread_start_us":140221,"threads_started":1,"wal-append.queue_time_us":217959}
I20260709 13:09:20.571053 32066 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:20.529495 26687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2024) took 2038 ms (client timeout 1633 ms). Trace:
W20260709 13:09:20.607028 26687 rpcz_store.cc:269] 0709 13:09:18.490767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.490926 (+   159us) service_pool.cc:224] Handling call
0709 13:09:20.529274 (+2038348us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b54001ea0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:20.529406 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76890368}
I20260709 13:09:20.563591 32082 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.547094 32162 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:20.615027 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.546129 26611 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:20.586381 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:20.615950 26610 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:20.563822 32072 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:20.598618 32146 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:20.577877 31818 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:20.528039 26603 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:20.623795 26603 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:20.620744 32066 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:20.629477 32066 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:20.633991 32149 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.077s	user 0.001s	sys 0.001s
I20260709 13:09:20.636148 32162 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.620296 32147 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.642972 26606 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:20.622087 32041 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:20.643788 32041 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:20.644416 26606 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:20.644320 32138 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.650557 32037 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:20.657892 26606 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:20.660559 32010 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.663074 32010 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.669703 31731 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.671073 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1955) took 1056 ms. Trace:
I20260709 13:09:20.671476 26758 rpcz_store.cc:276] 0709 13:09:19.614313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.616459 (+  2146us) service_pool.cc:224] Handling call
0709 13:09:19.616736 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.320905 (+704169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.670855 (+349950us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000db1d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:20.671016 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323369856}
I20260709 13:09:20.672921 26606 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:20.674271 26606 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:20.613981 26756 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:20.545763 32166 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:20.616792 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.616822 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:20.706295 26610 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:20.701222 26756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 2066) took 2036 ms (client timeout 1981 ms). Trace:
W20260709 13:09:20.708249 26756 rpcz_store.cc:269] 0709 13:09:18.664706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.739065 (+ 74359us) service_pool.cc:224] Handling call
0709 13:09:20.545771 (+1806706us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5800664dd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f329427c 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c
0709 13:09:20.701116 (+155345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404903808}
W20260709 13:09:20.711410 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.664275 32162 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:20.718703 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 101972us
I20260709 13:09:20.719542 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.726693 26610 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
W20260709 13:09:20.729992 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.712967 31531 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:09:20.735200 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 134404us
W20260709 13:09:20.764966 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.732959 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.765964 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:20.717464 31731 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:20.786854 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54029us
I20260709 13:09:20.734270 32101 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.644660 32041 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:20.809617 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 254754us
I20260709 13:09:20.800484 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:20.802384 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:20.814640 26684 raft_consensus.cc:2410] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:20.729924 31957 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.810595 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:20.812320 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 389696us
I20260709 13:09:20.815693 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.813789 26682 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:20.817814 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:20.794902 31934 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:20.826758 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.835963 26610 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
W20260709 13:09:20.830715 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 205284us
I20260709 13:09:20.812763 31818 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.838748 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.843765 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:20.853734 26683 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:20.842114 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:20.854566 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.855738 26605 raft_consensus.cc:2410] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:20.824926 32041 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.857649 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.858623 26605 raft_consensus.cc:2368] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:20.860325 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:20.855640 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.861086 26686 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:20.845553 32160 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.871237 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:20.843170 32052 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:20.839596 31934 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.863179 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.876860 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.853663 32074 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.877341 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.862787 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.878064 26605 raft_consensus.cc:2376] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16. Re-sending same reply.
I20260709 13:09:20.798624 32166 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.881145 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:20.861187 32199 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:20.883093 26753 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:20.842926 31731 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:20.891476 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.883967 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.892709 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:20.893743 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:20.894630 26756 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.885658 26754 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:20.896898 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.898638 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.899621 26686 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:20.900169 26686 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:20.869598 32096 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:20.874804 31642 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:20.903502 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:20.897094 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3208) took 3399 ms. Trace:
I20260709 13:09:20.907449 26608 rpcz_store.cc:276] 0709 13:09:17.498015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.617350 (+119335us) service_pool.cc:224] Handling call
0709 13:09:19.147837 (+1530487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.159378 (+ 11541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.896899 (+1737521us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001f6650. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:20.897034 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3518787968}
I20260709 13:09:20.876926 31934 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.852701 31818 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.869354 32160 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.909260 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.909014 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:20.936221 26760 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:20.938720 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 46105.2us
I20260709 13:09:20.940470 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:20.944923 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:20.945271 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:20.939517 26686 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.891785 32052 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:20.933912 32102 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.963811 26760 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:20.947304 26756 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:20.967087 26686 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.967232 26754 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:20.967212 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:20.973364 26760 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:09:20.974519 27312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 621) took 1573 ms. Trace:
I20260709 13:09:20.965394 32199 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:09:20.971979 31542 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:09:20.976805 32199 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:20.977317 32199 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:20.977669 32203 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:20.978331 32199 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:20.980005 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.944624 32206 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:20.980265 26680 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:20.980919 32199 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.944901 31642 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:20.982018 26680 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:20.982245 31642 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.983294 26680 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:20.943697 32166 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:20.984463 32195 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:09:20.985855 31818 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:20.884696 32074 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.986433 26760 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:20.986724 32197 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:09:20.944900 31752 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:20.909495 31999 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:20.988224 32074 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:20.987944 31999 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:20.990026 31999 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:20.943315 32037 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:09:20.970096 26606 raft_consensus.cc:2376] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15. Re-sending same reply.
I20260709 13:09:20.975076 27312 rpcz_store.cc:276] 0709 13:09:19.401444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.401593 (+   149us) service_pool.cc:224] Handling call
0709 13:09:19.401955 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.419055 (+ 17100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.419086 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.419571 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.663247 (+1243676us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b18003c1a20. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:09:20.823511 (+160264us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:20.823565 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.823636 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.974148 (+150512us) raft_consensus.cc:1685] finished
0709 13:09:20.974172 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.974461 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":532,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3678,"spinlock_wait_cycles":11647360,"thread_start_us":160077,"threads_started":1,"wal-append.queue_time_us":1458350}
I20260709 13:09:20.995945 26755 pending_rounds.cc:85] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 11
I20260709 13:09:20.996359 26755 pending_rounds.cc:107] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:09:20.996670 26755 raft_consensus.cc:2889] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.934808 32096 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.903065 32067 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:20.963903 32088 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:20.975092 32204 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:21.015995 26605 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:20.965209 32205 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:21.048226 26757 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.049399 32052 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:21.053258 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.057565 32160 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.076381 26686 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:21.018143 32088 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.048385 32207 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:20.992162 32102 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.086694 31795 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.029295 32205 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.092787 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:21.062841 32067 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.061362 32147 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:21.092808 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 478041us
I20260709 13:09:21.093199 32096 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.079844 32074 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:21.082526 32160 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:21.111630 32138 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.105072 32088 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:21.124761 27284 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:21.126176 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:21.130488 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182246us
I20260709 13:09:21.131314 26603 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:21.162230 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.163450 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:21.112526 32205 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:21.172186 26682 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.172403 26605 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:21.130016 32148 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.175493 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52614.1us
W20260709 13:09:21.175822 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.163048 32147 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.166831 31818 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.154490 31731 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:09:21.166742 31815 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:21.159014 32138 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.135003 32096 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:21.183132 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.188897 26605 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 9.
I20260709 13:09:21.175613 32133 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:21.178138 32067 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:21.202605 32067 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.181910 32107 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:21.205443 32133 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:21.170317 32101 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:09:21.206533 32133 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.207707 31812 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:21.208190 31812 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:21.209030 31812 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.192543 32102 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.199944 31815 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:21.211194 31815 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:21.212838 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.214289 31934 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.217314 26678 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:21.210359 31812 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.228932 26752 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:21.229810 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.232975 26760 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:21.234129 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.235780 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:21.237612 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.238718 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.238153 26760 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:21.184304 32095 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:21.242728 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:21.271617 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146909us
I20260709 13:09:21.179535 32148 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:21.283919 31818 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:21.241472 32101 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:21.287060 32146 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:21.294273 32146 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.294639 32146 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.297603 32138 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.292112 32009 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:09:21.302086 32205 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.303267 32009 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:21.307893 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.292516 32102 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.324532 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.289872 32101 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.331322 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.303651 32009 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:21.306475 32067 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.312958 32096 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.335546 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.301748 32088 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.330451 32102 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.338187 32096 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:21.338670 32222 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:21.339025 32009 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.340241 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1951) took 1727 ms. Trace:
I20260709 13:09:21.341900 31468 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:21.355695 32009 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.357110 32096 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.330693 31934 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.348875 32148 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.312745 32205 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.355383 26761 rpcz_store.cc:276] 0709 13:09:19.613208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.614009 (+   801us) service_pool.cc:224] Handling call
0709 13:09:21.340022 (+1726013us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540014fad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:21.340179 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294959872}
I20260709 13:09:21.359416 32102 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.333230 32101 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.372059 32148 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.372772 32148 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.363502 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:21.378129 27312 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:09:21.378829 31889 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:21.367789 32088 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.361835 32114 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:21.375438 32148 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.379931 31889 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:21.401957 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.381301 32114 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:21.400780 31934 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.411949 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.416715 26761 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:09:21.418982 31934 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.419790 32138 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:21.424321 32138 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:21.425163 32138 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.432353 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:21.432960 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.432978 26761 raft_consensus.cc:606] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:21.434041 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:21.436093 26607 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:09:21.437520 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:21.438585 26607 raft_consensus.cc:2410] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:21.440461 26605 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:21.448853 26607 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:21.453963 26605 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:21.456460 31889 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.458145 26606 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:21.459159 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:21.459830 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.460176 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.460850 26606 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:21.461409 31468 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:21.461841 26606 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:21.462919 26606 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:21.463514 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.463929 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.463929 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.455349 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.423471 32159 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:21.469295 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 179404us
I20260709 13:09:21.415647 32101 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.471585 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:21.451418 32099 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.471887 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:21.497861 32159 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:21.498637 32166 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:21.500204 32166 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:21.500419 32092 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:21.500886 32092 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:21.501528 32166 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:21.501793 32092 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.503132 32166 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:21.472805 31731 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.502959 32092 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:21.504344 31731 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.473466 32067 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:09:21.473268 32114 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.506834 26612 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:21.492832 26608 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:21.517841 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:21.485937 32132 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:21.514333 26607 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.521337 26608 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:21.482340 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.523108 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.527140 26605 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:21.523288 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:21.528332 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.511117 32224 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:21.532963 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.535099 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.533807 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3294) took 2737 ms. Trace:
I20260709 13:09:21.535820 26679 rpcz_store.cc:276] 0709 13:09:18.793738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.876082 (+ 82344us) service_pool.cc:224] Handling call
0709 13:09:20.529996 (+1653914us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:20.530492 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.530540 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:20.535209 (+  4669us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.792173 (+256964us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.792214 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.792280 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.986388 (+194108us) raft_consensus.cc:1685] finished
0709 13:09:20.986408 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.521999 (+535591us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001ea0d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:21.530734 (+  8735us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2236,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12948,"spinlock_wait_cycles":3802590464,"thread_start_us":232099,"threads_started":1,"wal-append.queue_time_us":298618}
I20260709 13:09:21.531139 32040 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:21.526342 32041 consensus_meta.cc:287] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 13:09:21.535511 26754 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11. Re-sending same reply.
I20260709 13:09:21.518409 31531 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:21.576022 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2099) took 1473 ms. Trace:
I20260709 13:09:21.576404 26611 rpcz_store.cc:276] 0709 13:09:20.102671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.300712 (+198041us) service_pool.cc:224] Handling call
0709 13:09:21.575836 (+1275124us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003796d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:21.575961 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562526080}
I20260709 13:09:21.515415 32201 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:21.533573 32162 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:21.581290 32162 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:21.582249 32162 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.513504 32099 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.525974 32132 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:21.532002 32102 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:21.589686 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.590466 26754 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:21.592132 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.592734 26611 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:21.593878 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:21.540928 32040 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:21.605463 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.589807 32102 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:21.612495 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2095) took 1622 ms. Trace:
I20260709 13:09:21.612699 32102 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.613059 26603 rpcz_store.cc:276] 0709 13:09:19.989772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.624771 (+634999us) service_pool.cc:224] Handling call
0709 13:09:20.625075 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.162244 (+537169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.612171 (+449927us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540003ded4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:21.612408 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163635456}
W20260709 13:09:21.609066 26752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 1966) took 1943 ms (client timeout 1663 ms). Trace:
W20260709 13:09:21.616003 26752 rpcz_store.cc:269] 0709 13:09:19.665405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.692917 (+ 27512us) service_pool.cc:224] Handling call
0709 13:09:21.608816 (+1915899us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400082354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:21.608970 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3452051200}
I20260709 13:09:21.616446 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.617298 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.537660 32089 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:21.617856 26752 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:21.619890 32099 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.621198 31731 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.622926 31548 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:21.532403 32146 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.611111 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:21.625371 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.627439 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.628140 32084 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:21.634203 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.634995 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.635483 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.635888 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 209369us
I20260709 13:09:21.636089 32041 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.636598 32041 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.636896 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.637632 26610 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:21.637844 26651 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:21.631590 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.632989 32052 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:21.633870 32145 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 2.108s	user 0.001s	sys 0.003s
I20260709 13:09:21.643163 32205 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:21.643818 32146 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.623904 32159 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:21.644097 32205 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.644646 32159 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.645116 32159 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:21.645246 32228 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 13:09:21.646349 32205 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.634948 32084 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:21.647397 32084 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.647784 26760 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:21.649014 32101 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.649358 32084 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.650576 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:21.650844 26759 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:21.651309 32066 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:21.651990 26759 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:21.652297 32088 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:21.652688 32088 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.653008 32088 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.653126 26759 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.654268 26759 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:21.655367 26759 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:21.655862 32215 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:21.656234 32215 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:21.639614 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:21.672061 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.680898 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:21.681569 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:21.681728 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:21.681988 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:21.541141 32224 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.642199 32041 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.680802 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:21.679440 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.689009 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.688001 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:21.685709 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:21.692466 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:21.590198 32132 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.681584 26678 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
W20260709 13:09:21.696462 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.696870 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.657018 32215 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:21.693975 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.694068 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.698319 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:21.706254 26680 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:21.673616 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:21.688380 32066 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:21.702335 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:21.690946 32089 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:21.715282 26759 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:09:21.700052 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 531422us
I20260709 13:09:21.697628 31468 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:21.727461 26754 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:21.718281 31919 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.719966 32146 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:21.722666 31877 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:21.722563 32089 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.745359 32089 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:21.743423 31877 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:21.748791 31877 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.748967 32102 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.712703 32193 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:21.750469 31934 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.750876 32042 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:21.750504 32193 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:21.755964 32193 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:21.751160 32102 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:21.756497 26611 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:21.728752 31812 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.710474 32050 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:21.717649 32041 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:21.759570 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:21.760764 32042 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:09:21.769605 32193 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.776682 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:21.777832 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:21.784480 26759 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:21.855180 32166 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.736583 31642 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:21.862834 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:09:21.920737 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 144134us
I20260709 13:09:21.921685 26650 leader_election.cc:400] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:21.921986 26650 leader_election.cc:403] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.923589 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:21.929252 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 142938us
I20260709 13:09:21.851699 32241 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.862419 32082 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.776262 32199 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:09:21.918781 32129 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:21.917805 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 189586us
I20260709 13:09:21.930383 32232 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.867869 32166 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.944464 32129 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.983816 32224 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.933779 32066 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:21.985155 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:21.985448 32251 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:21.981671 32041 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:21.986044 32251 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:21.985209 32237 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:21.979557 32042 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.946992 32241 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:21.992009 32241 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.992547 32159 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:21.994133 32241 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:21.995136 32159 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:21.995816 26755 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:21.982517 32082 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.006896 32129 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.033365 31642 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.995448 32088 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.054095 32089 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.037230 32042 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:21.987926 32250 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:09:21.982064 32232 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.049876 32082 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.077490 32082 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:22.081758 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 158235us
I20260709 13:09:22.086011 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:22.086936 32252 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:22.087622 32252 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.088112 32252 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.058408 31642 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.094127 32082 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.098278 32082 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.099388 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.100464 32082 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.100893 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.102224 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.102632 32088 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.103245 32249 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.103428 32251 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.104218 32089 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.103899 32249 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.106104 32232 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.106532 32249 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.107385 32166 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.109100 32052 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.109723 32052 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.116509 26754 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:22.066568 32042 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.118566 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.121699 32052 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.121863 32249 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.122294 32052 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.122354 32249 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.114969 32088 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.129014 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3319) took 1290 ms. Trace:
W20260709 13:09:22.129987 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.134656 26682 rpcz_store.cc:276] 0709 13:09:20.838392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.844774 (+  6382us) service_pool.cc:224] Handling call
0709 13:09:20.865449 (+ 20675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.172627 (+307178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.128747 (+956120us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400305cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:22.128948 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704989440}
I20260709 13:09:22.130686 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.137566 26753 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.122841 32052 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.138935 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.140656 32254 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:22.142103 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.161146 26680 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.143523 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.145779 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.162194 26678 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:22.146775 26681 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:22.133006 32041 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:22.147182 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:22.150225 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.150646 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.151767 31642 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.117683 32082 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:09:22.158093 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.158596 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:22.160353 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.166318 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.168182 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.168802 27315 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:22.163843 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.170416 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.170923 27315 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:22.172523 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.173105 26679 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.175647 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.176452 27315 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:22.166909 26681 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:22.115267 32132 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.195652 26753 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:22.197085 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.197309 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.197763 27314 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:22.199708 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:22.211251 26680 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:22.185076 32250 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.184988 31747 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.192984 32061 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:22.157393 32088 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.239117 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.240991 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.212858 32093 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:22.213372 31642 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:22.248395 26679 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:22.299188 27319 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:22.309396 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.292555 32250 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.351325 32250 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.353957 32249 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.354038 32250 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.351347 32146 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:22.356222 32146 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.292344 31642 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:22.362344 31642 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.363615 31642 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.370844 32040 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:22.371857 32258 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:22.372205 32040 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.373174 32132 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.308458 32093 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:22.374848 32093 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.380582 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.383352 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.384090 26756 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:22.384819 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.385510 32199 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.385946 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.386554 26761 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:22.324309 32042 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.333673 32215 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:22.335839 32254 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:22.387902 32254 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.389943 32254 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.392940 32193 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:22.341439 32223 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.049s	user 0.006s	sys 0.012s
I20260709 13:09:22.396826 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3308) took 2120 ms. Trace:
W20260709 13:09:22.397689 32240 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.696s	user 0.004s	sys 0.000s
I20260709 13:09:22.397185 26685 rpcz_store.cc:276] 0709 13:09:20.276761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.276879 (+   118us) service_pool.cc:224] Handling call
0709 13:09:20.277196 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.117689 (+840493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.117731 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.118251 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.176299 (+ 58048us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:21.176338 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.127756 (+951418us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54003052d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:22.127818 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.340841 (+213023us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:22.396628 (+ 55787us) raft_consensus.cc:1685] finished
0709 13:09:22.396649 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.396770 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5745,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6683,"spinlock_wait_cycles":1944793216,"thread_start_us":57668,"threads_started":1,"wal-append.queue_time_us":119038}
I20260709 13:09:22.342303 32088 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.348147 32052 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:22.349412 26683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 621) took 2705 ms (client timeout 3211 ms). Trace:
I20260709 13:09:22.350415 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3242) took 2472 ms. Trace:
I20260709 13:09:22.402050 32101 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.386118 32199 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.402796 32101 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.404505 32199 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.409559 31812 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.410073 31812 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.412950 32244 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.413817 32147 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.413511 32244 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.414304 32147 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:22.318961 32257 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:09:22.402117 26683 rpcz_store.cc:269] 0709 13:09:19.643656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.643863 (+   207us) service_pool.cc:224] Handling call
0709 13:09:22.349254 (+2705391us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400312ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:22.349356 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729574656}
I20260709 13:09:22.402293 26609 rpcz_store.cc:276] 0709 13:09:19.877960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.509254 (+631294us) service_pool.cc:224] Handling call
0709 13:09:20.509606 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.581934 (+ 72328us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:20.582318 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.834553 (+252235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.834607 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:20.834648 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.757744 (+923096us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b18004abb40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419
0709 13:09:22.350209 (+592465us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540017b454. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:22.350255 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.350365 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":507,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":127,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14073,"spinlock_wait_cycles":176476672,"thread_start_us":251859,"threads_started":1,"wal-append.queue_time_us":359085,"wal-append.run_cpu_time_us":1441,"wal-append.run_wall_time_us":1105367}
I20260709 13:09:22.420928 26678 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:22.429513 26679 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:09:22.430588 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.431367 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:22.431560 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 475031us
I20260709 13:09:22.440378 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.438936 32061 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.437886 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:22.436038 26685 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:22.447229 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.241981 31747 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.451854 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.453114 26685 raft_consensus.cc:2368] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:22.454344 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.431401 31815 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.468523 26685 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:22.459869 26682 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:22.454984 27319 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:22.476189 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.510957 32273 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.512269 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.512107 32274 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.512681 32273 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.513231 26609 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:22.513727 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.515794 32273 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.515950 26608 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:22.515138 26607 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:22.516610 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:22.517165 26606 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.518414 31999 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:22.519131 26607 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:22.519485 31999 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:22.519855 31999 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:22.521193 32269 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:22.520818 31999 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.513051 32274 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.522076 31999 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.523738 32274 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.528739 32132 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:22.530675 32132 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:22.531090 32269 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.531888 32273 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.533370 32269 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.534951 26608 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:22.537513 32273 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.537830 26608 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:22.538820 26606 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:22.540731 26608 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:22.542157 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:22.543025 32132 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:22.543707 32132 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:22.543936 26608 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:09:22.544490 26608 pending_rounds.cc:85] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 8
I20260709 13:09:22.544840 26608 pending_rounds.cc:107] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:09:22.544742 32132 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.545323 26608 raft_consensus.cc:2889] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.550721 32096 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.551872 32112 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.552381 32112 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.553548 32116 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.554175 32116 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.551268 32096 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.555838 31531 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.556485 31531 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.557425 32096 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.558496 32112 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.560560 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:22.561439 32116 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.562459 31531 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.563982 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:22.575646 26609 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:22.565770 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.454726 32245 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.571378 26606 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.579375 26608 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:22.582253 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.584266 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.591545 26604 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:22.586894 31812 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.586899 31747 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.474390 31815 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.594076 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.596084 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.597057 26680 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:09:22.446800 32146 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.603991 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.605696 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.606429 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:22.606491 26604 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:22.608521 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:22.609619 31747 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:22.611863 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.626547 27319 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:22.628707 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 1976) took 1742 ms. Trace:
I20260709 13:09:22.631335 26757 rpcz_store.cc:276] 0709 13:09:20.886568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.886776 (+   208us) service_pool.cc:224] Handling call
0709 13:09:20.887130 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.058278 (+171148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.628456 (+1570178us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002ea4d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:22.628649 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325991680}
I20260709 13:09:22.626423 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:22.632915 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.611222 32244 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.450418 32061 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.645175 26612 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:22.646724 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.649004 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.633240 26604 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:22.650959 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:22.628602 32248 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:22.620038 32232 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:22.668514 26754 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:22.657349 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.611508 32199 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.693056 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.599460 32010 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:09:22.697908 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 260078us
W20260709 13:09:22.663656 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 463050us
I20260709 13:09:22.620929 32042 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:22.702955 27313 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:22.703078 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.708515 26681 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:09:22.711158 26683 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:22.690901 32215 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:22.712119 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.714785 26681 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.604101 32245 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.653401 32112 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:09:22.712127 32129 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.003s
W20260709 13:09:22.721938 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.735925 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3270) took 1115 ms. Trace:
I20260709 13:09:22.714449 32215 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.736322 26610 rpcz_store.cc:276] 0709 13:09:21.620124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.674512 (+ 54388us) service_pool.cc:224] Handling call
0709 13:09:21.674957 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:21.694263 (+ 19306us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:21.733731 (+ 39468us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.450848 (+717117us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:22.460642 (+  9794us) log.cc:844] Serialized 52 byte log entry
0709 13:09:22.460827 (+   185us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:22.460877 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.460943 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.735721 (+274778us) raft_consensus.cc:1685] finished
0709 13:09:22.735739 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.735871 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519814,"prepare.queue_time_us":52624,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":573626,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4813,"thread_start_us":179324,"threads_started":1,"wal-append.queue_time_us":317591}
W20260709 13:09:22.717213 32252 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 13:09:22.739735 31815 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.739854 32129 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.697952 32199 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.741973 32129 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:22.742800 27316 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:22.745299 32061 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.745944 32114 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.731987 32101 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.748793 32245 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.749621 32146 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.737016 32215 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.739355 32252 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.758445 27320 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:22.759730 26685 raft_consensus.cc:2368] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:22.760311 32194 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:22.722692 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.762638 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.763335 26686 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:22.764247 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.713551 31799 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:22.724690 32260 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:09:22.717855 32148 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.766937 32148 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.768954 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2053) took 1087 ms. Trace:
I20260709 13:09:22.769112 32148 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.769384 26684 rpcz_store.cc:276] 0709 13:09:21.681403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.681508 (+   105us) service_pool.cc:224] Handling call
0709 13:09:22.768757 (+1087249us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:22.768896 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226835328}
I20260709 13:09:22.730618 32147 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:22.710824 32042 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.770625 32042 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.771979 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:22.772554 26605 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.699946 32232 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:22.731986 32112 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:22.774384 32112 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:22.774719 32232 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.775439 31889 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.775266 32112 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.742079 32199 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:22.762939 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.776532 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:22.777632 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.776542 32112 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.779824 32061 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.779747 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:22.780745 26754 raft_consensus.cc:606] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:22.780367 32061 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:22.782655 32061 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.783713 32252 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:22.784011 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.786375 32249 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.787021 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.787765 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.788897 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.790218 26604 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:22.790731 26755 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.790606 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.790619 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.791882 26752 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.792951 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.793848 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.794621 26761 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:09:22.794543 26605 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:22.794543 26681 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:22.795595 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.762712 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.796329 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.796800 26683 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:22.796918 26681 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:22.662143 26609 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:22.797717 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.798396 26681 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
W20260709 13:09:22.801935 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 161423us
W20260709 13:09:22.802776 26504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 116) took 27945 ms (client timeout 15000 ms). Trace:
I20260709 13:09:22.780501 31934 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:22.803257 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:22.803280 26504 rpcz_store.cc:269] 0709 13:08:54.857088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.915761 (+ 58673us) service_pool.cc:224] Handling call
0709 13:08:56.356789 (+1441028us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:22.802680 (+26445891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:16.064393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:16.083434 (+ 19041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:16.083485 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:09:16.083504 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:16.084987 (+  1483us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:16.085088 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:16.085121 (+    33us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:09:16.086658 (+  1537us) tablet.cc:701] Row locks acquired
0709 13:09:16.086721 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:09:16.086929 (+   208us) write_op.cc:270] Start()
0709 13:09:16.087088 (+   159us) write_op.cc:276] Timestamp: P: 1783602556086855 usec, L: 0
0709 13:09:16.087123 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:09:16.091649 (+  4526us) log.cc:844] Serialized 5750 byte log entry
0709 13:09:16.681190 (+589541us) op_driver.cc:464] REPLICATION: finished
0709 13:09:17.117839 (+436649us) write_op.cc:301] APPLY: starting
0709 13:09:17.139645 (+ 21806us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:17.453366 (+313721us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:17.453479 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:17.927520 (+474041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:18.032805 (+105285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:09:18.040486 (+  7681us) write_op.cc:312] APPLY: finished
0709 13:09:18.359029 (+318543us) log.cc:844] Serialized 129 byte log entry
0709 13:09:18.564164 (+205135us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.597876 (+ 33712us) write_op.cc:454] Released schema lock
0709 13:09:18.603755 (+  5879us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:18.604223 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.604262 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4639753,"reported_tablets":24,"spinlock_wait_cycles":771845376,"child_traces":[["op",{"apply.queue_time_us":357947,"apply.run_cpu_time_us":47992,"apply.run_wall_time_us":1516177,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62619,"num_ops":14,"prepare.queue_time_us":86099,"prepare.run_cpu_time_us":17102,"prepare.run_wall_time_us":145897,"raft.queue_time_us":327586,"raft.run_cpu_time_us":49665,"raft.run_wall_time_us":381823,"replication_time_us":474716,"thread_start_us":722819,"threads_started":5,"wal-append.queue_time_us":452142,"wal-append.run_cpu_time_us":43324,"wal-append.run_wall_time_us":2292001}]]}
I20260709 13:09:22.809150 32148 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:22.809621 32148 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:22.810456 32148 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.765309 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.813429 26686 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:22.814407 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.816552 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.789460 26760 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:22.771358 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.828276 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.828692 26684 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:22.828996 26760 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:22.818864 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.741878 32138 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.819633 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.829968 26606 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:22.824674 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.831120 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:22.719344 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.825326 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.826287 26759 raft_consensus.cc:2393] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:22.799350 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:22.832654 26681 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:22.835306 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.824083 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.837769 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:22.835575 26678 raft_consensus.cc:2410] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:22.831923 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:22.841735 26761 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.835129 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:22.845619 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 126347us
I20260709 13:09:22.824234 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:22.845592 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:22.826277 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.875727 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.876998 32144 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.877697 32010 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:22.877763 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.878523 26759 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:22.874568 32129 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:09:22.879873 32146 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.881409 32010 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:22.884717 26759 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:09:22.885210 26759 pending_rounds.cc:85] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 8
I20260709 13:09:22.885507 26759 pending_rounds.cc:107] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:09:22.885802 26759 raft_consensus.cc:2889] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.888873 27319 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.855490 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.824534 31929 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:22.811604 32148 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.882406 32010 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:22.893672 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.893611 31929 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:22.887946 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 71130.7us
I20260709 13:09:22.902345 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:22.903189 26686 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:22.905735 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 102785us
I20260709 13:09:22.875061 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:22.909634 26758 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:22.909420 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 83220.8us
I20260709 13:09:22.910674 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.850869 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:22.907718 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72671.9us
I20260709 13:09:22.916186 26686 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:22.835966 32147 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.922086 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:22.922860 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.915307 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:22.912730 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:22.874806 32101 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.939189 26685 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:09:22.948992 31542 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.826439 32249 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:22.910764 32075 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.054s	sys 0.083s
I20260709 13:09:22.948585 26685 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:22.951721 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:22.951993 26685 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:09:22.952414 26685 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.863514 31934 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.957288 26759 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:22.961696 26759 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:22.962822 26752 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:22.967057 26755 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:22.967473 31542 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:22.969118 26684 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:22.977705 26684 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.974587 26685 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:22.935683 32088 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:22.959961 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:22.973850 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:22.927053 31642 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:22.960371 32075 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.055s	sys 0.084s
I20260709 13:09:22.983930 26686 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:22.984735 26686 pending_rounds.cc:85] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:22.982831 26761 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:22.982085 26682 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:22.982271 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:22.970398 32061 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.985343 26686 pending_rounds.cc:107] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:22.944715 32272 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:23.018781 26686 raft_consensus.cc:2889] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:23.022156 26684 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:23.013993 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.017547 32193 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.009s
I20260709 13:09:22.985642 31542 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:23.036453 32215 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.036571 31542 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:22.985275 31934 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.035753 26681 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:09:23.039721 26651 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:22.980846 32146 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.042419 26681 pending_rounds.cc:85] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
I20260709 13:09:23.042727 26681 pending_rounds.cc:107] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:23.042968 26681 raft_consensus.cc:2889] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:23.043033 26683 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:22.985596 32102 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:22.956894 32101 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.046713 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:23.055873 27286 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:23.028885 32272 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.030620 31468 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:23.093777 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 187816us
I20260709 13:09:23.091888 32193 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:23.049289 32205 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:23.069280 32102 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:23.113324 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 204333us
I20260709 13:09:23.058622 32146 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.068756 32093 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.064945 31642 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:23.111658 32277 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:09:23.070591 32272 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:23.183449 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:23.190176 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:23.191090 27318 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:23.141954 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:23.092897 31468 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:23.158881 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.160406 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.160410 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:23.161429 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.162235 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:23.097499 31929 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:23.167635 26606 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:23.080749 32037 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:09:23.118239 32194 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.195150 27319 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:23.199225 26612 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:23.171325 32093 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.196787 32215 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:23.248046 32102 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.238232 32194 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.253713 32146 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.218010 32040 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:23.257959 31468 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.241787 32093 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.186256 31642 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.276031 26753 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:23.163897 32193 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.322316 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:23.233343 32282 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
W20260709 13:09:23.359773 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 217931us
I20260709 13:09:23.362419 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:23.289077 32281 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:09:23.393177 26726 leader_election.cc:400] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:23.393776 26726 leader_election.cc:403] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:23.357908 32279 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:09:23.218477 32294 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:23.289834 32042 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.436862 26683 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:23.425578 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.325050 31642 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.427202 32095 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16.
I20260709 13:09:23.433209 32193 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.435470 32194 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:23.437819 32042 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:23.440474 32280 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:09:23.443228 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:23.444161 31934 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.374213 31889 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:23.445297 32159 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:23.408324 32047 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:23.446205 32283 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:09:23.416898 32292 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:23.325378 31929 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.448469 26683 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:23.425793 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 670) took 1183 ms. Trace:
I20260709 13:09:23.568655 27314 rpcz_store.cc:276] 0709 13:09:22.242528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.242655 (+   127us) service_pool.cc:224] Handling call
0709 13:09:22.299547 (+ 56892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.462591 (+163044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.462622 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.463052 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.713094 (+250042us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:22.713136 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.713199 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.425496 (+712297us) raft_consensus.cc:1685] finished
0709 13:09:23.425526 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.425719 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28231,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":412385,"threads_started":2,"wal-append.queue_time_us":495713}
W20260709 13:09:23.465763 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.561590 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 118438us
I20260709 13:09:23.571993 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:23.555748 32296 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:09:23.582451 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:23.587236 26726 leader_election.cc:400] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:23.587976 26726 leader_election.cc:403] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:23.573938 26683 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:23.566329 32281 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:23.589962 26683 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.553967 32144 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:23.562726 31815 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.565212 32040 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.562548 32146 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.562199 32244 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.608551 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:23.581717 31934 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.564968 32245 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:23.565122 31889 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:23.586930 31747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.041s
I20260709 13:09:23.555438 32290 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:09:23.581000 32292 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:23.450078 32294 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.627565 26683 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:23.613297 32047 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15.
I20260709 13:09:23.612144 32096 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:23.608738 32138 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.002s
I20260709 13:09:23.586232 31929 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:23.641907 31747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.015s	sys 0.041s
I20260709 13:09:23.679405 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3341) took 1022 ms. Trace:
I20260709 13:09:23.681543 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 669) took 1464 ms. Trace:
I20260709 13:09:23.701273 27315 rpcz_store.cc:276] 0709 13:09:22.217524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.217687 (+   163us) service_pool.cc:224] Handling call
0709 13:09:22.218139 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.486707 (+268568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.486749 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.569376 (+ 82627us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.845129 (+275753us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:22.845659 (+   530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.846602 (+   943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.681274 (+834672us) raft_consensus.cc:1685] finished
0709 13:09:23.681301 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.681472 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89894,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5607,"thread_start_us":467530,"threads_started":2,"wal-append.queue_time_us":511809}
I20260709 13:09:23.592283 32282 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:09:23.700474 26678 rpcz_store.cc:276] 0709 13:09:22.656933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.657130 (+   197us) service_pool.cc:224] Handling call
0709 13:09:23.679134 (+1022004us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400125cd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:23.679321 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381565440}
W20260709 13:09:23.623553 32254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.001s	sys 0.020s
W20260709 13:09:23.659904 32021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.022s	sys 0.090s
I20260709 13:09:23.698905 27316 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:23.613004 32144 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:23.615036 31815 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.682569 32096 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.633332 32146 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.664073 32292 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:23.633208 32244 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.637485 32245 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:23.708153 32021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.022s	sys 0.091s
I20260709 13:09:23.635082 31934 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:23.710407 32254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.002s	sys 0.020s
I20260709 13:09:23.708698 32159 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:23.733965 27318 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
I20260709 13:09:23.737232 27318 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:23.716136 26687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.017s	sys 0.018s
W20260709 13:09:23.738742 26687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.017s	sys 0.018s
I20260709 13:09:23.739604 31934 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.741214 32041 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:23.739737 32298 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:09:23.742012 32047 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.709851 32130 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.742089 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3343) took 1043 ms. Trace:
I20260709 13:09:23.746516 26687 rpcz_store.cc:276] 0709 13:09:22.698935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.699552 (+   617us) service_pool.cc:224] Handling call
0709 13:09:22.712959 (+ 13407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.713182 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:22.788909 (+ 75727us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.740337 (+951428us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.740863 (+   526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.740913 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.740980 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.741910 (+   930us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.742037 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75732,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":171,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":145920,"thread_start_us":949980,"threads_started":1}
I20260709 13:09:23.742658 32047 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.720736 32096 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.709093 32040 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:09:23.720283 32075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.023s
I20260709 13:09:23.754259 32159 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:23.716310 31889 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:23.780997 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 488776us
W20260709 13:09:23.761053 32075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.011s	sys 0.023s
I20260709 13:09:23.790237 26611 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:23.752885 32130 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:23.794983 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.013s
W20260709 13:09:23.801138 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.014s
W20260709 13:09:23.806079 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.016s	sys 0.013s
W20260709 13:09:23.806493 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.016s	sys 0.013s
W20260709 13:09:23.806910 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.807636 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.837669 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.838454 26611 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:09:23.836783 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.802943 32290 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.841156 26611 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:23.860575 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:23.857124 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.861198 26611 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:23.842442 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:23.843327 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.843477 26603 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:09:23.862151 26605 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:23.863879 32302 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:23.862179 26612 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:23.844283 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.866612 26610 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 9.
I20260709 13:09:23.858321 26604 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:23.809258 31889 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.845718 26609 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:23.875509 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:23.876204 26753 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
W20260709 13:09:23.877452 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 268995us
I20260709 13:09:23.878132 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:23.859205 32299 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:09:23.881368 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:23.882167 26608 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.879416 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.883018 26606 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
W20260709 13:09:23.886909 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.892397 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:23.893682 26758 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:23.896739 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.897689 26606 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:23.860154 32294 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:23.883962 32147 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:23.873178 31934 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.907795 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.914865 26606 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:09:23.912919 26611 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:23.917708 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.918529 26606 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:23.923085 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.924079 26611 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:23.924978 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.925997 26611 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:23.929013 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50541.5us
I20260709 13:09:23.934087 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.865384 32290 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:23.974684 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:23.909391 31815 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.913616 32147 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.908838 32144 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:23.880980 32282 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:09:23.880646 32289 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:09:23.922684 32084 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.002949 32084 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.005005 26608 raft_consensus.cc:2410] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:24.005231 32084 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.006006 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:24.010025 26608 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.927153 32245 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.989147 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:23.975792 32146 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:24.008109 32301 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:09:24.025934 32305 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:09:24.029141 31877 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.045714 26577 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:24.029531 32144 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.922923 32294 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 13:09:24.034025 32307 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:09:24.038367 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:23.981029 32315 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:09:24.042829 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:23.999094 32147 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:23.980721 32318 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:23.923144 31934 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:24.046684 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 116753us
I20260709 13:09:23.996296 32075 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:09:24.041752 32084 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.006958 32047 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.050400 32146 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:24.054347 32042 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.044212 31815 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:24.077796 31815 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.062318 32095 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.080014 31815 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.054606 31752 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.056623 31542 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.080698 31752 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.081327 31934 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.057741 32215 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:24.059056 32308 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:09:24.082703 31752 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.058784 32194 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:24.059832 32303 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:09:24.063258 26757 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:24.085680 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 645) took 1269 ms. Trace:
I20260709 13:09:24.086066 26684 rpcz_store.cc:276] 0709 13:09:22.816135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.023123 (+206988us) service_pool.cc:224] Handling call
0709 13:09:23.023520 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.061973 (+ 38453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.062000 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.062584 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.581051 (+518467us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:23.593858 (+ 12807us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.594056 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.594136 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.085477 (+491341us) raft_consensus.cc:1685] finished
0709 13:09:24.085498 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.085620 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28810,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":55,"raft.queue_time_us":91,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8111,"thread_start_us":468928,"threads_started":1,"wal-append.queue_time_us":668964}
I20260709 13:09:24.024842 32244 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:23.886189 32159 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.088074 32088 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:24.042374 32245 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.091001 32245 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.091995 31929 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.093041 32245 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.095270 32130 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.096271 32146 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:24.098812 32291 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.464s	user 0.000s	sys 0.003s
I20260709 13:09:24.099038 32146 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.044451 32250 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.101186 32250 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:24.101970 32286 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.742s	user 0.013s	sys 0.014s
I20260709 13:09:24.103291 32250 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.058058 32320 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:24.104029 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3337) took 1499 ms. Trace:
I20260709 13:09:24.104413 26680 rpcz_store.cc:276] 0709 13:09:22.604868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.607862 (+  2994us) service_pool.cc:224] Handling call
0709 13:09:22.608240 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.608684 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.608724 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.609258 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.047427 (+438169us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.047502 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.047590 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.101384 (+1053794us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:24.103740 (+  2356us) raft_consensus.cc:1685] finished
0709 13:09:24.103763 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.103976 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10281,"raft.queue_time_us":645,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":10548096,"thread_start_us":351082,"threads_started":1,"wal-append.queue_time_us":568571}
I20260709 13:09:24.068920 32318 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.107434 32318 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.106882 32042 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.109578 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.110385 26612 raft_consensus.cc:2410] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:09:24.111171 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.111315 32042 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.113032 32047 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:24.114177 32047 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:24.114885 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.115813 26603 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:24.065903 32144 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.117933 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2068) took 1403 ms. Trace:
I20260709 13:09:24.118431 26681 rpcz_store.cc:276] 0709 13:09:22.714487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.926703 (+212216us) service_pool.cc:224] Handling call
0709 13:09:22.927213 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.043404 (+116191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.117595 (+1074191us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001225d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:24.117861 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248801024}
I20260709 13:09:24.119418 32144 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.113236 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.121227 26609 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:24.122442 26609 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:24.088726 32088 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:24.123816 26609 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:24.125873 26609 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:24.052865 31468 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.129129 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:24.136173 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.137391 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:24.126982 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 642) took 1338 ms. Trace:
I20260709 13:09:24.138286 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.138980 26684 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:24.138402 26685 rpcz_store.cc:276] 0709 13:09:22.788399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.982000 (+193601us) service_pool.cc:224] Handling call
0709 13:09:23.016541 (+ 34541us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:23.035456 (+ 18915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.035496 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:23.036161 (+   665us) log.cc:844] Serialized 78 byte log entry
0709 13:09:23.321653 (+285492us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:23.363918 (+ 42265us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.372547 (+  8629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.372629 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.126708 (+754079us) raft_consensus.cc:1685] finished
0709 13:09:24.126736 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.126915 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10517,"prepare.queue_time_us":102261,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":23674,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":7374,"thread_start_us":284540,"threads_started":1,"wal-append.queue_time_us":556161}
W20260709 13:09:24.140364 32321 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:24.140975 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.143024 32112 raft_consensus.cc:993] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:24.121156 32084 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.133287 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:24.145641 27315 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:24.146183 32084 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:24.134317 31642 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.012s
I20260709 13:09:24.146974 31642 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.148358 32290 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.147011 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.149303 31642 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.072376 32312 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:09:24.154105 32292 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.155915 32115 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:24.156349 32115 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:24.156733 32148 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.263s	user 0.004s	sys 0.009s
I20260709 13:09:24.156601 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:24.157743 26680 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:24.157261 32115 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:24.147250 32093 consensus_meta.cc:287] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.004s
I20260709 13:09:24.160689 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.162006 26684 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:24.162142 26609 pending_rounds.cc:85] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 8
I20260709 13:09:24.162668 26609 pending_rounds.cc:107] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:24.162964 26609 raft_consensus.cc:2889] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.163724 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.165738 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.166556 26680 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:24.161808 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 654) took 1626 ms. Trace:
I20260709 13:09:24.168745 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.169312 26609 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:24.131620 31929 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:24.169648 26685 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:24.169222 26607 rpcz_store.cc:276] 0709 13:09:22.535273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.535393 (+   120us) service_pool.cc:224] Handling call
0709 13:09:22.535741 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.536042 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.536067 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.818043 (+281976us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:22.844634 (+ 26591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.152661 (+308027us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:23.152695 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.152765 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.098112 (+945347us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:24.161607 (+ 63495us) raft_consensus.cc:1685] finished
0709 13:09:24.161628 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.161755 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2087,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":114887296,"thread_start_us":224902,"threads_started":1,"wal-append.queue_time_us":668407}
W20260709 13:09:24.135776 32272 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.000s
I20260709 13:09:24.188386 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.189751 26687 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:24.199918 26608 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:24.160096 32318 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:24.175930 32148 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.169967 32146 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.249056 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.258091 26680 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:24.175438 31929 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:24.257019 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.261716 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:24.160847 31468 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:24.266551 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 206482us
I20260709 13:09:24.311743 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:24.316010 26681 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
W20260709 13:09:24.266659 27316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 762) took 1345 ms (client timeout 1755 ms). Trace:
W20260709 13:09:24.320765 27316 rpcz_store.cc:269] 0709 13:09:22.921101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.921779 (+   678us) service_pool.cc:224] Handling call
0709 13:09:24.266414 (+1344635us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54005a5854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:24.266581 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770534784}
I20260709 13:09:24.211151 32272 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:24.258147 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 92639.8us
I20260709 13:09:24.322595 26606 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17.
I20260709 13:09:24.250576 32318 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:24.261747 32319 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:24.327951 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 452968us
I20260709 13:09:24.261785 32327 raft_consensus.cc:1081] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:24.329416 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:24.176880 32093 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.333675 26612 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
W20260709 13:09:24.356338 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.323110 32254 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.261731 32148 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.360628 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:24.360996 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.366026 26753 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:24.265630 32294 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.333194 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.366566 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.367583 26607 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:24.370332 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.370208 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.371845 26755 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:24.371074 26753 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
W20260709 13:09:24.373287 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 327639us
I20260709 13:09:24.373929 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.374032 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.375250 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:24.336777 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:09:24.334686 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 264607us
I20260709 13:09:24.376796 26575 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.375252 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.377660 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:24.379326 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.380100 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:24.327988 32290 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.382937 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:24.381542 26752 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:24.357055 32292 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.361595 32254 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.384050 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:24.365430 31642 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:24.266983 32146 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.382085 32194 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.382211 32244 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:24.381826 31934 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.362749 32147 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.360500 31929 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.389242 32282 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:24.385720 31815 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:24.391803 32254 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.364295 32088 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.391978 31889 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.396826 31642 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.378275 32294 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.409976 32194 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.391505 32290 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.415246 31934 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.412635 32244 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:24.397218 32315 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:24.420608 32272 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:24.435467 32096 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.002s
I20260709 13:09:24.441075 32194 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:24.454986 32329 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:24.386538 32318 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.446736 32244 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:24.457897 32323 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:09:24.471731 32294 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.480142 32148 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.482342 32290 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.464455 32318 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:24.498360 32254 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.452407 32096 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.430853 31815 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:24.639936 26755 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:24.640172 31815 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:24.642544 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.556123 26611 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:24.558684 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 174566us
W20260709 13:09:24.559187 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.557066 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 177667us
I20260709 13:09:24.444836 31934 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:24.571838 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.577770 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.655714 32250 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:24.659451 32250 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.660283 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.660668 32088 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.661499 26752 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:24.661679 32088 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:24.662393 32250 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.584311 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.585071 26759 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:24.585974 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:24.595999 27285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.609s (SENT) [suppressed 10 similar messages]
I20260709 13:09:24.596930 31548 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:24.620146 31531 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:24.621495 32325 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.622092 31642 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:24.643599 26755 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:24.623028 31752 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.628254 31468 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.437856 31889 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:24.570880 32344 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:24.656147 31999 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:24.663543 26757 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
W20260709 13:09:24.671439 32095 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.002s
I20260709 13:09:24.659430 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:24.663951 32290 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.666601 31548 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.667621 32146 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.668959 32332 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.668740 31531 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.814771 32332 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.671162 32101 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.817832 32332 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.817543 32290 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:24.819303 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.675705 32147 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.835899 31889 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.677237 32093 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.655494 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:24.838027 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 182868us
W20260709 13:09:24.838310 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 455310us
I20260709 13:09:24.677436 26760 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:24.839826 26760 pending_rounds.cc:85] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 10
I20260709 13:09:24.840216 26612 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.840437 32332 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:24.678968 32115 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:24.679765 32331 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.684660 32010 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:24.844368 32250 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:24.635510 32096 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:24.690409 32112 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.662433 32088 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.845239 32250 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.845723 32112 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.847553 32088 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.700938 32249 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.701838 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:24.580470 26756 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:24.813815 31548 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.800962 31752 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.809891 32095 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:24.676676 32254 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.839607 31929 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.848677 31999 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.858186 32325 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:24.849995 31752 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.858755 32325 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:24.860981 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 159565us
W20260709 13:09:24.861280 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.861398 32331 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:24.861776 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.862200 32331 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.865752 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.847637 32250 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.864110 32132 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:24.871171 32132 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.871567 32132 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.872063 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:24.843381 31877 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.006s
I20260709 13:09:24.851253 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.840260 26760 pending_rounds.cc:107] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:24.876390 26760 raft_consensus.cc:2889] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:24.875828 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 280007us
I20260709 13:09:24.853312 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:09:24.806325 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127723us
W20260709 13:09:24.858227 26650 connection.cc:256] RPC call timeout handler was delayed by -1.3853370770000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:09:24.896576 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.908167 26650 connection.cc:256] RPC call timeout handler was delayed by -1.2602370770000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:09:24.908632 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0262462670000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:09:24.908947 26650 connection.cc:256] RPC call timeout handler was delayed by -1.007337077000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 13:09:24.902839 32331 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.922516 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:24.930258 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90808.7us
I20260709 13:09:24.931416 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:24.931752 26754 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
W20260709 13:09:24.931746 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.932641 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.933868 32040 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:24.934325 32040 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:24.934741 32040 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.935171 32101 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:24.935705 32101 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.936106 32101 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:24.937031 31999 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.911435 32344 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:24.937826 32344 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:24.939035 32344 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.940901 32319 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:24.914564 31815 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.944764 31815 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.945712 26758 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:24.946205 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.946791 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.947351 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.948081 26755 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:24.948055 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.913607 32250 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.959560 32250 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.960354 32093 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:24.961230 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2136) took 1097 ms. Trace:
I20260709 13:09:24.961005 32093 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.961799 32250 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.961620 26606 rpcz_store.cc:276] 0709 13:09:23.864157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.925453 (+ 61296us) service_pool.cc:224] Handling call
0709 13:09:24.960831 (+1035378us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:24.961068 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891099904}
I20260709 13:09:24.935915 32332 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:24.963150 32093 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:24.963822 32114 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.963961 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 124437us
I20260709 13:09:24.964663 32290 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:24.967178 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:24.956378 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:24.956542 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.958226 31531 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:24.958560 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.964355 32114 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:24.968186 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.969638 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.955243 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:24.955710 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:24.975230 26760 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.948210 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:24.980274 26612 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:24.970350 31934 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:24.991019 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72705.4us
W20260709 13:09:24.967219 32345 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:09:24.996358 26758 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
W20260709 13:09:25.006162 32244 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.014s
I20260709 13:09:25.006752 32244 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:24.952769 32254 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:25.008279 32254 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:25.012403 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 76858.5us
I20260709 13:09:25.013401 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.014402 32332 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:25.015121 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:25.015636 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48699.2us
I20260709 13:09:24.998807 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.017272 32332 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:25.023466 32041 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:25.044559 32041 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.017589 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.018407 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:24.951810 31642 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.023736 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.024601 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.025312 32093 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:25.025789 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.026336 32112 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.026520 31531 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:25.054323 31531 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:25.055428 31531 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.056582 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.057132 31752 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.031883 26761 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.057953 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.058825 26759 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:25.059235 31752 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.011404 32254 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.036325 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2000) took 2246 ms. Trace:
I20260709 13:09:25.041304 31934 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.001283 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.059597 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.052225 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.053387 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:25.060240 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.000530 26607 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:25.088637 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:25.055174 31889 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:25.090919 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 142386us
I20260709 13:09:25.083443 26754 rpcz_store.cc:276] 0709 13:09:22.789960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.790338 (+   378us) service_pool.cc:224] Handling call
0709 13:09:25.036046 (+2245708us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b540023afd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:25.036229 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4805952768}
W20260709 13:09:25.062319 32194 consensus_meta.cc:287] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.006s
I20260709 13:09:25.091427 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.063855 31642 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.061832 32244 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:25.118257 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64978.7us
I20260709 13:09:25.104933 26759 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.064502 32249 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:25.064152 32021 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:25.125586 31468 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:25.127116 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 112155us
I20260709 13:09:25.128044 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.130285 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.131104 32112 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:25.131585 32112 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.131829 32254 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:25.132162 32112 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.136921 26759 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:25.139918 26755 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:25.144208 32114 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.145502 32112 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.119874 31752 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:25.153203 26758 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:25.153379 31752 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.153644 32101 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.167273 26760 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:25.088677 32325 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.171455 26757 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.177670 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:25.158272 32093 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:25.119865 32146 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:25.200692 32041 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.207619 31752 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.207816 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:25.208446 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.208616 26760 raft_consensus.cc:2376] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13. Re-sending same reply.
I20260709 13:09:25.210966 32112 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.212405 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.215705 32041 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.219795 31934 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:25.220752 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:25.222942 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95040.2us
I20260709 13:09:25.224128 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.226060 32344 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:25.226255 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.227205 32319 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:25.226650 32344 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.228248 32344 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:25.231256 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.232327 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:25.233136 27316 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:25.236199 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.237679 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.239530 31889 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.165227 32254 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:25.193562 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:25.245697 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 228333us
I20260709 13:09:25.183035 32093 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.261569 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.133883 32194 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.155925 32249 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.265154 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:25.270460 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.176282 32040 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.259258 32021 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.266718 32093 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.288265 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:25.246798 32132 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.296568 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.293422 32101 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.306190 27316 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:25.311538 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.297133 32319 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:25.324323 31752 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:25.325227 31752 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:25.326494 31752 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.329877 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.333714 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.334362 26678 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.337530 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:25.338256 27314 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
W20260709 13:09:25.339169 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 88304.7us
I20260709 13:09:25.339954 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.341146 32194 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.341522 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.342778 32254 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.344770 26682 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.346771 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.348511 32249 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.298388 31934 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:25.360018 32061 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.321338 32325 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:25.376187 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 124803us
W20260709 13:09:25.378928 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.385722 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 100709us
W20260709 13:09:25.375082 32159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.017s	sys 0.022s
I20260709 13:09:25.372423 32332 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:25.385543 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.368722 32101 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:25.357067 32021 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.421649 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:25.393875 27321 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:25.394543 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.395344 32312 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:25.396320 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2123) took 1552 ms. Trace:
I20260709 13:09:25.398270 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.432881 26610 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:25.400144 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.401268 31542 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:25.403565 27285 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.404706 31799 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:25.435283 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:25.412068 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.417868 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.418815 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.419952 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:25.425671 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 43799.1us
W20260709 13:09:25.422878 32159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.017s	sys 0.023s
I20260709 13:09:25.368458 32061 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.433072 26608 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.424467 32332 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.425002 32101 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.454052 26678 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:25.455695 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74424.7us
I20260709 13:09:25.457429 27315 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 13:09:25.457729 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54329.3us
I20260709 13:09:25.440124 32325 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:25.472783 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57095.1us
I20260709 13:09:25.472440 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:25.476536 32249 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:25.462677 32332 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.468519 32101 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:25.488868 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.477252 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.488935 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.494292 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:25.505654 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44591.6us
I20260709 13:09:25.432614 26603 rpcz_store.cc:276] 0709 13:09:23.844197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.116676 (+272479us) service_pool.cc:224] Handling call
0709 13:09:24.117075 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.178372 (+ 61297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.178420 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.187046 (+  8626us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.014009 (+826963us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b180009f040. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:09:25.297806 (+283797us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.297863 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.297957 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.395826 (+ 97869us) raft_consensus.cc:1685] finished
0709 13:09:25.395846 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.396132 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58727,"raft.queue_time_us":69489,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7914,"spinlock_wait_cycles":80387456,"thread_start_us":250570,"threads_started":1,"wal-append.queue_time_us":1193563}
I20260709 13:09:25.496826 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:25.520612 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63711.6us
I20260709 13:09:25.492107 32040 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.494059 32249 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:25.534709 26608 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:25.528662 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.537092 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.511085 32132 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.537843 26757 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:25.525609 26610 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.541204 26678 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:25.547560 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.547147 31929 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.523046 31889 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:25.552245 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69885.4us
I20260709 13:09:25.551582 32102 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:25.502059 32344 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.488296 31542 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.557044 26752 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:09:25.555544 31929 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.558584 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:25.559176 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:25.559604 32148 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:25.562466 32095 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:25.567780 32319 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:25.568696 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93858.4us
I20260709 13:09:25.593912 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.528117 31642 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:25.599121 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 108346us
I20260709 13:09:25.602581 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:25.603339 26609 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.603212 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.603739 32130 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:25.604187 26683 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:25.604151 32130 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:25.605273 32130 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:25.588083 32363 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:09:25.610066 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.610567 26687 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.611603 26604 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:09:25.569519 32102 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:25.615149 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.624671 26603 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:25.590816 32148 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.625932 26752 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:25.631984 26576 leader_election.cc:400] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:09:25.634943 26576 leader_election.cc:403] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.558812 26505 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 8 to 10, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 10 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.621176 32102 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:25.627635 32037 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:25.617673 32319 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:25.630458 32148 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:25.621760 31642 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:25.657747 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63821.1us
I20260709 13:09:25.628650 32021 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:25.651444 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 50584.2us
I20260709 13:09:25.650326 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.661155 32319 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.667523 26683 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: [17.10-18.11]
I20260709 13:09:25.616721 32095 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.678761 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.662364 32130 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:25.683629 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 161904us
W20260709 13:09:25.685343 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146086us
I20260709 13:09:25.671550 32138 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:25.689755 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 95897.4us
I20260709 13:09:25.687851 32344 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:25.688010 32369 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260709 13:09:25.670533 32037 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:25.674661 32159 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.693981 31468 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:25.699329 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.706466 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.681394 26678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55252
I20260709 13:09:25.708341 32037 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.712144 32344 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:25.724299 32367 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:09:25.727748 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.731348 31642 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.671875 32244 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:09:25.741317 26505 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 11, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.708920 26678 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.745898 26678 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.747247 26609 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
W20260709 13:09:25.749392 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 49911.7us
I20260709 13:09:25.767490 26757 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:25.680459 32249 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:25.789026 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 115367us
I20260709 13:09:25.792586 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:25.796200 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.797011 26609 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:25.797348 27315 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:09:25.797633 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50062.5us
I20260709 13:09:25.756031 31815 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:09:25.832352 31468 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:25.800118 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:25.744208 32061 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.800555 31531 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.800999 31929 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.805042 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.809392 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:25.811232 32359 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
I20260709 13:09:25.820638 32095 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.748203 31752 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:09:25.743637 26505 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 11, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.832806 31468 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.831214 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:25.834676 26603 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:25.698887 32159 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.859737 26604 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.860520 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:25.858606 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.865290 26687 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:25.866639 26606 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.867158 26603 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.870932 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.872059 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.872609 32148 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.872108 32250 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Committing config change with OpId 10.9: config changed from index 2 to 9, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:25.876454 26679 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:25.877465 26610 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:09:25.795655 32093 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.831032 32332 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.879364 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.883365 32375 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.884088 32375 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.884801 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.887131 32375 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.887952 32194 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:25.888440 32368 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.192s	user 0.001s	sys 0.002s
I20260709 13:09:25.888803 32194 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:25.889436 32372 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:09:25.890620 32194 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:25.891098 32194 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:25.891188 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.891649 32194 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.892015 26607 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.897011 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:25.897799 26607 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
W20260709 13:09:25.898183 32374 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:09:25.892468 31929 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.900463 31929 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:25.902258 32159 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:25.903035 31929 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.908480 32041 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:25.910938 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.912204 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:25.913338 26681 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:25.914340 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:25.916270 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:25.915895 26505 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:25.917212 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.918452 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:25.918321 26505 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:25.874233 31542 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:25.919869 32061 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:25.920128 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.920518 31542 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:25.920797 26686 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.921092 31542 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:25.921373 32148 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.921656 31542 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:25.921759 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.922508 26686 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:25.923327 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:25.924528 27320 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:25.868077 32244 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:25.917043 26679 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:25.927147 26611 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:25.928023 26505 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:25.929567 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.884478 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:25.925287 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:25.869153 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 178562us
I20260709 13:09:25.932611 26678 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.943655 26603 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:25.920379 32061 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:25.946307 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.948606 26681 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:25.960284 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.964044 26604 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:25.975836 26605 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:25.980630 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:25.981729 26759 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:25.861343 32101 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:25.984567 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:25.985483 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 290192us
I20260709 13:09:25.997982 32194 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.000447 26678 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.999385 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:26.009960 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.929731 32102 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.010639 26678 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:26.011543 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.012110 32102 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:25.860500 31531 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.012552 32194 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:26.016409 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:25.971468 32061 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:26.003019 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:26.010053 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:25.986703 31752 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:26.027273 26681 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:26.012130 26678 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:25.971514 32244 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:26.026881 26760 raft_consensus.cc:2410] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:25.947180 32159 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:09:26.029959 26608 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:26.029062 26575 leader_election.cc:400] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13.
I20260709 13:09:26.030439 26686 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:09:26.025055 27315 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:26.026746 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:26.003083 31877 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:26.022631 31934 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.043172 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.044050 26679 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:26.048064 32101 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:26.051280 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.051462 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.030819 31752 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:26.057861 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:26.472038 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.072530 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:26.096275 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 171086us
I20260709 13:09:26.516211 26678 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:26.363523 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.520668 26755 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.147749 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.040454 31877 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.080169 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:26.542037 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 469556us
W20260709 13:09:26.543766 26606 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.004s
I20260709 13:09:26.544413 26606 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:26.536759 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.391826 26756 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:26.540689 26753 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:26.050815 32312 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:26.311769 32385 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:09:26.270769 32389 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:09:26.518023 31752 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:26.589342 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:26.162180 32101 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.426s
I20260709 13:09:26.539985 32148 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:26.592965 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 363685us
I20260709 13:09:26.596180 26678 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:26.601442 26610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.038s
W20260709 13:09:26.601996 26610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.038s
I20260709 13:09:26.550626 31877 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:26.341495 32332 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:26.095146 31934 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.583244 32095 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:26.607846 31468 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.001s
I20260709 13:09:26.092900 32386 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.509s
W20260709 13:09:26.614293 26754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.010s
W20260709 13:09:26.616283 26754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.010s
I20260709 13:09:26.613508 31468 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.612087 26682 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:26.603263 32325 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:26.627310 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.619633 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:26.629380 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 88867.4us
I20260709 13:09:26.607360 32312 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:26.362879 32244 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:26.640609 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.641892 31468 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:26.657296 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:26.658089 26678 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.630425 32325 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.663599 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:26.676937 26609 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:26.663798 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:26.667097 31889 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:26.682720 26682 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:26.656616 32394 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:09:26.685559 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3298) took 1283 ms (client timeout 1708 ms). Trace:
W20260709 13:09:26.684535 26686 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 13:09:26.686424 26686 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:26.686014 26611 rpcz_store.cc:269] 0709 13:09:25.397152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.399791 (+  2639us) service_pool.cc:224] Handling call
0709 13:09:26.679785 (+1279994us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540003e8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:26.679980 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134319488}
I20260709 13:09:26.050715 26505 catalog_manager.cc:5697] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 8, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.614708 32148 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:26.681351 32325 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:26.713243 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:26.707826 26726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.031s	sys 0.048s
W20260709 13:09:26.731109 26726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.031s	sys 0.048s
W20260709 13:09:26.731447 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 633870us
I20260709 13:09:26.679534 31889 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.709797 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:26.680648 32386 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:09:26.725210 32390 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:09:26.710237 32392 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:09:26.753316 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.765503 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.745761 32386 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.748991 31548 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:26.778476 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3362) took 1360 ms. Trace:
W20260709 13:09:26.771114 31542 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.849s	user 0.013s	sys 0.000s
W20260709 13:09:26.775638 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 98693.4us
W20260709 13:09:26.773842 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 158231us
I20260709 13:09:26.784789 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:26.804068 26686 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:26.804600 26686 pending_rounds.cc:85] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:26.804891 26686 pending_rounds.cc:107] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:26.805171 26686 raft_consensus.cc:2889] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:26.805747 26678 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:26.778923 26684 rpcz_store.cc:276] 0709 13:09:25.326723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.332198 (+  5475us) service_pool.cc:224] Handling call
0709 13:09:25.332520 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.332972 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.332998 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.824485 (+491487us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:25.824967 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.950004 (+125037us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:25.950055 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.950141 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.681632 (+731491us) raft_consensus.cc:1685] finished
0709 13:09:26.681658 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.687383 (+  5725us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2543,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":47005952,"thread_start_us":124631,"threads_started":1,"wal-append.queue_time_us":205460}
I20260709 13:09:26.824923 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3374) took 1034 ms. Trace:
I20260709 13:09:26.787124 31542 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:26.811095 32402 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 13:09:26.840039 26679 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:26.883443 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3310) took 1166 ms. Trace:
I20260709 13:09:26.837205 31929 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:26.883925 26608 rpcz_store.cc:276] 0709 13:09:25.717157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.717274 (+   117us) service_pool.cc:224] Handling call
0709 13:09:25.717579 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.042765 (+325186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.883177 (+840412us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400065754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:26.883379 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700331904}
I20260709 13:09:26.884436 31929 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:26.885426 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.886631 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.836689 31934 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:26.893369 31877 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.842926 32325 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.825493 26683 rpcz_store.cc:276] 0709 13:09:25.794951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.831978 (+ 37027us) service_pool.cc:224] Handling call
0709 13:09:25.854244 (+ 22266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.883277 (+ 29033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.883312 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.883931 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.036848 (+152917us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:26.036885 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.036954 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.824664 (+787710us) raft_consensus.cc:1685] finished
0709 13:09:26.824693 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.824851 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8591,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":152496,"threads_started":1,"wal-append.queue_time_us":526125}
I20260709 13:09:26.857836 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:26.896867 26758 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:26.858683 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.898406 26752 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:26.859400 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.899082 26753 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.860406 26756 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:26.860751 26754 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:26.860910 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:26.861770 32397 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:09:26.862572 32403 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:09:26.782297 32386 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.910859 26682 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:26.802960 26505 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 11, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.827553 31889 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.867854 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:26.757779 32312 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:26.876617 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.877884 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:26.878911 32148 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:26.887178 26679 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:26.840830 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3360) took 1472 ms. Trace:
I20260709 13:09:26.890031 26755 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:26.863534 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:26.892926 31929 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:26.896946 32325 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:26.799388 32095 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.864598 32404 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:26.928767 26759 raft_consensus.cc:2368] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:26.952062 27286 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:26.953392 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:26.953575 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:26.931565 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.935761 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:26.949460 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 164746us
I20260709 13:09:26.949597 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:26.958489 26758 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:26.931010 32401 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:26.932740 26680 rpcz_store.cc:276] 0709 13:09:25.326001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.329475 (+  3474us) service_pool.cc:224] Handling call
0709 13:09:25.329846 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.330275 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.330306 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.838872 (+508566us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:25.861378 (+ 22506us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.007316 (+145938us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:26.007366 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.007455 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.781998 (+774543us) raft_consensus.cc:1685] finished
0709 13:09:26.782017 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.798473 (+ 16456us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5073,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":54097408,"thread_start_us":126100,"threads_started":1,"wal-append.queue_time_us":521123}
I20260709 13:09:26.963016 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.965271 26684 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:26.966058 26679 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:26.972378 32386 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:26.972905 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.973572 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.974160 26760 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:26.974435 26760 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.972422 32413 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:26.976382 32413 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:26.976643 32377 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.069s	user 0.001s	sys 0.019s
I20260709 13:09:26.977340 32413 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.978482 32093 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:26.980331 32404 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.981349 32404 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:26.983727 26687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3370) took 1433 ms (client timeout 1580 ms). Trace:
W20260709 13:09:26.984112 26687 rpcz_store.cc:269] 0709 13:09:25.550290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.555722 (+  5432us) service_pool.cc:224] Handling call
0709 13:09:26.983499 (+1427777us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54003c64d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:26.983614 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52505856}
I20260709 13:09:26.984630 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:26.985507 26687 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:26.985809 32414 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:26.987389 32414 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:26.987877 32414 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:26.988786 32414 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.992785 31934 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.993848 26679 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:26.994395 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:26.994856 32095 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:26.994393 32101 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:26.995162 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:26.995957 31877 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:26.996037 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.002442 26753 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:27.002801 32332 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.004182 32040 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:26.985522 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.006029 31642 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:27.006074 31548 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:27.065773 26755 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:09:27.066308 26755 pending_rounds.cc:85] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 13
I20260709 13:09:27.066570 26755 pending_rounds.cc:107] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:09:27.066831 26755 raft_consensus.cc:2889] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:27.068233 32396 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.291s	user 0.000s	sys 0.003s
I20260709 13:09:27.053457 32040 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:27.069450 32040 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.070648 32040 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.037576 32332 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:27.074456 32332 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.075127 26761 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:26.975193 26760 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.008205 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:26.955391 32254 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:27.013134 31531 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.014634 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:26.963006 32375 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:26.962584 32021 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:27.015916 32416 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:27.010025 31752 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.032925 26608 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:27.035475 26684 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:27.112947 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2089) took 1071 ms. Trace:
I20260709 13:09:27.113300 26684 rpcz_store.cc:276] 0709 13:09:26.041316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.948708 (+907392us) service_pool.cc:224] Handling call
0709 13:09:26.965098 (+ 16390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.112630 (+147532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.112884 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:27.104504 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.036286 26680 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:09:27.102698 26752 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:27.115348 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2091) took 1025 ms. Trace:
I20260709 13:09:27.115708 26680 rpcz_store.cc:276] 0709 13:09:26.090278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.968399 (+878121us) service_pool.cc:224] Handling call
0709 13:09:27.035960 (+ 67561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.115107 (+ 79147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.115299 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.060072 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.117177 26604 raft_consensus.cc:2368] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17.
I20260709 13:09:27.062352 26757 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:27.053256 31934 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.052670 32101 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.075627 32332 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:27.076363 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90905us
I20260709 13:09:27.076745 26603 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:27.076859 31877 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.058436 31889 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:27.077324 32417 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:27.079514 32061 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.038s	user 0.008s	sys 0.004s
W20260709 13:09:27.080155 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 269995us
W20260709 13:09:27.080397 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.080809 32408 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:09:27.006677 32148 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.082054 26685 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:27.082444 26756 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:27.158915 26756 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:27.083250 26505 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 11, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.008854 31542 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.092872 26760 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:27.096856 26681 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:27.033793 32403 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:27.097234 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.034489 32411 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:27.132112 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:27.139209 27320 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:09:27.133875 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.143774 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.174927 26604 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:27.144392 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.097416 32010 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:27.023205 32401 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.157573 26687 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:27.159505 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.161868 27315 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:27.171788 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.190003 26605 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:27.190142 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.190796 26603 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:27.176780 31468 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.177526 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.178570 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.180634 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.181391 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.127198 32138 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.185791 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2092) took 1093 ms. Trace:
I20260709 13:09:27.186276 26610 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:27.138005 32375 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.192945 31468 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.191934 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:27.200423 27321 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:27.193750 26609 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:27.196070 26611 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:27.198132 26681 rpcz_store.cc:276] 0709 13:09:26.092128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.014372 (+922244us) service_pool.cc:224] Handling call
0709 13:09:27.185730 (+171358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.186057 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:27.212949 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:27.212898 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 205129us
I20260709 13:09:27.216346 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:27.216584 26610 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:27.217060 27316 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:27.160151 32417 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:27.223455 31468 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.118888 32416 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.218912 26760 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:27.216723 26756 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.222354 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.232611 26608 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:27.187251 32412 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.235534 32412 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.238463 32412 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.147228 31877 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.224067 31468 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:09:27.230757 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.220888 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.243405 26610 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:27.244345 26756 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:27.248484 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.161401 32061 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:27.249598 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 87915.3us
I20260709 13:09:27.250792 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.251561 26609 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.203073 31815 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.251233 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.245882 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.173199 32254 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:09:27.223879 32249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.030s	sys 0.044s
I20260709 13:09:27.249217 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.184861 32148 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.216318 31548 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:27.265486 26607 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.218596 26651 leader_election.cc:400] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:27.300559 26651 leader_election.cc:403] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:27.223789 31531 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:27.267988 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.255151 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:27.299163 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.299468 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:27.179219 32418 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.088s
W20260709 13:09:27.265269 32249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.030s	sys 0.044s
W20260709 13:09:27.309834 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54802.6us
I20260709 13:09:27.314304 26758 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:27.193502 32010 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.305827 26610 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:27.260327 32412 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:27.218545 32375 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.325404 26609 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:27.266677 31929 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:27.273056 31548 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:27.212433 32138 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:27.344579 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 149248us
I20260709 13:09:27.216364 32411 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.273566 31815 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.318888 32095 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:27.329107 32412 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:27.436470 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 96174.9us
I20260709 13:09:27.438097 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.434568 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.442246 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.454392 26684 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:27.436621 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.328680 32159 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.347448 26611 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:27.319340 32427 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:09:27.387691 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.437345 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.467773 26681 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:27.465469 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.340497 31929 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.475700 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.477193 26679 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:27.431962 32409 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.484146 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 96567.5us
I20260709 13:09:27.369484 32254 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:27.482403 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.486375 26680 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:27.491691 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 191415us
W20260709 13:09:27.495618 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.452000 32095 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:27.464217 32412 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.502535 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:27.470124 31752 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.379613 32417 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:27.503916 32426 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:09:27.504245 32420 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:09:27.504920 32421 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:09:27.505029 32425 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:27.506065 32423 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:09:27.508607 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.499205 32433 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:27.484961 31929 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.532809 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:27.533393 26753 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:27.556905 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.560904 26605 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:27.512907 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.460781 32413 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.537274 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.545763 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:27.546042 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 653) took 1542 ms. Trace:
W20260709 13:09:27.546316 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43882.3us
I20260709 13:09:27.546466 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:27.497057 32427 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:27.492141 32254 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:27.551447 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:27.552925 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44527.6us
W20260709 13:09:27.552942 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 237762us
I20260709 13:09:27.511694 32095 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:27.506102 32422 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:27.566188 31934 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.545501 31548 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.567546 31877 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.536638 31531 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.597910 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.598558 26684 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:27.598836 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:27.568277 32376 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:27.568913 32061 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.575891 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:27.574415 26682 rpcz_store.cc:276] 0709 13:09:26.004090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.912737 (+908647us) service_pool.cc:224] Handling call
0709 13:09:26.913123 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.954531 (+ 41408us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:27.100296 (+145765us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.545099 (+444803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.545171 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.545789 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.545859 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.545979 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64242,"prepare.queue_time_us":78037,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":80871,"spinlock_wait_cycles":93993728,"thread_start_us":347955,"threads_started":2,"wal-append.queue_time_us":230379}
I20260709 13:09:27.559168 32325 raft_consensus.cc:2764] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:09:27.594460 26685 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:27.605744 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:27.576332 32427 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:27.497130 32409 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.610019 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.611296 31815 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:27.611744 32419 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.372s	user 0.001s	sys 0.001s
I20260709 13:09:27.607086 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.620230 26612 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:27.626888 32010 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.627499 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 652) took 1711 ms. Trace:
W20260709 13:09:27.629559 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90999.5us
I20260709 13:09:27.627701 32061 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:27.626888 32442 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:27.631148 32061 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:27.631215 32442 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.631685 32061 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.511336 26505 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 8, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 8 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:27.632390 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 651) took 1717 ms. Trace:
I20260709 13:09:27.632778 26686 rpcz_store.cc:276] 0709 13:09:25.915406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.864978 (+949572us) service_pool.cc:224] Handling call
0709 13:09:26.865328 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.895172 (+ 29844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.895205 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.895741 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.140948 (+245207us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.141013 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.141108 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.632176 (+491068us) raft_consensus.cc:1685] finished
0709 13:09:27.632196 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.632338 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29355,"raft.queue_time_us":30699,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":244782,"threads_started":1,"wal-append.queue_time_us":370853}
I20260709 13:09:27.633209 26505 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.629860 26683 rpcz_store.cc:276] 0709 13:09:25.935633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.895752 (+960119us) service_pool.cc:224] Handling call
0709 13:09:26.896144 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.896373 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.896402 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.896877 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.119801 (+222924us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:27.119835 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.119899 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.627290 (+507391us) raft_consensus.cc:1685] finished
0709 13:09:27.627311 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.627434 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":222571,"threads_started":1,"wal-append.queue_time_us":310085}
I20260709 13:09:27.631716 32442 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.640035 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 649) took 1725 ms. Trace:
I20260709 13:09:27.640453 26678 rpcz_store.cc:276] 0709 13:09:25.914805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.808317 (+893512us) service_pool.cc:224] Handling call
0709 13:09:26.823644 (+ 15327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.888269 (+ 64625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.888307 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.888834 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.143608 (+254774us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.144375 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.144690 (+   315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.639747 (+495057us) raft_consensus.cc:1685] finished
0709 13:09:27.639784 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.639969 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":810,"raft.queue_time_us":60433,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":254378,"threads_started":1,"wal-append.queue_time_us":359784}
I20260709 13:09:27.642282 32375 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.643116 32138 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:27.644248 32434 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:27.645634 32061 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.605083 32376 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.647958 32376 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.595362 32040 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:27.650907 32061 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:27.653926 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43986.4us
I20260709 13:09:27.654667 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.630424 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.606691 32148 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.660315 31468 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.662657 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.672863 31468 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:27.679687 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 461173us
I20260709 13:09:27.614871 32435 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:27.680655 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 83428.7us
I20260709 13:09:27.684012 26680 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:27.622254 32416 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.673429 31815 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.672175 31548 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:27.615460 31531 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.687654 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.689919 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.677546 32249 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:27.694058 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88388.6us
W20260709 13:09:27.694821 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 64464.9us
I20260709 13:09:27.701236 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.701875 26610 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.708451 31468 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.711578 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.712941 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.689706 32435 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.692613 32427 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.686770 32444 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:27.740477 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.822657 26606 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:27.770694 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:27.770419 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.698087 32061 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:27.717720 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.818158 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 105317us
W20260709 13:09:27.772691 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.829304 26680 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:27.697999 32148 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:27.832983 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:27.820968 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 158534us
I20260709 13:09:27.760845 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:27.775936 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.824812 26610 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:27.635419 26505 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 8 to 10, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 10 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.860620 26612 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:27.860999 26577 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:27.830451 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 89904.4us
W20260709 13:09:27.744446 32386 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.002s
W20260709 13:09:27.747641 32438 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:27.831741 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.755098 31934 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:27.740165 32250 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:27.834549 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.767887 32325 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:27.844703 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.844816 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.754665 32376 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.851972 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:27.874478 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.852535 32375 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:27.853966 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.855049 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.879959 26680 raft_consensus.cc:2376] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17. Re-sending same reply.
I20260709 13:09:27.855293 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.761650 32409 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.757138 32442 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.855944 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:27.856359 31889 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.004s
I20260709 13:09:27.857671 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:27.754491 32416 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:27.708019 32411 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.692306 31815 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.704954 31542 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:27.860621 26605 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
W20260709 13:09:27.864286 26607 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
W20260709 13:09:27.867069 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.906194 26607 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:27.889129 32386 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:27.895272 32332 consensus_meta.cc:287] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.001s
I20260709 13:09:27.878310 26505 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 11, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 11 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:27.899224 32416 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:27.916407 26505 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 11 to 12, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 12 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.918365 32416 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.918442 26505 catalog_manager.cc:5697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 10, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:27.692423 32254 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.928574 32376 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.914268 31929 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.931136 31929 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.934546 32413 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:27.936523 32159 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:27.939702 26684 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:27.823733 32101 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:27.870790 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 110043us
I20260709 13:09:27.874589 26687 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:27.767838 32454 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:09:27.874058 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:27.759625 32095 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:27.877074 26754 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:27.877801 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:27.908239 32451 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:27.878289 32148 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:27.878111 26756 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 2 to 9, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:27.713727 31752 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
I20260709 13:09:27.708081 32425 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.160s
I20260709 13:09:27.887815 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:27.947767 31542 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:27.888648 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:27.890244 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.861969 32427 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.888456 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:28.045866 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.046969 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:28.047497 26683 raft_consensus.cc:2376] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13. Re-sending same reply.
I20260709 13:09:27.715441 32244 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:09:27.869997 32456 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:27.870374 32404 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:27.902714 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45109.9us
I20260709 13:09:27.748277 32448 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:27.777186 31531 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.913959 32435 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:27.892422 32250 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:27.915181 26611 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:09:27.909708 32386 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.920137 32442 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.868690 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:27.862675 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:27.921805 26604 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:28.078454 26610 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:27.927146 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58716.8us
I20260709 13:09:27.927605 32452 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:27.927914 31815 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:27.942292 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:27.952116 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.920785 32061 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:27.953060 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:27.968355 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:28.080816 26609 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:27.968619 26607 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:27.967553 32451 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:27.977317 26680 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.888350 26682 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:27.950182 31642 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.979789 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:27.997756 26760 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:27.999150 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:28.003170 32401 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:27.979636 26606 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:28.008656 32425 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.020964 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512480111cea40cebe7a32ae9439af70"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:28.086170 26755 raft_consensus.cc:606] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:27.966475 32462 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:28.031014 26754 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:28.088227 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 225628us
W20260709 13:09:28.036119 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 147556us
I20260709 13:09:28.086534 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.089736 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.040901 31542 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.044236 32101 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:28.044682 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.098153 26678 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:28.041874 26752 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:28.099682 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:27.949749 32412 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.101876 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.102533 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.056645 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.102507 26760 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:28.103459 26759 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:28.086553 26755 raft_consensus.cc:614] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:28.078084 32386 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.103813 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:28.154467 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 50733.1us
I20260709 13:09:28.087601 32451 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.103154 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.055337 32456 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.116824 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:28.159390 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56313.2us
I20260709 13:09:28.160166 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:28.160794 26755 raft_consensus.cc:606] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:28.160926 32456 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:28.117026 32095 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:28.161912 32010 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.162186 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.162971 32095 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:28.163333 32095 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.163695 32095 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.164707 32412 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:28.165546 32425 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:28.165745 32010 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:28.055524 32404 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.176682 26752 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:28.178012 32404 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:28.106791 31548 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:28.179600 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:28.181172 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:28.120579 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:28.183102 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62566.2us
I20260709 13:09:28.184144 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.184294 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.185253 32459 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:28.185607 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.185954 32459 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.186764 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:28.188982 32415 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:28.189483 32415 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:28.189707 32414 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:28.190172 32414 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:28.190528 32415 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.121112 32411 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.121428 32148 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.190990 32414 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.194278 32414 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.121774 32332 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.125600 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:28.131840 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.207521 26759 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:09:28.132179 26680 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:28.134457 32441 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:09:28.135802 31752 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:28.136086 32465 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:09:28.115381 26609 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:28.135589 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.133050 32250 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.136385 32428 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:28.145644 32061 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.152735 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.117748 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.054667 26505 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 11, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.087296 32452 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.097118 32435 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:28.172098 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.186549 32459 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.087479 31642 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.232156 32404 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:28.232736 32404 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:28.232545 31642 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:28.233392 32437 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.621s	user 0.002s	sys 0.002s
I20260709 13:09:28.233897 31642 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.233705 32404 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.234880 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3327) took 1081 ms. Trace:
I20260709 13:09:28.212815 31934 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:28.214915 32244 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.235260 26608 rpcz_store.cc:276] 0709 13:09:27.153194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.233374 (+ 80180us) service_pool.cc:224] Handling call
0709 13:09:27.233819 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.234103 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.234140 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.234676 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.402692 (+168016us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.402744 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.402821 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.232767 (+829946us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:28.234579 (+  1812us) raft_consensus.cc:1685] finished
0709 13:09:28.234606 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.234819 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6967168,"thread_start_us":167574,"threads_started":1,"wal-append.queue_time_us":338399}
I20260709 13:09:28.240140 32465 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:28.240609 32465 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:28.240979 32465 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.241565 32451 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.214402 32386 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.243865 27314 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:28.247211 32415 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.249142 26755 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:28.250459 26753 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:09:28.262538 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.264012 26760 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:28.262578 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 60074.8us
I20260709 13:09:28.247624 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:28.196811 32095 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.204282 31531 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:28.203411 26756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:28.209753 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.208043 26759 pending_rounds.cc:85] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 10
I20260709 13:09:28.186093 31815 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:28.273804 26759 pending_rounds.cc:107] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:09:28.273970 26756 raft_consensus.cc:606] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:28.274147 26759 raft_consensus.cc:2889] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:28.275624 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65988.9us
I20260709 13:09:28.278064 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.278429 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.281306 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.281988 26681 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:28.248656 32401 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:28.284032 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.285686 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:28.271762 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 110444us
I20260709 13:09:28.296546 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2158) took 1415 ms. Trace:
I20260709 13:09:28.297065 26758 rpcz_store.cc:276] 0709 13:09:26.876461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.054280 (+177819us) service_pool.cc:224] Handling call
0709 13:09:27.081180 (+ 26900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.328791 (+247611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.291958 (+963167us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54000dbbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:28.292183 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507825536}
I20260709 13:09:28.306490 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.307583 26687 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:28.311218 26757 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:28.274771 32244 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:28.320168 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:28.291919 32332 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:28.283715 31934 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:28.321818 31815 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.321373 32244 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:28.326125 32451 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:28.306442 32435 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:28.406311 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:28.355973 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 220534us
I20260709 13:09:28.477131 26757 raft_consensus.cc:1240] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:28.477411 26608 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:28.477955 26758 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:28.442512 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.367825 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 367227us
I20260709 13:09:28.381229 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:28.476527 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:28.481938 26612 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:28.327651 32425 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:28.354557 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 147028us
W20260709 13:09:28.485500 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.486250 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.453913 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:28.395524 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.325945 32452 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:28.492818 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 97404.6us
I20260709 13:09:28.411300 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.395260 26611 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:28.413869 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.495919 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:28.452035 32433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.018s	sys 0.017s
I20260709 13:09:28.498420 26607 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.378371 32417 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.500481 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:28.507624 26610 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:28.508126 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:28.483970 32244 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:28.342545 31548 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.499711 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.509354 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:28.506181 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94989.4us
I20260709 13:09:28.354677 32459 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:28.476704 32010 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:09:28.506783 31934 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:09:28.506124 32433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.018s	sys 0.020s
I20260709 13:09:28.463359 32101 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:28.516115 32095 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:28.516793 31531 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:28.492039 32471 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:28.517596 32250 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:28.521555 32469 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.285s	user 0.002s	sys 0.001s
I20260709 13:09:28.520699 26505 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 8 to 12, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:28.525360 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:28.527200 32418 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:28.525415 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:28.513643 32148 raft_consensus.cc:3055] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:28.531972 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 156535us
I20260709 13:09:28.532173 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:28.533038 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:28.378875 32021 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:09:28.530880 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.534041 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:28.395895 32401 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:28.506958 32442 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:28.405905 32386 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:28.507078 32417 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:28.666237 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 154553us
I20260709 13:09:28.537902 32433 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:28.548187 32425 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:28.644937 32470 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:09:28.550032 31531 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.670878 32095 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.652046 31548 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.650666 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.668524 32459 consensus_queue.cc:1059] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:28.487815 31815 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.529623 32478 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:09:28.549695 32471 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:28.649052 32254 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.717566 32442 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:28.550367 31752 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:09:28.750232 31752 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:28.750634 31752 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.710175 26758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923e107aa6da49eb820049f53360fba9"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:28.752267 26758 raft_consensus.cc:606] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:28.752745 26758 raft_consensus.cc:614] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:28.671700 32332 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:09:28.717315 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 186501us
W20260709 13:09:28.717949 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 192598us
I20260709 13:09:28.756121 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.684942 32465 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:28.719991 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 187021us
I20260709 13:09:28.720019 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:28.721989 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.723120 31542 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:28.731551 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 80985.4us
I20260709 13:09:28.718667 32404 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.714875 32148 raft_consensus.cc:740] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:28.716692 32376 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:28.717902 32401 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.722380 32411 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.545578 32462 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:09:28.724365 32448 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:28.773294 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:28.767691 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.736565 32471 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.723465 32456 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:28.747284 32459 raft_consensus.cc:3055] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:28.747624 31815 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:28.752586 32442 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.734303 32101 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.758714 26650 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17.
W20260709 13:09:28.767038 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47168.2us
I20260709 13:09:28.790493 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:28.752159 32386 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:28.787130 32459 raft_consensus.cc:740] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:28.783882 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.748376 32478 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:28.766438 32435 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:28.793071 26650 leader_election.cc:403] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.775875 32482 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:28.797796 26607 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:28.800072 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:28.734504 32095 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.804096 31642 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:28.804520 31642 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.751451 31752 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.788546 32456 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:28.788247 32418 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:28.805244 31642 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.792514 32472 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:28.820906 32010 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.832494 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:28.792544 32101 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.824597 31642 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:28.836570 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.795161 32478 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:28.819135 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61893.8us
I20260709 13:09:28.798794 32435 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:28.839767 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 108527us
I20260709 13:09:28.787765 32376 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:28.768218 32404 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.860590 26608 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:28.824836 32456 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:28.834021 32414 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.003s
I20260709 13:09:28.794328 31815 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:28.796772 32411 consensus_queue.cc:1059] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:09:28.837929 32101 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.832535 32472 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:28.796495 32459 consensus_queue.cc:260] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.818668 32481 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:28.825711 32475 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17.
W20260709 13:09:28.867726 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 103014us
I20260709 13:09:28.870229 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:28.871516 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:09:28.885810 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 353679us
I20260709 13:09:28.886626 32386 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:28.867085 31752 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.911577 26680 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:09:28.845551 32435 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.768287 32417 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.921339 26761 raft_consensus.cc:606] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:28.930418 26761 raft_consensus.cc:614] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:28.932502 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62391.2us
I20260709 13:09:28.914155 32462 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:28.933389 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:28.915000 32481 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.918732 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 86343us
I20260709 13:09:28.937358 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:28.950888 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:28.964815 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.839485 32433 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:28.950385 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182767us
I20260709 13:09:28.939527 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:28.948084 32480 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:09:28.982551 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45287.7us
I20260709 13:09:28.983325 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:28.936022 32462 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:28.976277 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:28.950623 32459 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:28.938213 32491 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.940174 32481 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.986428 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:28.966460 32411 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:28.979151 32488 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:09:29.005326 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:29.006620 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:28.998812 32462 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.013330 32496 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:29.012432 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:29.008209 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:29.019846 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 168744us
I20260709 13:09:29.007910 32465 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.003901 32491 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:29.011801 32485 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.059180 26609 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:09:29.071841 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50048.6us
W20260709 13:09:29.065315 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.058282 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.010241 31815 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:29.059621 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:29.064278 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81010.6us
I20260709 13:09:29.009121 32501 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.938273 32418 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:28.966015 32386 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.023173 32493 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:29.081063 26611 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:29.097503 26610 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:09:29.025516 32448 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.003364 32412 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:29.017165 32492 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.940577 32478 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.116276 32478 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.059052 32415 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:29.118209 32415 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:29.119117 32415 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.120309 32505 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:29.120819 32512 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:29.088651 32490 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:29.072389 32491 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.086063 31815 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:29.081013 32494 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:29.127830 26611 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:28.986516 32472 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.171922 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 111362us
I20260709 13:09:29.123567 32485 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:09:29.127113 31815 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:29.189357 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 107142us
I20260709 13:09:29.193115 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:29.097967 32501 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.207310 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.219898 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.218340 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 141083us
I20260709 13:09:29.188601 32472 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:29.177014 32404 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:29.227927 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.231509 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.233827 26681 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:09:29.142594 31531 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.246080 26679 raft_consensus.cc:2410] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:29.298302 26756 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:29.303597 32483 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:09:29.308190 32513 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.299695 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65099.4us
I20260709 13:09:29.315917 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:29.316249 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:29.318225 32513 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.323622 26759 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:29.324556 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:29.325579 32513 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.325675 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.326785 32101 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.329519 32507 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:09:29.331480 32510 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:09:29.313935 32442 consensus_meta.cc:287] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 13:09:29.340379 32442 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.342603 32442 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:29.347618 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.383965 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.388211 26757 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:29.388394 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2111) took 1110 ms. Trace:
I20260709 13:09:29.388797 26680 rpcz_store.cc:276] 0709 13:09:28.277682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.277807 (+   125us) service_pool.cc:224] Handling call
0709 13:09:29.349164 (+1071357us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54000b4354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:29.388321 (+ 39157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454533888}
I20260709 13:09:29.393662 26607 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:09:29.314805 32437 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:09:29.401567 32244 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.868s	user 0.007s	sys 0.004s
I20260709 13:09:29.402082 32244 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.404978 32244 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:29.390077 31934 raft_consensus.cc:3055] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:29.451206 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.466281 32101 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:29.466589 32518 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.467108 32518 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.469389 32518 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:29.473299 32471 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 13:09:29.473898 32471 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.473379 32010 consensus_meta.cc:287] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.002s
I20260709 13:09:29.475070 32376 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.475100 32010 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:29.476166 32471 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.451015 32462 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.452500 31934 raft_consensus.cc:740] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:29.492774 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:29.493811 27315 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:29.428061 32435 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.496650 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:29.496824 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:29.518978 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:29.525516 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.597287 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:29.599892 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:29.600917 27318 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:29.602447 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:29.536661 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:29.604944 26724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.020s
I20260709 13:09:29.607528 26752 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:29.607683 26724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.012s	sys 0.020s
W20260709 13:09:29.605757 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 66391.3us
W20260709 13:09:29.609563 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 528578us
I20260709 13:09:29.618211 26603 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:29.620078 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:29.620896 32521 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:29.606726 32411 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.000s
I20260709 13:09:29.626770 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:29.623478 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:29.605459 32478 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.627830 32456 consensus_meta.cc:287] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 13:09:29.611912 32526 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:29.637058 32411 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:29.658569 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.657804 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 791400us
I20260709 13:09:29.669721 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:29.666738 27315 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:29.668895 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:29.625551 32376 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:09:29.653453 32521 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.654008 32478 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.691432 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:29.658269 32524 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:29.636714 32491 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.706399 32525 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:09:29.706736 26727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.002s	sys 0.041s
W20260709 13:09:29.711042 26727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.002s	sys 0.041s
W20260709 13:09:29.711481 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.708276 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:29.679351 32471 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:29.674003 32518 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.697935 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.716481 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.659363 32456 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.696110 32481 consensus_meta.cc:287] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.003s
W20260709 13:09:29.708616 32401 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.905s	user 0.009s	sys 0.005s
I20260709 13:09:29.719709 26761 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:29.723785 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54173.5us
I20260709 13:09:29.681794 32411 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:29.692799 32249 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.726336 26611 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:29.709491 32254 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.709450 32462 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:29.714762 32413 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:29.656229 31934 consensus_queue.cc:260] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.774463 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 362597us
I20260709 13:09:29.771006 26650 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:29.721952 32425 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.727802 31929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.005s
I20260709 13:09:29.734995 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:29.665958 32526 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.731364 32441 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:29.836522 32441 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.838492 32441 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.839569 32441 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:29.772814 32490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.036s	sys 0.136s
I20260709 13:09:29.720309 32518 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.854291 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 128953us
I20260709 13:09:29.857762 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:29.849038 32488 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:29.731757 32401 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.725421 32481 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:29.716022 32524 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.772758 32254 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.852317 31531 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:29.849159 32462 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:29.767194 32411 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:29.854420 32490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.037s	sys 0.137s
I20260709 13:09:29.830566 32249 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.854197 32435 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:29.863555 32428 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:29.888052 26754 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:29.871636 26650 leader_election.cc:400] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17.
W20260709 13:09:29.845489 31929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.013s	sys 0.014s
I20260709 13:09:29.868175 32244 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.906195 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.897042 31548 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:29.907809 31548 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.845194 32425 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.907536 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 130560us
W20260709 13:09:29.916709 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 208504us
I20260709 13:09:29.917480 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:29.899852 32490 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:29.904685 32476 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:29.905081 32413 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:29.908775 32503 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:29.919480 32486 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:09:29.897568 32492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.013s
W20260709 13:09:29.919937 32472 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.000s
W20260709 13:09:29.919775 32459 consensus_meta.cc:287] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.000s
W20260709 13:09:29.944378 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.944244 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:29.940429 32492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.004s	sys 0.013s
I20260709 13:09:29.949383 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.949565 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.914399 32244 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:29.936328 32532 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:09:29.952769 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.960527 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.961476 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.977520 26680 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:29.977706 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:29.969228 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:29.971851 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:29.969457 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.979820 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.980139 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:29.980901 26686 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.999810 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.000957 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.001828 26679 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:30.004396 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.009187 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.010313 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.010838 26680 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:30.011384 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.012650 26680 raft_consensus.cc:2410] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:30.013366 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.013844 26680 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:30.014528 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:29.955911 32456 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:29.940264 32413 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.968240 32527 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:29.931712 32476 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:29.954167 32546 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:09:30.016515 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.022892 26682 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:09:30.327382 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.027076 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.247206 26686 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:30.144438 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.165969 26679 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:30.332331 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:29.982895 32552 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.333456 26686 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:30.323513 32554 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:09:30.324513 32559 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:09:30.325487 32560 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:09:30.387518 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2122) took 1160 ms. Trace:
I20260709 13:09:30.387892 26683 rpcz_store.cc:276] 0709 13:09:29.227234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.227339 (+   105us) service_pool.cc:224] Handling call
0709 13:09:29.293676 (+ 66337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.869719 (+576043us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:29.869748 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.876475 (+  6727us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.968917 (+ 92442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:29.968952 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.969017 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.387298 (+418281us) raft_consensus.cc:1685] finished
0709 13:09:30.387318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.387455 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380917,"raft.queue_time_us":391183,"spinlock_wait_cycles":29642880,"thread_start_us":256888,"threads_started":2,"wal-append.queue_time_us":264592}
I20260709 13:09:30.389911 26683 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:30.160403 32549 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:09:30.156100 31815 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.960s	user 0.012s	sys 0.000s
I20260709 13:09:30.385872 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2125) took 1157 ms. Trace:
I20260709 13:09:30.163381 32401 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.075166 32492 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:30.156327 32542 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:09:30.149453 32486 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:09:30.162156 32536 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 13:09:30.163793 32539 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
W20260709 13:09:30.161584 32534 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 13:09:30.022027 32530 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:09:30.397317 32472 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.392746 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.150424 32545 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:30.150746 32254 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.147135 32518 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:30.391271 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 328710us
W20260709 13:09:30.413277 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.324235 32425 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.149082 32491 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.461942 32491 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.462499 32491 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.463279 32417 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.464861 32491 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.335455 32557 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.465809 32557 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.468068 32095 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:30.468199 32557 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.468855 32557 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:30.471728 32514 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.247s	user 0.002s	sys 0.002s
I20260709 13:09:30.474821 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3357) took 1446 ms. Trace:
I20260709 13:09:30.475813 32478 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.476516 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2180) took 1656 ms. Trace:
I20260709 13:09:30.476923 26754 rpcz_store.cc:276] 0709 13:09:28.820168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.820326 (+   158us) service_pool.cc:224] Handling call
0709 13:09:28.820695 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.905291 (+1084596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.476274 (+570983us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000dacd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:30.476451 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454094720}
I20260709 13:09:30.477480 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3359) took 1448 ms. Trace:
I20260709 13:09:30.477864 26612 rpcz_store.cc:276] 0709 13:09:29.028755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.030169 (+  1414us) service_pool.cc:224] Handling call
0709 13:09:29.030512 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.222233 (+191721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.222262 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.246125 (+ 23863us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.651365 (+405240us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:29.651403 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.651480 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.477281 (+825801us) raft_consensus.cc:1685] finished
0709 13:09:30.477302 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.477428 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79862,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"thread_start_us":503615,"threads_started":2,"wal-append.queue_time_us":539200}
I20260709 13:09:30.059859 32490 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.485424 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 711) took 1311 ms. Trace:
I20260709 13:09:30.485855 26611 rpcz_store.cc:276] 0709 13:09:29.174338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.174508 (+   170us) service_pool.cc:224] Handling call
0709 13:09:29.174824 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.768150 (+593326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.485178 (+717028us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400249854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:30.485361 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267801344}
I20260709 13:09:30.486673 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2119) took 2107 ms. Trace:
I20260709 13:09:30.487108 26684 rpcz_store.cc:276] 0709 13:09:28.352407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.352554 (+   147us) service_pool.cc:224] Handling call
0709 13:09:28.372321 (+ 19767us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:28.463050 (+ 90729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.463082 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:28.499341 (+ 36259us) log.cc:844] Serialized 52 byte log entry
0709 13:09:28.710603 (+211262us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:28.803583 (+ 92980us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.803857 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.803928 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.629154 (+825226us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b180022a980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f716458f 00007f40f01a3571 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd
0709 13:09:29.685135 (+ 55981us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b180022a980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:30.459189 (+774054us) raft_consensus.cc:1685] finished
0709 13:09:30.459210 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.459353 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97883,"prepare.queue_time_us":163890,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":94986,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":30986,"spinlock_wait_cycles":35991680,"thread_start_us":245665,"threads_started":2,"wal-append.queue_time_us":289669}
I20260709 13:09:30.490469 31548 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.491493 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 706) took 1647 ms. Trace:
I20260709 13:09:30.496186 26607 rpcz_store.cc:276] 0709 13:09:28.846088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.846324 (+   236us) service_pool.cc:224] Handling call
0709 13:09:28.855351 (+  9027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.394250 (+538899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.491233 (+1096983us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:30.491432 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237296000}
I20260709 13:09:30.498431 32476 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.475265 26603 rpcz_store.cc:276] 0709 13:09:29.028104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.029540 (+  1436us) service_pool.cc:224] Handling call
0709 13:09:29.029910 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.625573 (+595663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.474523 (+848950us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400100ed4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:30.474753 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342509440}
I20260709 13:09:30.147609 32481 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.330408 32524 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.042132 32459 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:30.154405 32428 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:30.328299 32526 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:30.423040 32550 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:30.535383 32459 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.536355 26679 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:30.337435 32527 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.537684 32459 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.160723 32548 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:30.394829 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 417161us
I20260709 13:09:30.366933 32249 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.433457 26681 rpcz_store.cc:276] 0709 13:09:29.228113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.271292 (+ 43179us) service_pool.cc:224] Handling call
0709 13:09:29.293565 (+ 22273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.674677 (+381112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.674721 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.679837 (+  5116us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.896872 (+217035us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:29.896911 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.898161 (+  1250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.385652 (+487491us) raft_consensus.cc:1685] finished
0709 13:09:30.385672 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.385813 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375199,"raft.queue_time_us":391004,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"spinlock_wait_cycles":23808,"thread_start_us":175516,"threads_started":1,"wal-append.queue_time_us":349320}
I20260709 13:09:30.459287 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:30.445493 31815 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:30.543483 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84269.2us
I20260709 13:09:30.544584 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:30.551412 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.338001 32558 consensus_queue.cc:1059] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:09:30.434887 32564 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:30.441419 26687 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:30.573745 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.574324 26687 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.574909 26683 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:30.458166 32472 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.555720 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:30.556561 26681 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:30.564862 26684 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:09:30.393481 32552 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:30.570250 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.434135 32492 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:30.584209 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 251937us
I20260709 13:09:30.554312 32524 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:30.591025 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:30.590378 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.584877 26687 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:30.593356 26686 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:30.590343 32544 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.550092 32548 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.594374 32544 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.562335 32563 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:30.601318 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45716.7us
I20260709 13:09:30.602244 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:30.606931 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:30.608592 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:30.610450 32548 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.611764 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.612393 26684 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.615021 26681 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:30.616946 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:30.617789 32566 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:30.618356 32566 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.618399 32249 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:30.618808 32566 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.597576 32518 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.619382 32518 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.617880 32332 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:30.588019 32459 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.626844 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.626965 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.627576 26683 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:30.630797 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.631469 26683 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 10: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:30.632598 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.633351 26683 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:30.634522 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:30.641428 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.621227 32428 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.644004 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.644925 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.655826 32567 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:30.656391 32567 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.656783 32567 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.657155 32472 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.657728 32563 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.658241 32563 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.660024 32332 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:30.660959 32332 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.662792 32568 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.663292 32568 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.642174 32249 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:30.664680 32249 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:30.664786 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:30.623700 32518 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.665488 32568 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.665920 32518 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.666263 32558 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.666697 32496 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.667886 32476 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:30.668640 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:30.591848 32564 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.669267 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:30.678097 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.678615 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:30.680485 26683 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:09:30.696386 31642 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.696852 31642 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.697144 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:30.698134 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.698627 26683 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.698818 32496 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.698627 31642 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.683909 26684 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:30.631431 32413 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.699625 32448 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.694372 32476 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.704613 32476 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.704542 32448 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.706157 32564 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.707410 32568 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.708098 32568 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:30.708559 32487 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.869s	user 0.002s	sys 0.002s
I20260709 13:09:30.710218 32568 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.714246 32566 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.715938 32448 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.693456 32518 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.717622 32533 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.718116 32533 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.718431 32518 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.689885 32546 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:30.719022 32148 consensus_queue.cc:260] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.719149 32546 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.719781 32566 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.720161 32533 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:30.720289 32148 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:30.721457 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 803991us
I20260709 13:09:30.679355 32492 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.725142 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:30.725535 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.725787 26681 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:30.734000 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:30.633282 32459 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.739287 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:30.690613 32249 consensus_queue.cc:1059] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:09:30.747437 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67399.6us
I20260709 13:09:30.749306 32497 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
W20260709 13:09:30.751708 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.752653 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.753562 32386 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:30.752683 32401 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.753980 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.754349 32401 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.734026 32462 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.755595 31877 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.756100 31877 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.756477 32401 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:30.749764 32569 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:30.760954 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:30.764550 26754 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.761694 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:30.761694 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.762267 26753 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:30.765727 26761 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:09:30.766417 32544 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.766563 32533 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:30.767311 26759 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:30.698689 32558 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:09:30.768052 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.764146 31929 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.768774 32563 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.769259 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.769714 32538 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:30.769838 26757 raft_consensus.cc:1240] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:30.770481 32535 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.760031 32555 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.770974 32535 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.772908 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.773518 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.771428 32555 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.777503 32401 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:30.778558 32555 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:30.779277 32543 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.859s	user 0.002s	sys 0.000s
I20260709 13:09:30.787575 26610 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:30.789372 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:30.790184 26612 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.797439 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.799125 26758 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:30.810842 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.807348 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:30.807891 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.813191 26758 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:30.814044 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.815960 26607 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:30.817167 32417 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:30.819911 31877 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:30.759456 32567 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:30.821466 32547 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.861s	user 0.003s	sys 0.000s
I20260709 13:09:30.822454 32567 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.829150 32491 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.829815 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:30.829952 32491 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.837477 26761 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:30.839974 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.841200 26754 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:30.841960 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:30.842852 26607 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:30.845403 26726 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:30.781044 31815 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:30.851769 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2072) took 1439 ms. Trace:
I20260709 13:09:30.804579 32552 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:30.768851 31929 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:30.865521 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.868448 26754 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:30.867244 26761 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:30.870069 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.871367 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.871389 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.872277 26755 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:30.872917 31815 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.868839 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.873488 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.855831 26760 rpcz_store.cc:276] 0709 13:09:29.412550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.412663 (+   113us) service_pool.cc:224] Handling call
0709 13:09:29.433895 (+ 21232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.434165 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:29.727329 (+293164us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.864591 (+137262us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.148069 (+283478us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b18003cdae0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:30.717339 (+569270us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18003cdae0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:30.847623 (+130284us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.851408 (+  3785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:30.851465 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:30.851513 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.851579 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.851713 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629619,"prepare.queue_time_us":35878,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4395,"raft.queue_time_us":998076,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12898,"spinlock_wait_cycles":19775744,"thread_start_us":507548,"threads_started":3}
I20260709 13:09:30.876618 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.877058 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.873493 31815 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:30.879163 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:30.991523 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.999955 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.875159 26759 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:30.901958 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.000590 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.880188 26757 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:30.902643 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:30.967106 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.004351 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:30.918040 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47166.5us
W20260709 13:09:30.993779 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 245425us
I20260709 13:09:31.000695 26755 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:31.005980 26612 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
W20260709 13:09:31.009249 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.022661 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.871346 32503 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:31.028090 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.029183 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:31.030853 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.032380 26760 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:31.032681 26759 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:31.033527 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.034189 26760 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:31.034348 32476 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.035164 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:30.947926 32495 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:31.036752 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:31.039310 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:31.040658 27315 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:31.046782 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:31.003945 31877 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:31.067646 32459 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.067963 31877 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.068928 31815 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.064414 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:31.070071 31877 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:31.017424 32570 raft_consensus.cc:3055] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:31.070659 32570 raft_consensus.cc:740] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:31.070756 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:31.044572 32557 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:31.071525 32570 consensus_queue.cc:260] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.072548 32570 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:31.074842 32404 raft_consensus.cc:993] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:09:31.075491 32404 raft_consensus.cc:1081] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Signalling peer 687d192f79a044ce838f0bf292f0c09f to start an election
I20260709 13:09:31.067652 27318 raft_consensus.cc:2393] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:31.078097 32411 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.079574 32428 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:31.080680 26687 raft_consensus.cc:2410] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:31.078235 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:31.088858 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:31.089707 32557 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:31.090381 32557 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.090830 32557 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.091187 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.091787 26607 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:31.091868 32435 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.092116 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:31.089728 32562 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.523s	user 0.000s	sys 0.003s
I20260709 13:09:31.092648 32435 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.093924 32148 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:31.094444 32148 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.094878 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 685) took 1146 ms. Trace:
I20260709 13:09:31.096376 32148 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.096948 32148 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.097065 32557 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.095227 26685 rpcz_store.cc:276] 0709 13:09:29.948126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.948280 (+   154us) service_pool.cc:224] Handling call
0709 13:09:29.948699 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:29.969434 (+ 20735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.969464 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:29.982284 (+ 12820us) log.cc:844] Serialized 52 byte log entry
0709 13:09:30.109489 (+127205us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:30.253470 (+143981us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.254463 (+   993us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.260034 (+  5571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.260153 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.479370 (+219217us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18004ae420. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:30.868239 (+388869us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18004ae420. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3557 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:31.088868 (+220629us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:31.094691 (+  5823us) raft_consensus.cc:1685] finished
0709 13:09:31.094712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.094826 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41201,"prepare.queue_time_us":761322,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":105,"raft.queue_time_us":62309,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":140021,"spinlock_wait_cycles":97552128,"thread_start_us":93977,"threads_started":1,"wal-append.queue_time_us":443730}
I20260709 13:09:31.097400 32148 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.095398 32435 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.098568 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.099104 32435 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:31.099347 32574 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.099869 32574 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.100190 32574 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.101696 32435 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:31.102295 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.102770 32546 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.104622 32386 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:31.105000 32386 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:31.105822 32386 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.107024 32386 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.108445 32501 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:31.036407 32548 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:09:31.109566 32244 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.109956 32574 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.031358 32496 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.054309 31752 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.054988 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:31.057808 32497 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:31.111577 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.112138 32497 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:31.039762 32418 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.059830 32495 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:31.059415 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:31.061718 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:31.062667 27314 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:31.063170 27312 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:31.063699 27319 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:31.064375 27320 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:31.065053 32476 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.102902 26606 raft_consensus.cc:3060] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:31.114459 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:31.117452 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.137439 26610 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:31.138883 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:31.139621 26752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 667) took 1908 ms (client timeout 1718 ms). Trace:
W20260709 13:09:31.049505 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.112535 32497 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:31.125063 32418 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.125316 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.128057 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.147305 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.151451 26756 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:31.128988 32495 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:31.159215 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.160006 26603 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:31.161769 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.501s (SENT) [suppressed 14 similar messages]
W20260709 13:09:31.131719 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72362.3us
I20260709 13:09:31.139606 26607 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:31.142241 26610 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:31.142428 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:31.142970 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.170836 26684 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:31.145617 26606 raft_consensus.cc:2468] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
W20260709 13:09:31.140070 26752 rpcz_store.cc:269] 0709 13:09:29.231097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.231241 (+   144us) service_pool.cc:224] Handling call
0709 13:09:31.139403 (+1908162us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54000dc0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:31.139524 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853997312}
I20260709 13:09:31.146997 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.149308 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.153065 26760 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:31.153770 27315 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:31.149257 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:31.087414 32527 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:31.143810 31934 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.180918 27313 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:31.157737 26758 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:31.176476 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.187091 26610 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.175210 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.179454 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.099352 32148 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.151314 32496 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:31.169853 32586 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:09:31.177963 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.244740 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:31.200562 26606 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:31.244069 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.248549 26607 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:31.152081 31877 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:31.173264 32250 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:31.251688 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:31.264545 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 89398.8us
W20260709 13:09:31.264676 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102945us
I20260709 13:09:31.265208 26685 raft_consensus.cc:2410] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:31.252343 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.265872 26683 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:31.265966 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.263700 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 85774.7us
I20260709 13:09:31.269481 26758 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:31.272715 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:31.240245 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 91079.1us
I20260709 13:09:31.252815 26603 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
W20260709 13:09:31.253146 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.253607 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.256157 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.256937 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.276232 26686 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:31.258630 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.259270 26611 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:31.280409 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:31.280787 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.280946 26611 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:31.283057 26609 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:31.197724 31815 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:31.181190 32535 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:31.284392 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.285152 26604 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:31.273989 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.285758 26758 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:31.285842 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.286650 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.287158 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:31.287171 26758 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:31.158689 32495 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:31.176146 32462 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:31.261545 26610 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:31.247851 32548 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:31.296067 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.296303 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.273342 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:31.273934 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.297093 26760 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:31.277057 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.298458 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.290586 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.299455 26603 raft_consensus.cc:2410] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:31.299798 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:31.300201 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.300649 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.300966 26761 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:09:31.301246 26605 raft_consensus.cc:2368] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:31.299434 26610 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:31.291738 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:31.301271 26686 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 10.
I20260709 13:09:31.259929 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.292708 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.201982 32412 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:31.171849 32417 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:09:31.303277 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:31.324352 32516 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:31.324771 26753 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:31.324946 32516 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:31.325840 32516 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.304545 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.328536 31877 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.246443 32555 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:09:31.245349 32476 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:31.197943 32249 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:09:31.332188 31877 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.389107 31877 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.323915 32584 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.382323 26753 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:31.202590 32475 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:09:31.257438 32496 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.392212 32496 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.391952 32584 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.394299 32584 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.394788 32584 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.241470 32567 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:09:31.304684 32548 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.397308 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.398075 26759 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:31.398839 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:31.401544 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3418) took 1442 ms. Trace:
I20260709 13:09:31.290342 31752 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:31.402354 31752 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:31.402868 31752 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.402799 32496 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.405889 32558 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.354188 32556 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:09:31.407528 32509 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 2.311s	user 0.002s	sys 0.008s
I20260709 13:09:31.408702 32496 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.409587 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.410853 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.381573 32138 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:31.412117 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 677) took 2595 ms. Trace:
I20260709 13:09:31.412601 32481 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:31.413573 32481 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:31.197870 32435 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.414108 32481 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:31.414677 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3413) took 1457 ms. Trace:
I20260709 13:09:31.177054 32404 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:09:31.412469 26678 rpcz_store.cc:276] 0709 13:09:28.816956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.817064 (+   108us) service_pool.cc:224] Handling call
0709 13:09:28.817408 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:28.833437 (+ 16029us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:28.833468 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:28.840399 (+  6931us) log.cc:844] Serialized 52 byte log entry
0709 13:09:28.929718 (+ 89319us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:28.929761 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.929842 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.406779 (+2476937us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:31.411805 (+  5026us) raft_consensus.cc:1685] finished
0709 13:09:31.411829 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.412055 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":790618,"raft.queue_time_us":16185,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12177,"spinlock_wait_cycles":21037312,"thread_start_us":11709,"threads_started":1,"wal-append.queue_time_us":112809}
I20260709 13:09:31.180912 32538 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:09:31.180770 32474 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.152s
I20260709 13:09:31.379216 32417 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:31.323058 32482 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:09:31.329285 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.331586 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:31.439435 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 108142us
I20260709 13:09:31.268769 31929 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:31.447361 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.344012 32462 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:31.289122 31815 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.415056 26682 rpcz_store.cc:276] 0709 13:09:29.957216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.329290 (+372074us) service_pool.cc:224] Handling call
0709 13:09:30.329645 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.428361 (+ 98716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.428393 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.432509 (+  4116us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.603683 (+171174us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:30.603749 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.414304 (+810555us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54001da954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:31.414348 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.414394 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:31.414409 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.414619 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226368896,"thread_start_us":144845,"threads_started":1,"wal-append.queue_time_us":219049}
I20260709 13:09:31.417563 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:31.454310 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.455022 26682 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:31.417610 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.391876 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.457947 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.360791 32418 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:31.464749 31929 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:31.465101 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.465763 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.465927 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.466367 26608 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:31.466948 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.467159 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.467571 26609 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 9.
I20260709 13:09:31.451455 32459 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.468227 32459 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.468343 32577 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:31.468820 32459 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.345615 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.470256 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.459398 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.429531 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.464797 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:31.401911 26679 rpcz_store.cc:276] 0709 13:09:29.959056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.332743 (+373687us) service_pool.cc:224] Handling call
0709 13:09:30.333028 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.536807 (+203779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.401350 (+864543us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400127fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:31.401494 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467115904}
I20260709 13:09:31.431955 26612 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:31.468920 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.471716 26603 raft_consensus.cc:1217] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:09:31.472498 26603 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:09:31.386930 32560 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:31.395399 32491 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:31.444499 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72863.2us
W20260709 13:09:31.480942 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.481513 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:31.289978 32492 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:31.449484 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:31.486716 26753 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.386509 32537 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.361548 32574 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.452347 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.442559 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.323696 32589 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:31.395220 32584 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.463092 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:31.467846 26608 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:31.470716 26687 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:31.470893 26605 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:31.471501 26678 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:31.418744 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:31.496541 26755 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:31.474571 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.375274 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3419) took 1416 ms. Trace:
I20260709 13:09:31.373816 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.505337 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.481843 26612 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:31.506165 26681 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:31.500937 26682 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:31.501858 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.503144 26678 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:31.509843 26678 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:31.482133 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.511885 26753 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:31.512111 26606 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 13: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:31.505260 26680 rpcz_store.cc:276] 0709 13:09:29.959341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.333627 (+374286us) service_pool.cc:224] Handling call
0709 13:09:30.333907 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.394127 (+ 60220us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:30.566536 (+172409us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.676006 (+109470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:30.676071 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:30.676117 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.946092 (+269975us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b180047f560. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:31.375035 (+428943us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54000b4d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:31.375081 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.375216 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39336,"prepare.queue_time_us":237422,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":37011,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":108,"spinlock_wait_cycles":160748544,"thread_start_us":215390,"threads_started":2,"wal-append.queue_time_us":109438}
I20260709 13:09:31.513375 26680 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:31.515313 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.516541 26679 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:31.518498 26685 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:31.483033 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:31.444265 32417 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.484254 26724 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:31.525570 26686 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:31.489759 26609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:49434
I20260709 13:09:31.561084 26609 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.561470 26609 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.494280 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:31.496973 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.519349 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 76909.8us
W20260709 13:09:31.562539 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68373.4us
I20260709 13:09:31.468855 32577 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:31.519430 26610 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:31.524087 26682 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:31.485383 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.415056 32481 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.565114 26611 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.492962 32492 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.559592 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.560135 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:31.516018 31929 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:31.538278 32566 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:31.574682 32566 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.575074 32566 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.329828 32497 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:31.559628 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.581339 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:31.560822 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.564354 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.582690 26603 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.498842 32590 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:31.594039 26761 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 12: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:31.599076 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:31.597077 26724 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:31.593660 32583 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.077s	user 0.000s	sys 0.008s
I20260709 13:09:31.571202 32589 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.579957 32492 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:31.504664 32537 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.733661 26609 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.600106 32538 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:31.602861 32462 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:31.608589 32577 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.573731 31531 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:09:31.604279 32061 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:31.567407 32501 raft_consensus.cc:2804] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:31.750005 26611 raft_consensus.cc:1240] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:31.776531 32590 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.515247 32418 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:09:31.753259 26603 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
W20260709 13:09:31.766480 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.773618 31934 consensus_meta.cc:287] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.007s
I20260709 13:09:31.776037 32481 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:31.758127 32486 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.178s	user 0.001s	sys 0.006s
I20260709 13:09:31.749271 32412 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:31.791301 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 499622us
W20260709 13:09:31.784096 32386 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.008s
I20260709 13:09:31.753257 26608 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:31.776994 32589 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:31.873529 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:31.882414 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.015s	sys 0.026s
W20260709 13:09:31.894620 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.015s	sys 0.026s
I20260709 13:09:31.894913 26603 raft_consensus.cc:2368] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
W20260709 13:09:31.894938 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 602650us
I20260709 13:09:31.914691 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.915822 26603 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:31.886054 32433 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.918067 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 354921us
I20260709 13:09:31.895761 32412 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:31.920053 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:31.903785 32555 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.925868 26603 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:09:31.927583 26608 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:09:31.906921 31815 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.929760 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:31.930436 26603 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:09:31.895586 32590 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:31.926600 32555 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.939821 32584 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:31.964706 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.965816 26603 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:31.948153 32555 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.926085 32433 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:31.972879 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.974225 26608 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:31.992506 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:31.993398 26610 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
W20260709 13:09:31.994776 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 397752us
W20260709 13:09:31.989477 31877 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.003s
W20260709 13:09:31.991796 31752 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.588s	user 0.004s	sys 0.012s
I20260709 13:09:32.006757 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:32.002964 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.001191 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.006898 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.976614 32584 consensus_queue.cc:1059] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:32.013607 26576 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:31.990140 32566 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.009831 32601 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:32.023968 32601 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:32.024897 32601 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.026152 32601 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.012995 32415 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:32.028456 32597 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:32.008203 31752 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:32.030455 32596 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:32.033685 32417 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.006145 32537 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.004144 31877 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.012914 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.039149 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:32.054157 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.057004 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44150us
I20260709 13:09:32.017266 32496 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.019874 31815 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:32.068296 31815 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:32.030663 31752 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.059675 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.077000 27313 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:32.059952 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:32.086788 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.099501 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.027493 32412 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.058348 32496 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.061170 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.061693 27320 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:32.062271 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:32.062800 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.064610 32566 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.068790 32548 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.128099 32474 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:32.128599 32474 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:32.129110 32548 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:32.129464 32474 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.130642 32474 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:32.132081 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.132184 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 713485us
W20260709 13:09:32.132862 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.133216 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.133613 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.133383 32555 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:32.134052 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.135070 32249 raft_consensus.cc:476] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:32.071290 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.135627 32249 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:32.069566 32537 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:32.136050 32249 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:32.136243 32537 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.136528 32249 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.136715 32537 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:32.069774 32538 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.058444 32501 raft_consensus.cc:697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.041883 32061 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.112709 26607 raft_consensus.cc:1240] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:09:32.113867 32599 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:09:32.114833 31815 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.110291 32496 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.122133 26608 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:32.122846 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.123008 26609 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.123587 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.123981 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.133540 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.135757 32492 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.066751 31877 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.154668 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:32.192387 32061 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.192754 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:32.193693 26686 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:32.194799 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:32.157197 26758 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:32.159739 31542 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.197300 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 136263us
I20260709 13:09:32.197894 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.198691 26761 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:32.199086 26761 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.160137 26682 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:32.060528 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.201865 26610 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:09:32.201925 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 124813us
W20260709 13:09:32.186786 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.136904 32552 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:09:32.203207 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.195523 26686 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.203812 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:32.204638 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:32.205336 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.206753 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.196740 31542 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.196488 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.154830 32555 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.210664 26611 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:32.218132 26611 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:32.215160 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:32.211567 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 301554us
I20260709 13:09:32.200997 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:32.221007 26682 raft_consensus.cc:3060] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.222821 26686 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
W20260709 13:09:32.216334 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 297522us
W20260709 13:09:32.217630 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86622.8us
I20260709 13:09:32.228098 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.210093 32567 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:32.233258 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.233587 26682 raft_consensus.cc:2468] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:32.234144 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.237072 26607 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:32.226263 26761 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.238330 31542 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.239949 26761 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:32.160480 32551 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:09:32.244470 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.244988 31542 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.244971 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.245345 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.249372 27313 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:32.210197 32465 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:32.248371 27320 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:32.249060 31542 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.249435 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.209924 32613 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.230283 32548 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.249679 31934 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:32.191658 31752 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:09:32.251341 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.238143 32491 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:32.238783 32566 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.283027 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:32.282853 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 73211.3us
I20260709 13:09:32.212726 32477 consensus_queue.cc:1059] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:09:32.286100 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:32.272445 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 68721.7us
I20260709 13:09:32.253628 27314 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:32.270979 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:32.271075 27319 raft_consensus.cc:1240] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:32.256107 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.286347 31542 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:32.253242 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.288333 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.290783 26684 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:32.236176 32516 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:09:32.293239 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:32.304224 26761 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:32.301906 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.237933 32567 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.319727 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.238300 32415 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:09:32.271281 31934 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.286023 32609 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:32.315354 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.278095 32555 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.324299 26610 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:32.287964 32332 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:32.310804 32491 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:32.305768 32476 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:32.329759 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90236.9us
I20260709 13:09:32.346414 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:32.375156 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.375200 27313 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:32.316093 32621 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.320454 32465 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:32.381770 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:32.377151 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 68304.1us
I20260709 13:09:32.316331 32552 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:32.389858 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.330896 31934 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:32.271214 32538 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:32.408597 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 125940us
I20260709 13:09:32.411038 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.342321 32548 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:32.317881 31531 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:09:32.317993 31877 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:32.413262 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.378980 32418 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.306465 32610 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:09:32.377611 32462 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:32.387342 32465 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:32.319222 32428 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:32.289561 32501 consensus_queue.cc:237] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.413669 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:32.417912 32616 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:09:32.326378 31752 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.069s
W20260709 13:09:32.396044 32459 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.000s
I20260709 13:09:32.433538 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.455938 27313 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
W20260709 13:09:32.440498 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50845.4us
W20260709 13:09:32.458093 26757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2089) took 1600 ms (client timeout 1778 ms). Trace:
I20260709 13:09:32.438555 32548 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:32.409094 32481 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:09:32.408596 32552 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.414654 32574 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:32.393574 32590 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:09:32.475807 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.391786 32609 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:32.425731 32418 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:32.381027 32476 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:32.458537 26757 rpcz_store.cc:269] 0709 13:09:30.858097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.876364 (+ 18267us) service_pool.cc:224] Handling call
0709 13:09:32.457931 (+1581567us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5400227254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:32.458039 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6707584}
W20260709 13:09:32.456949 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 130591us
W20260709 13:09:32.460142 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 70504.6us
I20260709 13:09:32.466702 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.484712 26726 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.434445 32465 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:32.452019 32600 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:09:32.476749 26607 raft_consensus.cc:2410] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:09:32.460763 32603 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:09:32.455178 32629 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:32.482797 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.392100 32621 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.486595 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2203) took 1067 ms. Trace:
I20260709 13:09:32.487478 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.490942 26685 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:32.492818 26761 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:32.491904 26756 rpcz_store.cc:276] 0709 13:09:31.419736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.420978 (+  1242us) service_pool.cc:224] Handling call
0709 13:09:31.438308 (+ 17330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.438694 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:31.438723 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.439160 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.924049 (+484889us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:31.924091 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.924169 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.486394 (+562225us) raft_consensus.cc:1685] finished
0709 13:09:32.486412 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.486543 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9688,"thread_start_us":430605,"threads_started":1,"wal-append.queue_time_us":619474}
I20260709 13:09:32.439612 32462 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.472090 32492 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.477252 32516 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.497051 26726 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.457414 32459 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:32.491796 32617 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:09:32.514557 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.491159 32630 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:32.513120 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:32.528223 32619 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:09:32.505919 32610 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:32.530052 32626 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:09:32.530896 32614 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:09:32.531458 32615 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:09:32.532266 32567 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.536804 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.510341 32629 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:32.538378 32577 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.510056 32061 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:32.525466 32609 raft_consensus.cc:2804] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:32.541581 32625 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:09:32.544055 32627 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:09:32.545698 32552 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.546456 32433 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.602710 26609 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:32.592299 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.483583 32418 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.555357 26761 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:32.529031 32628 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:32.556989 26753 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:32.557389 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44368.4us
W20260709 13:09:32.557932 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.483743 32417 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:09:32.620904 32249 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.621451 32595 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:32.621815 32598 raft_consensus.cc:3055] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:32.622212 32598 raft_consensus.cc:740] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:32.560292 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 146750us
I20260709 13:09:32.623811 32611 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:32.624200 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.624621 32459 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.625207 32459 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:32.623147 32598 consensus_queue.cc:260] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.531250 32496 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.625931 32598 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:32.626776 32602 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.598s	user 0.001s	sys 0.000s
I20260709 13:09:32.627537 32496 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.599916 32061 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.567992 26606 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:32.629181 32061 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.629948 32613 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.568010 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.545742 32621 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.576920 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:32.562852 32492 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:32.581696 32465 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.573599 31934 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:32.583175 32589 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.002s
I20260709 13:09:32.556722 32610 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.488955 32548 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.549769 32516 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.630659 32249 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.631471 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2206) took 1210 ms. Trace:
I20260709 13:09:32.639849 27313 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:32.631965 26607 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:32.625847 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.602528 32462 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.611404 26576 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:32.643251 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:32.632557 26681 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:32.635267 31934 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.644933 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.645236 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.686017 27316 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:32.686133 27320 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:32.625847 32629 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.646024 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.646438 32433 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:32.640132 26759 rpcz_store.cc:276] 0709 13:09:31.420800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.435101 (+ 14301us) service_pool.cc:224] Handling call
0709 13:09:31.454358 (+ 19257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.454721 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.454750 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.455190 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.936629 (+481439us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:31.936698 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.936788 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.626233 (+689445us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:32.631171 (+  4938us) raft_consensus.cc:1685] finished
0709 13:09:32.631192 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.631412 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5339,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"spinlock_wait_cycles":20337920,"thread_start_us":373027,"threads_started":1,"wal-append.queue_time_us":526698}
I20260709 13:09:32.646880 32441 raft_consensus.cc:3055] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:32.598475 32537 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.624195 32611 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:32.647557 32496 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:32.628500 32250 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:32.653851 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.656334 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:32.656813 32632 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:32.634690 32589 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.695421 32496 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.702387 32496 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.695781 32574 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.703203 32574 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.704272 26603 raft_consensus.cc:2368] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:09:32.609154 32609 raft_consensus.cc:697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:32.661978 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:32.666216 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:32.666733 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55409.9us
I20260709 13:09:32.710604 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.711236 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.711259 26606 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:32.711727 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.712555 26753 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.635293 32610 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.671365 32418 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.740448 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.741271 26609 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:32.742012 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.742403 32418 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.742995 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.743336 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.638450 32491 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:32.744159 26611 raft_consensus.cc:2393] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:32.744347 32491 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.744915 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.745004 32491 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:32.745509 26611 raft_consensus.cc:2376] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10. Re-sending same reply.
I20260709 13:09:32.745635 32491 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.639695 32516 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.687927 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:32.746304 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.697049 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.694516 32250 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:32.697856 32611 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.688401 32459 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:32.718191 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.695420 32433 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:32.719247 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:32.722326 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.690009 32441 raft_consensus.cc:740] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:32.735181 32474 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.001s
I20260709 13:09:32.735939 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.736655 26754 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:32.735267 26607 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:32.730197 32462 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.738346 31934 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.739213 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.740058 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.693380 32492 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:32.634452 32465 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.688580 27321 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:32.743589 26609 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:32.750116 26611 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:32.753028 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.754709 26606 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:32.757494 27315 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
W20260709 13:09:32.758433 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 61504.9us
I20260709 13:09:32.772907 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.735862 32574 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.770053 26684 raft_consensus.cc:2410] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:32.774334 32250 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.775501 32250 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.770179 32459 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:32.776752 32459 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.773000 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.781814 26575 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.782814 27314 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:32.783164 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.783687 26753 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:32.763239 32610 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.787429 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.761008 32640 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.768024 32577 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:32.790767 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.790089 32548 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:32.797475 32548 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.795953 32441 consensus_queue.cc:260] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.797905 32548 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:32.798446 32441 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:32.800454 32643 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:32.806030 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:32.808792 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.809463 26608 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:32.811386 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.785279 32435 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:32.812491 26606 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:32.813026 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.793865 32630 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:32.859318 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.794023 32577 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.783787 31934 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.781919 32492 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.788378 32574 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.860185 26608 raft_consensus.cc:2368] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
I20260709 13:09:32.803696 32491 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.860466 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.867276 26606 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:32.868098 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.868775 26606 raft_consensus.cc:2368] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:32.869446 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.796765 32611 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:32.874011 26608 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:32.861060 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.875600 26612 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:32.781941 32462 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.877913 32462 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:32.870224 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.863854 32537 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:32.861838 32577 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:32.880300 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.881763 32589 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:32.882311 26607 raft_consensus.cc:2368] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
W20260709 13:09:32.885440 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.886004 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.856892 32640 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:32.887560 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.832163 32332 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:32.856721 32555 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.905157 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.905869 26603 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:32.906698 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.907320 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.907845 26612 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:32.908607 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:32.909281 26612 raft_consensus.cc:2376] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12. Re-sending same reply.
I20260709 13:09:32.910113 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:32.925671 26755 raft_consensus.cc:1240] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:32.928998 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 117724us
I20260709 13:09:32.929797 26575 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:32.930802 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.931553 26753 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:32.896839 32640 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:32.933265 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.864702 32404 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:09:32.936390 32495 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.937465 32495 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:32.939740 32496 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:32.940186 32496 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.940548 32496 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:32.941092 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.943050 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.943701 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:32.943817 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.899312 32332 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.944638 26759 raft_consensus.cc:2393] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:32.946043 26753 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:32.952021 27313 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:32.952178 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.934880 32640 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.933594 32555 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:32.957252 32555 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.959024 26758 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:32.960677 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:32.961457 27321 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:32.863209 32433 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:32.970422 32607 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.741s	user 0.001s	sys 0.000s
I20260709 13:09:32.971031 32332 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:32.973644 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.809201 32609 consensus_queue.cc:237] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:32.974323 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:32.975191 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.975325 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:32.976054 26758 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:32.976086 26756 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:32.978334 27313 pending_rounds.cc:85] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 11
I20260709 13:09:32.959450 32555 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:32.978622 27313 pending_rounds.cc:107] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:09:32.978931 27313 raft_consensus.cc:2889] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.945231 32589 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.985363 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:32.986212 26757 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.990074 32548 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.990953 32640 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:32.996919 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:32.987239 32589 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.988605 32558 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:33.060779 26612 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:33.004760 32610 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:33.005081 32412 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:33.004405 32629 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:33.094408 32496 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.095170 32610 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.097258 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.097627 32610 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:33.098302 32610 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:33.098681 32610 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:33.099088 32610 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:33.102386 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.093101 32640 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.103047 27321 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:33.015254 32589 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.106884 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.109727 26757 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:33.110497 26758 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:33.058658 32558 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.111279 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:33.107594 26611 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:33.112301 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.115815 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.117587 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.118997 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.120563 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.121402 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.123627 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:33.125016 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.126165 26611 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.126742 26608 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:33.127162 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:33.124382 27312 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:33.134362 27321 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:33.135773 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:33.140153 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.141017 26608 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:33.141860 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.143994 32433 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:33.144780 32433 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.146313 26611 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:33.145941 32433 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.147555 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.148401 26611 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:33.148451 32482 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:33.151998 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.117455 32558 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:33.149032 32482 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:33.123936 32412 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:33.156674 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:33.118080 32640 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:33.135813 32609 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:33.160434 26611 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:33.165378 32482 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.166330 32577 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.170660 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.172719 32404 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:33.174352 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.179208 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.159960 32412 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.183542 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.185022 26611 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:33.181732 32496 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.194726 27314 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:33.186008 32412 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:33.182873 32609 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:33.196659 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.188414 32482 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:33.170892 32640 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.185540 32332 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.199622 32414 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:33.242410 26606 raft_consensus.cc:2393] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:33.242470 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2205) took 1822 ms. Trace:
W20260709 13:09:33.244400 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47803.1us
I20260709 13:09:33.243516 26760 rpcz_store.cc:276] 0709 13:09:31.420466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.422741 (+  2275us) service_pool.cc:224] Handling call
0709 13:09:31.423125 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.921204 (+498079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.921286 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.921984 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.190844 (+268860us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:32.190881 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.214542 (+1023661us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400226d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:33.214589 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.214640 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:33.214659 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.242399 (+ 27740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1358,"raft.queue_time_us":130449,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4170,"spinlock_wait_cycles":851409280,"thread_start_us":373536,"threads_started":2,"wal-append.queue_time_us":347051}
I20260709 13:09:33.250415 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.251228 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:33.208961 32414 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.254125 26756 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:09:33.256264 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.254827 26760 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:33.255475 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:33.260155 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.241202 32555 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:33.261914 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:33.266268 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:33.252780 32653 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:09:33.265614 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:33.269766 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.269795 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.272049 32435 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:33.272243 32666 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:33.272732 32666 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:33.273068 32666 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.274315 32577 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:33.274959 32574 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.275192 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.275839 27313 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.276279 32462 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:33.276674 32462 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:33.277215 32462 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:33.276710 32612 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:33.272989 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:33.280208 26758 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.259078 32414 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:33.282236 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:33.296059 27313 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:33.282950 32612 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:33.297600 27315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 655) took 1235 ms. Trace:
I20260709 13:09:33.300577 27315 rpcz_store.cc:276] 0709 13:09:32.059573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.059725 (+   152us) service_pool.cc:224] Handling call
0709 13:09:33.295094 (+1235369us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:33.295196 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538470144}
W20260709 13:09:33.302377 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.302899 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.292590 32548 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:33.300408 32660 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:09:33.300742 32459 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:33.318768 26758 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:33.301266 32435 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.298251 32574 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:33.326375 32459 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:33.386058 32459 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:33.389068 31929 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.389628 31929 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.293362 32609 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.355342 32640 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.360337 32435 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.361295 26609 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:33.342229 32612 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.362766 32610 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.368408 32667 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:33.429206 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.374156 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.429710 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.429771 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.374898 32332 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.396510 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:33.432775 27315 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:33.398341 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.433284 27313 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:33.418099 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.370954 32632 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:33.442461 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133330us
W20260709 13:09:33.450397 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.450814 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.451432 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.491953 27313 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:33.402172 31929 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.493407 26575 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:33.433548 32667 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.433012 32577 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:09:33.512099 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 230044us
I20260709 13:09:33.439069 32666 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.518431 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.501726 32548 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:33.561312 32332 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:33.602036 26606 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:33.594890 32607 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:33.507579 32412 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.590838 32640 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:33.589453 32414 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.565466 32574 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:09:33.674641 26606 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:09:33.687614 32658 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.579s	user 0.000s	sys 0.002s
I20260709 13:09:33.688813 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2115) took 1618 ms. Trace:
I20260709 13:09:33.691313 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2194) took 1563 ms. Trace:
I20260709 13:09:33.689277 26605 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:09:33.691650 26754 rpcz_store.cc:276] 0709 13:09:32.070859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.070982 (+   123us) service_pool.cc:224] Handling call
0709 13:09:33.688568 (+1617586us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003f16d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:33.688739 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364587264}
I20260709 13:09:33.633698 32548 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.691905 26610 rpcz_store.cc:276] 0709 13:09:32.127986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.202631 (+ 74645us) service_pool.cc:224] Handling call
0709 13:09:32.227488 (+ 24857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.332325 (+104837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.691011 (+1358686us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b5400065254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:33.691241 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221892864}
I20260709 13:09:33.575682 32589 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.589370 32558 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:33.688835 32669 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:09:33.665650 32332 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:33.707305 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.707401 26603 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:33.715364 26603 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:33.716549 26603 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:33.693706 32640 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.727983 26608 raft_consensus.cc:2368] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20.
I20260709 13:09:33.731364 32495 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:33.731851 32610 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:33.732658 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.733253 26610 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:33.709187 31877 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:33.734445 31877 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:33.734791 31877 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:33.735594 31877 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.736827 31877 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.737614 32497 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:33.706665 31531 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:09:33.739701 32674 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:09:33.743134 32555 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:33.746466 32414 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.747692 32492 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:33.748993 32412 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
W20260709 13:09:33.751317 32656 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.558s	user 0.001s	sys 0.001s
I20260709 13:09:33.713892 32332 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:33.756673 32332 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.757952 32332 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:33.760170 32679 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:33.761094 31934 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:33.657445 32462 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.769593 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3382) took 2305 ms. Trace:
W20260709 13:09:33.774394 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 256011us
I20260709 13:09:33.636871 32667 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.771370 26604 rpcz_store.cc:276] 0709 13:09:31.463974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.464096 (+   122us) service_pool.cc:224] Handling call
0709 13:09:31.472333 (+  8237us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.472700 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.472730 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:31.483928 (+ 11198us) log.cc:844] Serialized 52 byte log entry
0709 13:09:31.939288 (+455360us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:31.939345 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.939442 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.510778 (+571336us) raft_consensus.cc:1685] finished
0709 13:09:32.510802 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.767649 (+1256847us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b540003edd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:33.769502 (+  1853us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":11702,"spinlock_wait_cycles":18135296,"thread_start_us":454893,"threads_started":1,"wal-append.queue_time_us":593056,"wal-append.run_cpu_time_us":4508,"wal-append.run_wall_time_us":1486366}
I20260709 13:09:33.788033 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.788811 26604 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:33.788827 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.790026 27314 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:33.781061 26610 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:33.784902 32558 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:33.803067 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.803910 26606 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:33.802498 32613 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.822669 26604 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:33.824121 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:33.815676 32667 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:33.829273 26759 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:09:33.762877 32476 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.840526 26759 pending_rounds.cc:85] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 8
I20260709 13:09:33.840965 26759 pending_rounds.cc:107] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:09:33.841313 26759 raft_consensus.cc:2889] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.826701 26754 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:33.849972 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:33.851866 26757 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:33.852116 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:33.852679 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:33.839322 26604 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:33.853533 27314 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:33.861804 26752 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:33.819196 32548 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:33.838821 32613 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:33.847512 32666 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:33.859122 32577 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:33.877086 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 1.21082e+06us
I20260709 13:09:33.879623 32570 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:33.883078 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 952381us
I20260709 13:09:33.890214 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.890465 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.890887 26685 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.891208 26684 raft_consensus.cc:2393] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:33.892572 26680 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:33.896407 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.896986 26680 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:33.897846 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.898761 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:33.899124 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.867444 32476 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:33.901674 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.904196 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.905033 26684 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:33.906081 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:33.888332 32482 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.001s
I20260709 13:09:33.928951 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.952940 26684 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:33.953758 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.954267 26684 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:33.931911 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.885989 32570 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:33.934659 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.935206 32481 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:33.935286 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.907707 32546 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.924760 32428 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.937888 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 699) took 1637 ms. Trace:
I20260709 13:09:33.907991 32589 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:33.938812 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.939092 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3464) took 1429 ms. Trace:
I20260709 13:09:33.956995 32570 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.938443 26612 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:33.939121 32474 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:33.969601 26686 rpcz_store.cc:276] 0709 13:09:32.509404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.509526 (+   122us) service_pool.cc:224] Handling call
0709 13:09:32.509788 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.429162 (+919374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.429206 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.429787 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.647993 (+218206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:33.849429 (+201436us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.938819 (+ 89390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.938888 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.938927 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:33.938937 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.939041 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1475642,"prepare.queue_time_us":60744,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1017737,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":1882,"thread_start_us":295025,"threads_started":2,"wal-append.queue_time_us":344013}
I20260709 13:09:33.972186 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.972893 26686 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:09:33.939245 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 54986.3us
I20260709 13:09:33.974736 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.943638 26609 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:33.948232 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.950582 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.950836 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:33.956022 26679 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:33.976833 27314 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:33.986009 27314 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:33.990394 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.992275 26752 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:33.955387 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:33.902873 31752 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.965863 26682 rpcz_store.cc:276] 0709 13:09:32.300540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.300939 (+   399us) service_pool.cc:224] Handling call
0709 13:09:32.301178 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.301360 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:32.323373 (+ 22013us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.387464 (+ 64091us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.391831 (+  4367us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.393634 (+1001803us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b180042fbe0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:33.502821 (+109187us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.937441 (+434620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.937492 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:33.937557 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.937719 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.937832 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1526320,"prepare.queue_time_us":279480,"prepare.run_cpu_time_us":221,"prepare.run_wall_time_us":17133,"raft.queue_time_us":1499319,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":46128,"spinlock_wait_cycles":39061248,"thread_start_us":60277,"threads_started":1}
I20260709 13:09:33.845691 32640 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.024240 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:34.025220 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.957551 32459 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.003s
I20260709 13:09:34.023027 27314 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:09:34.024319 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44477.6us
I20260709 13:09:34.028681 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.942040 32613 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:34.032833 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:33.991561 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:33.957116 32481 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:34.030619 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.033756 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:34.034834 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79544.2us
I20260709 13:09:33.965478 32462 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:34.038318 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.038228 26684 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:34.040356 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.041141 26684 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:34.088917 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:34.090911 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:34.091548 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52291.5us
I20260709 13:09:34.092592 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:34.104758 26761 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:34.104414 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 112938us
I20260709 13:09:34.107899 26761 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:34.036048 32667 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.027637 32664 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:33.969506 32428 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.095175 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:33.967590 32546 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.031306 32567 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:34.039628 32418 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:34.125408 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89766.7us
I20260709 13:09:34.041630 32475 raft_consensus.cc:2764] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:09:34.088904 32249 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:34.126995 26686 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:34.128018 26761 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.044872 32589 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:34.177222 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.241717 26761 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.117925 32667 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.038225 32459 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.208155 26681 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.208765 32535 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.209344 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 101194us
I20260709 13:09:34.209470 32664 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:34.210333 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.032510 32465 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:09:34.093304 32630 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.039052 32551 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:34.109745 32577 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:34.260844 32683 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:09:34.261101 32577 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.261976 32685 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.236996 32418 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:34.104667 32482 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.027164 32474 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.120299 32417 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:34.312393 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.312997 32417 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:34.033985 31752 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.177858 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.239387 26686 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.315685 26679 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:34.251288 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 158745us
I20260709 13:09:34.316514 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.259766 32677 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.217s
I20260709 13:09:34.260381 32594 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.212491 32481 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.268980 26761 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:34.273164 26603 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:34.277820 32577 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.282161 26685 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
W20260709 13:09:34.286026 32657 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.117s	user 0.004s	sys 0.000s
I20260709 13:09:34.325913 26684 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:34.251510 32589 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:34.326318 26685 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:34.289404 32570 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.291394 32667 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.272969 32679 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.296221 32689 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:09:34.300604 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2137) took 1043 ms. Trace:
I20260709 13:09:34.302592 32598 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:34.305512 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3402) took 1311 ms. Trace:
I20260709 13:09:34.355913 26607 rpcz_store.cc:276] 0709 13:09:32.993757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.262950 (+269193us) service_pool.cc:224] Handling call
0709 13:09:33.276017 (+ 13067us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.276348 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.276377 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.276925 (+   548us) log.cc:844] Serialized 52 byte log entry
0709 13:09:34.304362 (+1027437us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18004acce0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1
0709 13:09:34.304535 (+   173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:34.304871 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.305102 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.305177 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.305217 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:34.305307 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.305450 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3086,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":4068,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":9332,"spinlock_wait_cycles":3801472,"thread_start_us":15639,"threads_started":1,"wal-append.queue_time_us":51548}
W20260709 13:09:34.289455 32691 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:34.306586 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3415) took 1210 ms. Trace:
I20260709 13:09:34.361896 26608 rpcz_store.cc:276] 0709 13:09:33.096404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.141612 (+ 45208us) service_pool.cc:224] Handling call
0709 13:09:34.306383 (+1164771us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400353754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:34.306523 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346282752}
I20260709 13:09:34.225224 32567 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.022838 32492 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:09:34.368916 32704 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.322141 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.369431 32704 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.324210 26757 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:34.329288 26686 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:09:34.330693 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.338338 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.340801 32418 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.342384 32695 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:09:34.318266 32435 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:34.323202 32686 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.422s	user 0.001s	sys 0.001s
I20260709 13:09:34.344720 32589 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:34.347440 32663 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.012s	user 0.000s	sys 0.003s
I20260709 13:09:34.348572 32428 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.350678 32622 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.262571 32685 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.438043 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 88502.2us
I20260709 13:09:34.355291 26756 rpcz_store.cc:276] 0709 13:09:33.257388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.257706 (+   318us) service_pool.cc:224] Handling call
0709 13:09:33.257969 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.355736 (+ 97767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.355775 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.355817 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:33.355852 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.300371 (+944519us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400225954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:34.300415 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.300546 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":579,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":223873280}
I20260709 13:09:34.439823 32577 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:34.258671 32535 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.440755 32711 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:34.441176 32711 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:34.360872 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:34.317488 32254 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.372499 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:34.446269 26610 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:34.375061 26680 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:34.401280 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.354451 32481 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.321092 32654 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:09:34.371529 32704 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.360250 32598 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:34.314880 32482 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.421803 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:34.467118 26607 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.365252 32701 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.274230 32630 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.429520 26679 raft_consensus.cc:2410] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:09:34.396325 32567 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:34.408181 31934 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.441994 32711 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.333303 32594 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.519204 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 71033.3us
I20260709 13:09:34.443257 32428 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:34.454545 32254 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:34.409823 32417 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.367801 32664 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.461328 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 100564us
W20260709 13:09:34.462036 32696 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:34.462203 32425 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:34.436990 32412 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.361042 32679 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:34.468935 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.471364 26680 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:34.545734 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.449679 32535 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:34.504912 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3466) took 1994 ms. Trace:
I20260709 13:09:34.415730 32551 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.511449 26610 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:34.547837 26678 rpcz_store.cc:276] 0709 13:09:32.509996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.642128 (+132132us) service_pool.cc:224] Handling call
0709 13:09:32.642416 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.501015 (+858599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.501046 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.759183 (+258137us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:33.759613 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.847509 (+ 87896us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.847558 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.847626 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.473082 (+625456us) raft_consensus.cc:1685] finished
0709 13:09:34.473111 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.504841 (+ 31730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1283412,"raft.queue_time_us":856052,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4651,"spinlock_wait_cycles":8923392,"thread_start_us":68735,"threads_started":1,"wal-append.queue_time_us":136693}
I20260709 13:09:34.517839 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:34.474633 32606 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.531195 26724 leader_election.cc:400] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20.
I20260709 13:09:34.508222 32485 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.562464 32485 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.564119 32709 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:34.564981 32485 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.507786 31929 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.565696 31929 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.568554 31929 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.443406 32622 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.569082 32465 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.569602 32465 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.570737 32622 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:34.541636 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.571712 26686 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:09:34.542486 26684 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:34.572533 26684 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:34.422816 32546 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.551389 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:34.553714 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.573302 26684 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.574198 26650 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.574509 26684 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.575232 32546 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.535000 32249 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:34.575969 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.577474 32709 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:34.577440 32249 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.560696 32425 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.572170 32706 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.579759 32425 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.579845 32706 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.576412 32546 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.579316 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:34.583518 32546 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.590265 26604 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:34.591452 26607 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:34.557590 26724 leader_election.cc:403] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.501636 32700 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:09:34.591614 26684 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:34.597002 26686 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:34.537854 32711 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:34.601435 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:34.598749 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69286.8us
I20260709 13:09:34.594858 26607 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:09:34.604415 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.605062 26681 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:34.591547 26604 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:34.597599 32485 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.606925 32556 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20.
I20260709 13:09:34.596004 32551 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.611248 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 212695us
I20260709 13:09:34.636023 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:34.611341 32482 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.611835 32598 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.645836 32709 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:34.646072 32598 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.647236 32709 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.647645 32709 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:34.648031 32709 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:34.616165 32663 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:34.612670 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.613197 32654 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:34.613826 32594 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.614261 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.669399 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.670447 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.619903 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:34.621186 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:34.622609 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.598829 26684 pending_rounds.cc:85] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:34.627305 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:34.671932 26684 pending_rounds.cc:107] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:34.628762 32667 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:34.629041 32546 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.631048 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:34.678351 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.518821 31934 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.637255 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.559387 32459 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.642591 32574 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.645457 32693 log.cc:927] Time spent T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:09:34.651486 26575 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.613375 32567 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.655532 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:34.658860 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46276.6us
I20260709 13:09:34.712407 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3400) took 1719 ms. Trace:
I20260709 13:09:34.712694 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.667850 26754 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:34.672330 26684 raft_consensus.cc:2889] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.672957 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.712806 26611 rpcz_store.cc:276] 0709 13:09:32.993276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.186945 (+193669us) service_pool.cc:224] Handling call
0709 13:09:33.187286 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.187651 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.187715 (+    64us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.188252 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:09:33.266410 (+ 78158us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:33.299065 (+ 32655us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.299222 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.299272 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.346819 (+1047547us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:34.706580 (+359761us) raft_consensus.cc:1685] finished
0709 13:09:34.712201 (+  5621us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.712357 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47636,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3640,"raft.queue_time_us":13041,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":12667,"spinlock_wait_cycles":4199552,"thread_start_us":60877,"threads_started":1,"wal-append.queue_time_us":101402}
I20260709 13:09:34.547374 32412 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:34.673251 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50777.4us
I20260709 13:09:34.682202 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:34.690550 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.684885 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47689.7us
I20260709 13:09:34.714916 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.670128 31752 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.718937 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.650923 32716 raft_consensus.cc:2764] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:09:34.706084 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.718894 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.720018 26686 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:34.720450 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.721153 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.722035 26686 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:34.722080 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.505885 32701 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.713017 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.729136 26755 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:34.679248 32497 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:34.645200 32551 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.717502 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.722841 26684 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:34.710646 26760 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:34.723831 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.717978 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.725040 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.727039 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.733156 26753 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:34.735533 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:34.736300 26610 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:34.679195 32570 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.733719 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.739938 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.740087 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.732324 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.637735 32485 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.811024 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.601749 32606 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.756312 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:34.811262 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69816.5us
I20260709 13:09:34.710844 32594 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:34.741925 26682 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:34.839560 32594 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.840171 32594 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.841742 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.842403 26682 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:34.843257 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:34.754922 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.843864 32482 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:34.815362 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.739558 32418 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:34.846025 32679 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.846854 32548 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:34.825840 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.741230 32476 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.004s
I20260709 13:09:34.712549 32435 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:34.829386 26685 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:34.833380 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:34.743794 32556 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:34.737915 32552 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:34.729637 32459 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:34.835486 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.866163 32459 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.866796 32459 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.867522 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:34.720032 32574 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:34.870818 26685 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:09:34.839004 32672 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.341s	user 0.006s	sys 0.000s
I20260709 13:09:34.848901 26682 raft_consensus.cc:2393] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:34.826249 26686 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:34.853308 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:34.809926 32699 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:09:34.874759 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:34.876168 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 121334us
I20260709 13:09:34.877733 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:34.680073 32705 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.210s
I20260709 13:09:34.882501 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:34.817126 32566 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:34.896872 26753 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:34.883589 26687 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:34.880470 26755 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:34.830535 32474 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:34.814824 32535 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:34.889438 32546 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:34.816766 32700 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:34.901901 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.849852 32685 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.872382 32418 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:34.848152 32613 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:09:34.891589 32630 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:34.900264 32428 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.888906 32679 consensus_queue.cc:1059] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:09:34.907701 32535 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.916514 32700 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:34.914978 32566 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:34.923456 32546 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:34.905731 32594 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:34.966349 32535 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:34.915619 32621 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.978812 32497 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:34.987885 32700 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.998651 32709 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.003466 32706 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.011113 32700 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:35.012639 32717 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.445s	user 0.000s	sys 0.002s
W20260709 13:09:35.014300 32658 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.601s	user 0.002s	sys 0.000s
W20260709 13:09:35.017864 32719 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 13:09:32.895058 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:35.063545 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 411971us
W20260709 13:09:35.071362 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.065966 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 353217us
I20260709 13:09:35.077255 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.081128 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.097430 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.089110 26502 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 15, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 15 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.104815 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.090054 32738 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:35.119069 32738 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.121363 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2168) took 1226 ms. Trace:
W20260709 13:09:35.121865 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 244049us
I20260709 13:09:35.122293 26685 raft_consensus.cc:1275] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:09:35.122946 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 240407us
I20260709 13:09:35.124599 26684 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:35.129642 26679 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:09:35.136288 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 307297us
I20260709 13:09:35.123306 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2165) took 1231 ms. Trace:
I20260709 13:09:35.140877 26686 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:35.104630 26502 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 6 to 8, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 8 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.150158 32738 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:35.154294 32738 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.159857 32546 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.160949 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.162866 32630 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.939757 32332 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.181s	user 0.014s	sys 0.000s
I20260709 13:09:35.163792 32630 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.164769 32332 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.165360 32476 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:35.166015 32476 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.165669 32332 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.166525 32476 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.168596 26758 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:35.168821 32654 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:34.973812 32435 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.170034 32654 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:34.939368 32428 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:35.176775 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.178929 32418 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.180619 32412 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:35.182236 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.182880 32638 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.183063 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 78593.5us
I20260709 13:09:35.163491 32404 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:35.150040 26505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 214) took 50074 ms (client timeout 15000 ms). Trace:
I20260709 13:09:35.195104 32598 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.194991 32566 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.196390 32711 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.997249 32621 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.199733 32594 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.200384 32638 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.159312 32606 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.202092 26757 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:35.199759 32567 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.163592 32497 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.203835 32727 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:35.204478 32474 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:35.205075 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3428) took 1440 ms. Trace:
I20260709 13:09:35.234642 32485 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.235608 26606 rpcz_store.cc:276] 0709 13:09:33.764448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.860756 (+ 96308us) service_pool.cc:224] Handling call
0709 13:09:33.861155 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.949584 (+ 88429us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:33.949876 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.112879 (+163003us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.067807 (+954928us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:35.068955 (+  1148us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.069326 (+   371us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:35.069412 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.069573 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.204478 (+134905us) raft_consensus.cc:1685] finished
0709 13:09:35.204606 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.204852 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94797,"prepare.queue_time_us":7189,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":105236,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":63927,"spinlock_wait_cycles":8974080,"thread_start_us":162672,"threads_started":1,"wal-append.queue_time_us":229957}
I20260709 13:09:35.237867 32621 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.205561 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:35.206187 32630 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.152271 26681 rpcz_store.cc:276] 0709 13:09:33.891520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.025983 (+134463us) service_pool.cc:224] Handling call
0709 13:09:35.122796 (+1096813us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400127fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:35.123058 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268140928}
I20260709 13:09:35.208062 32404 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:35.210901 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.211753 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.215790 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56417.7us
I20260709 13:09:35.217075 32475 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:35.218884 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.150334 26680 rpcz_store.cc:276] 0709 13:09:33.894741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.898579 (+  3838us) service_pool.cc:224] Handling call
0709 13:09:35.120789 (+1222210us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400187c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:35.121031 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094176000}
W20260709 13:09:35.240329 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.275300 32711 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.276639 26680 raft_consensus.cc:1275] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:09:35.278543 26678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.010s
I20260709 13:09:35.278712 31934 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:35.279011 26678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.011s
I20260709 13:09:35.271217 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.238729 32598 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.264273 32332 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.284868 26502 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 7 to 10, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:09:35.287536 26502 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 12, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.290045 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.291857 32570 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:35.292089 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 108007us
W20260709 13:09:35.292400 32481 consensus_meta.cc:287] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.837s	user 0.016s	sys 0.001s
I20260709 13:09:35.293116 26680 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:35.293339 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.290697 26502 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.294646 32613 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.296203 31815 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:35.297685 32404 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.299219 32404 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.296150 26502 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 13, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:35.301548 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 140831us
I20260709 13:09:35.295646 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:35.302906 26650 leader_election.cc:400] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:35.295503 32613 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.314460 32613 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.275404 32638 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.279031 32711 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.334108 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3467) took 2823 ms. Trace:
W20260709 13:09:35.346843 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 46530.1us
I20260709 13:09:35.351758 26687 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:09:35.368379 27286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.001s	sys 0.018s
W20260709 13:09:35.368999 27286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.002s	sys 0.018s
I20260709 13:09:35.369138 32612 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:35.369588 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.369505 27312 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:35.371001 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.373399 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.374169 27313 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:35.337363 26502 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.406599 32621 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:35.410005 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:35.412186 32638 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:35.412693 32638 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.413110 32638 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.336699 26683 rpcz_store.cc:276] 0709 13:09:32.510279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.654651 (+144372us) service_pool.cc:224] Handling call
0709 13:09:32.654993 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.501320 (+846327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.501349 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.870940 (+369591us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180036ba40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a
0709 13:09:33.871580 (+   640us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b2c0005c228. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:33.872257 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 13:09:34.120753 (+248496us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:34.228354 (+107601us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.175032 (+946678us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b180036ba40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:35.320899 (+145867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.331254 (+ 10355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.333698 (+  2444us) raft_consensus.cc:1685] finished
0709 13:09:35.333717 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.333893 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":841526,"prepare.queue_time_us":106659,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":981159,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":29336,"spinlock_wait_cycles":31292032,"thread_start_us":315383,"threads_started":2,"wal-append.queue_time_us":337715,"wal-append.run_cpu_time_us":3193,"wal-append.run_wall_time_us":1090478}
I20260709 13:09:35.428493 26681 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:09:35.440440 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48760.8us
I20260709 13:09:35.453480 32589 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.455546 32476 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.469115 32700 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.459206 32476 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:35.491715 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 196312us
I20260709 13:09:35.488247 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.472761 26502 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 12, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 12 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.473640 32709 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.511834 26754 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:35.512084 32711 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.520309 26752 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
W20260709 13:09:35.524690 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 222106us
I20260709 13:09:35.527295 32425 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.527616 26502 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 16, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 16 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.504289 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.499843 32433 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:35.537442 26502 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 10, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.544977 32433 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.548002 26650 leader_election.cc:400] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13.
W20260709 13:09:35.548379 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.550371 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 125392us
I20260709 13:09:35.550726 26650 leader_election.cc:400] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:09:35.552374 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:35.553697 31929 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.545892 26502 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 12, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.554243 31929 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.554814 31929 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.557211 26502 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 13, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 13 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:35.560103 32632 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:35.559520 32482 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:35.567636 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84413.1us
I20260709 13:09:35.568395 26650 leader_election.cc:400] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:35.574975 26650 leader_election.cc:403] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:35.562901 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:35.547407 32433 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.580493 26603 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
W20260709 13:09:35.584396 32459 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.015s
I20260709 13:09:35.584956 32459 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.582518 32574 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.588157 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:35.589342 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.587867 32711 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.590920 32428 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.592082 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:35.594105 26608 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:35.594434 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2216) took 1556 ms. Trace:
I20260709 13:09:35.594794 26758 rpcz_store.cc:276] 0709 13:09:34.037917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.039144 (+  1227us) service_pool.cc:224] Handling call
0709 13:09:34.109493 (+ 70349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.169290 (+1059797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.594210 (+424920us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000db1d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:35.594368 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408671488}
W20260709 13:09:35.596149 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 70447.5us
I20260709 13:09:35.596995 32465 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.597138 26577 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:35.598163 32711 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.591056 32598 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.573796 32632 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:35.616927 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.620056 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:35.620867 26603 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:35.631870 32674 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.632225 32425 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:35.632105 32556 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:35.633229 32556 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.635998 32556 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.638128 32674 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.639902 26756 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:09:35.640007 32677 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:35.640251 26756 pending_rounds.cc:85] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 13
I20260709 13:09:35.640583 26756 pending_rounds.cc:107] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:09:35.640619 32677 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:35.640964 26756 raft_consensus.cc:2889] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.641875 32677 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.649712 32250 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:35.650238 32250 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:35.652344 31929 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.654812 31929 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.655954 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:35.657320 32474 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:35.657852 32474 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:35.658294 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:35.659795 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:35.660775 26761 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:35.661000 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.661974 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3489) took 1017 ms. Trace:
I20260709 13:09:35.662469 26680 rpcz_store.cc:276] 0709 13:09:34.644718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.277977 (+633259us) service_pool.cc:224] Handling call
0709 13:09:35.278408 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.293521 (+ 15113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.661677 (+368156us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54000b4354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:35.661903 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32818560}
I20260709 13:09:35.661616 27312 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:35.666693 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.610491 32459 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.681254 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:09:35.685789 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 131934us
W20260709 13:09:35.688042 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69468.6us
W20260709 13:09:35.691250 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.694871 32667 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:35.696151 27312 raft_consensus.cc:1240] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:35.696328 32612 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.696628 32667 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.697190 32332 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:35.659020 32474 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.697678 32332 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.698015 32474 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.698181 32566 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:35.699000 32667 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.700173 32632 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.651324 32250 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.697033 32612 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:35.701894 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133694us
I20260709 13:09:35.695391 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:35.740199 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.742130 26758 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:35.698094 32332 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:35.746091 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.758071 27315 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:35.690723 31929 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:35.771819 32535 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.004s
I20260709 13:09:35.772363 32535 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.773978 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:35.774523 32535 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.774844 26612 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:35.775349 32535 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:35.776057 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 74148.1us
I20260709 13:09:35.778378 26603 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:35.780669 32701 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.787766 26502 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.793773 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.796929 27319 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:35.798024 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:35.811928 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52314.5us
I20260709 13:09:35.811959 27321 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:35.799290 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 90028.2us
I20260709 13:09:35.805493 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:35.799057 26681 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:35.806490 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:35.819512 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.827445 32738 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.007s
W20260709 13:09:35.818238 32697 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:35.827994 32738 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.828989 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:35.829764 26608 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:35.830348 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.830780 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 716) took 1072 ms. Trace:
I20260709 13:09:35.811324 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.831283 26681 rpcz_store.cc:276] 0709 13:09:34.758225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.452476 (+694251us) service_pool.cc:224] Handling call
0709 13:09:35.798665 (+346189us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400304c28. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f8234ebc 00007f40f826a08c 00007f40f825493b 00007f40f82543d2 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c
0709 13:09:35.798796 (+   131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.826725 (+ 27929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.830710 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64162048}
I20260709 13:09:35.804093 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.806317 32250 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:35.816702 32535 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.834786 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.843555 26680 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:35.832765 32621 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:35.219937 26505 rpcz_store.cc:269] 0709 13:08:45.041380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.041907 (+   527us) service_pool.cc:224] Handling call
0709 13:09:35.115280 (+50073373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:30.598052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:30.619989 (+ 21937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:30.620055 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:09:30.620089 (+    34us) tablet.cc:662] Decoding operations
0709 13:09:30.666610 (+ 46521us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:30.666697 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:30.666725 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:09:30.668161 (+  1436us) tablet.cc:701] Row locks acquired
0709 13:09:30.668205 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:09:30.668386 (+   181us) write_op.cc:270] Start()
0709 13:09:30.668559 (+   173us) write_op.cc:276] Timestamp: P: 1783602570668322 usec, L: 0
0709 13:09:30.668591 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:09:30.669286 (+   695us) log.cc:844] Serialized 6791 byte log entry
0709 13:09:30.873037 (+203751us) op_driver.cc:464] REPLICATION: finished
0709 13:09:31.197669 (+324632us) write_op.cc:301] APPLY: starting
0709 13:09:31.249852 (+ 52183us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:32.120797 (+870945us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:32.120984 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:32.546290 (+425306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:32.546656 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:09:32.546713 (+    57us) write_op.cc:312] APPLY: finished
0709 13:09:32.547193 (+   480us) log.cc:844] Serialized 156 byte log entry
0709 13:09:32.576773 (+ 29580us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:32.576939 (+   166us) write_op.cc:454] Released schema lock
0709 13:09:32.577019 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:32.616813 (+ 39794us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:32.619512 (+  2699us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37767,"reported_tablets":52,"spinlock_wait_cycles":19456,"child_traces":[["op",{"apply.queue_time_us":273307,"apply.run_cpu_time_us":38749,"apply.run_wall_time_us":1448117,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":646751,"prepare.run_cpu_time_us":10937,"prepare.run_wall_time_us":146264,"raft.queue_time_us":116993,"raft.run_cpu_time_us":26993,"raft.run_wall_time_us":164854,"replication_time_us":204264,"thread_start_us":619755,"threads_started":5,"wal-append.queue_time_us":88922,"wal-append.run_cpu_time_us":87054,"wal-append.run_wall_time_us":2141356}]]}
I20260709 13:09:35.853688 31752 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:09:35.856173 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.857275 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.858381 32612 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:35.859329 27313 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:09:35.861269 32589 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:35.841655 27320 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:35.867856 32738 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.868120 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:35.868996 32613 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.869632 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:35.870332 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:35.871065 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:35.802387 31929 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.872603 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.873723 31929 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:35.874327 31929 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.874676 31929 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.874593 32538 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:35.876298 32613 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:35.876427 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.876786 32613 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:35.877110 27319 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:35.877991 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.877770 32613 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.878545 27319 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:35.879177 32613 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.880352 31752 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:35.881283 31752 consensus_queue.cc:1243] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer e09ea9b455894a0189912a7b9b6b2f84 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:35.882130 31752 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:35.882395 31752 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:35.882714 32404 consensus_meta.cc:287] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.010s
I20260709 13:09:35.841427 32535 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.894512 26758 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:35.875392 31929 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.911847 32667 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:09:35.919823 31752 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.921085 31752 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:35.883675 32566 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:35.929656 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.929955 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.930585 26683 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:35.930501 26680 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:09:35.930436 32538 consensus_queue.cc:1048] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:35.931749 32589 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:35.932281 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.932579 32679 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:35.933005 26681 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:35.933252 32433 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:35.937520 32417 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:35.938201 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.939019 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:35.931317 32404 consensus_queue.cc:1048] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:35.936715 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:35.939847 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.931839 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.950225 32598 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:35.952459 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:35.953238 32250 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:35.911370 32612 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:09:35.953779 32250 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:35.954852 32250 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:35.940446 26650 connection.cc:256] RPC call timeout handler was delayed by -3.0454395040000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 13:09:35.958590 32705 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.959262 31752 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.959352 32705 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.959918 31752 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.960428 27286 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.962085 32472 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:35.962373 32598 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:35.962875 32598 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.962634 32472 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.963304 32598 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:35.964061 26683 raft_consensus.cc:2410] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:35.958622 32744 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:35.964574 32744 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.965471 32465 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:35.966089 32465 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.967216 32254 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.967854 32254 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:35.969467 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:35.970432 26650 connection.cc:256] RPC call timeout handler was delayed by -1.4075589119998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:09:35.970441 32741 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.971865 32741 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.972280 32741 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.972489 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.963842 32679 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:35.975594 32705 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.973135 26680 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:35.977015 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:35.981194 32741 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:35.981737 26680 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:35.983299 32741 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:35.971361 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:35.985464 32711 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.985834 32711 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.986172 32711 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.988581 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3493) took 1279 ms. Trace:
I20260709 13:09:35.988986 26684 rpcz_store.cc:276] 0709 13:09:34.708789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.732122 (+ 23333us) service_pool.cc:224] Handling call
0709 13:09:35.940390 (+1208268us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400013bd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:35.988498 (+ 48108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712908160}
I20260709 13:09:35.989828 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:35.990082 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:35.945623 32701 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:35.939469 32538 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:09:35.996778 32474 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:35.999827 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:35.999526 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.998677 26758 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:35.997745 32404 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.003777 26682 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.003722 32404 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.004441 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.005687 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.006171 32404 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:36.006825 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.009133 27319 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:36.009898 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.010742 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:36.011081 32638 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:09:36.011279 26758 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:36.011571 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.012295 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:36.002171 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 91294.4us
I20260709 13:09:36.009898 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:35.919236 32332 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.016191 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.001094 26684 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:36.016014 32701 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.011430 26609 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:36.027459 26680 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:36.003635 32474 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:36.030405 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.031782 27319 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:36.033368 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.033232 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.037263 26684 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.045046 26680 raft_consensus.cc:2393] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:36.027004 32148 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:36.057263 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:36.011525 32638 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.064550 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.067119 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.074653 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.077096 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.083426 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.055207 32741 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.087162 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:36.087914 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 114201us
I20260709 13:09:36.091007 27312 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:36.093262 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.095096 27320 raft_consensus.cc:2410] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:36.087814 32679 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.102510 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:36.104163 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:36.109647 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.108704 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:36.113893 32640 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:36.114087 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.115046 26757 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:36.116305 27285 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:36.117228 32735 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.117651 32735 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.118016 32735 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.121757 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:36.123718 32546 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:36.125080 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.128350 32465 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.129248 32472 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.129264 26757 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:36.130213 32254 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.111002 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:36.134131 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 99739.6us
I20260709 13:09:36.093058 32741 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.142558 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 710) took 1535 ms. Trace:
I20260709 13:09:36.144840 26678 rpcz_store.cc:276] 0709 13:09:34.604495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.604608 (+   113us) service_pool.cc:224] Handling call
0709 13:09:34.604966 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.616941 (+ 11975us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:35.279602 (+662661us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.941094 (+661492us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.946504 (+  5410us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.951461 (+  4957us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.951607 (+   146us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:35.951641 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.951767 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.139770 (+188003us) raft_consensus.cc:1685] finished
0709 13:09:36.139799 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.140001 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64764,"prepare.queue_time_us":366374,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":33476,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":63225,"thread_start_us":1187796,"threads_started":3,"wal-append.queue_time_us":637933}
I20260709 13:09:36.147524 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.148182 32735 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.148906 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.149379 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.149914 26687 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:09:36.150326 26650 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.151610 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.151773 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:36.152416 26687 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:36.153367 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:36.153731 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.096580 32598 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.153934 26687 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:36.140851 32465 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.158619 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.135128 32538 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.157099 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.160698 32425 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.138935 32546 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:36.175904 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.172760 26684 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:36.151173 32735 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:36.173699 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.157689 32417 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.157913 32472 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.177376 32332 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:36.177807   302 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:36.154409 32612 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.155606 32481 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.193007 27319 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:36.194069 27317 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:09:36.204396 27317 pending_rounds.cc:85] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 13
I20260709 13:09:36.204728 27317 pending_rounds.cc:107] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:09:36.205020 27317 raft_consensus.cc:2889] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.162640 32538 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.110754 32497 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:36.136855 32679 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.198200 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.135577 32474 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.195751 32589 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:36.210376 32465 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:36.241652 32756 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.687s	user 0.003s	sys 0.011s
I20260709 13:09:36.245846 32638 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:36.246634 31752 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.207739 32612 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.208699 32538 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.214700 32705 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:36.240959 32481 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.386544 26680 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:36.248891 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.388099 26681 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:36.203658 32425 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:36.280217 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.391136 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2221) took 1656 ms. Trace:
I20260709 13:09:36.247978 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.392171 27316 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.228921 32566 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:36.242775 32546 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.370333 26687 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:36.369199 27314 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:36.391597 26754 rpcz_store.cc:276] 0709 13:09:34.734450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.734621 (+   171us) service_pool.cc:224] Handling call
0709 13:09:34.734914 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.535946 (+801032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.253200 (+717254us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400226d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:36.391068 (+137868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726302464}
I20260709 13:09:36.374176 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3480) took 1731 ms. Trace:
I20260709 13:09:36.374145 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 701) took 1720 ms. Trace:
I20260709 13:09:36.378551 32612 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.390244 31752 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.404013 31752 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.247648 32744 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.395371 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:36.355201 32701 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.399785 26756 rpcz_store.cc:276] 0709 13:09:34.653372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.668802 (+ 15430us) service_pool.cc:224] Handling call
0709 13:09:34.669200 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.641579 (+972379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.249774 (+608195us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400138b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:36.374060 (+124286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230813056}
I20260709 13:09:36.382959 32332 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:36.412480 27312 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:36.383286 32589 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:36.262192 32535 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:36.395601 32613 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.006s
I20260709 13:09:36.417613 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.428946 31752 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.433935 26575 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:36.435068 26575 leader_election.cc:403] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.441556 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.444561 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.445312 26681 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.451493 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.399359 26686 rpcz_store.cc:276] 0709 13:09:34.642400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.173916 (+531516us) service_pool.cc:224] Handling call
0709 13:09:36.146342 (+972426us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b5800105f98. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bf8c 00007f40f016bef6 0000000000375939 00007f40f81df1e0 00007f40f82a80c4 00007f40f82a8131 00007f40f8269fc0 00007f40f8254929 00007f40f82543d2 00007f40f17cbbd4
0709 13:09:36.146467 (+   125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.146755 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:36.147033 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.373822 (+226789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.373889 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:36.373935 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.373998 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.374124 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3429,"prepare.queue_time_us":7876,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4986,"raft.queue_time_us":25485,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7033,"spinlock_wait_cycles":19264768,"thread_start_us":205322,"threads_started":1}
I20260709 13:09:36.464385 32481 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.465660 32735 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:36.465458 32548 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:09:36.468297 32589 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.472033 32491 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:36.472970 32491 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.477345 32535 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:36.482709 32741 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.488483 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.489372 26687 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.492508 26686 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:36.492911 26686 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:36.493794 26686 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.495036 26686 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:36.500272 32711 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.004s
I20260709 13:09:36.500836 32711 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.424042 32566 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.503507 32711 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:36.519879 32677 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.520767 32677 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:36.523802   305 log.cc:927] Time spent T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.274s	user 0.000s	sys 0.008s
I20260709 13:09:36.524035 32632 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.529253 32435 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:36.529996 32435 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.537582 32566 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.540946 32674 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.409116 32332 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:36.550472 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.506145 32535 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:36.547577 31929 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.002s
I20260709 13:09:36.523536 32677 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.552531 32679 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:36.636662 26685 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:36.643297 27316 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:36.629683 26681 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:36.660655 26575 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:36.671005 32677 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:36.609005 32535 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.604872 31929 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.703904 32465 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.704800 26753 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:36.708123 32598 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.709724 27315 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:36.710647 32538 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.712009 32677 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:36.712618 26687 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:36.713279 32677 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.714478 32679 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:36.715003 32679 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.717249 32679 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.727299 26755 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:36.726709 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 714) took 1969 ms. Trace:
I20260709 13:09:36.704244 31929 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.730845 26682 rpcz_store.cc:276] 0709 13:09:34.757648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.448760 (+691112us) service_pool.cc:224] Handling call
0709 13:09:35.945218 (+496458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.004333 (+ 59115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.693525 (+689192us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400013bd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:36.726637 (+ 33112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950212864}
W20260709 13:09:36.735894 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.737126 26684 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:36.711041 32612 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:36.748312 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.749840 27319 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:36.739344 32435 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:36.754490 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.755172 26761 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:36.756628 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:36.749198 32491 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:36.775709 32491 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.776254 32491 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:36.777679 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.755749 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.762377 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.767314 32332 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.770797 27318 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:36.772364 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.772841 32538 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.773721 27316 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:36.784574 26686 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:36.781769 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:36.789554 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:36.790203 26608 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.789958 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:36.791993 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:36.792129 32491 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:36.793116 27321 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:36.808097 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2188) took 2267 ms. Trace:
I20260709 13:09:36.807382 26604 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 2 to 9, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:36.808482 26679 rpcz_store.cc:276] 0709 13:09:34.540481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.541338 (+   857us) service_pool.cc:224] Handling call
0709 13:09:35.128361 (+587023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.151127 (+ 22766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.807878 (+1656751us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5400187c50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:36.808036 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348773248}
I20260709 13:09:36.809857 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:36.825067 26679 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:09:36.827610 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.828681 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 687964us
I20260709 13:09:36.833376 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:36.837968 26612 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:36.838610 32728 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:09:36.839725 32728 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:36.840051 32728 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:36.840639 32535 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.840939 32728 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:36.842789 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.836961 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.843959 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:36.844467 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:36.844990 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.822436 32606 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.821177 32632 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:36.837136 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:36.849098 26686 raft_consensus.cc:2410] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:09:36.836639 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.822995 32612 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:36.848004 26679 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:36.847858 26608 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:36.854524 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 712) took 2097 ms. Trace:
I20260709 13:09:36.829733 32497 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:36.854851 26685 rpcz_store.cc:276] 0709 13:09:34.757040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.384163 (+627123us) service_pool.cc:224] Handling call
0709 13:09:35.440626 (+ 56463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.662784 (+1222158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.854371 (+191587us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000c3fd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:36.854483 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2671091584}
I20260709 13:09:36.861348 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:36.861934 26603 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.847297 32417 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:36.833304 32640 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:09:36.914115 27320 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:36.914330 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46926 (request call id 716) took 1074 ms. Trace:
I20260709 13:09:36.914767 27316 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:36.943092 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.868275 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:36.914892 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:36.944355 26608 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
W20260709 13:09:36.926831 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.834892   316 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:09:36.859817 32728 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.957886 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.954195 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.959237 26685 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:36.864974 32674 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.937103 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.937980   321 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.940588 26607 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:09:36.941407 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79124.8us
W20260709 13:09:36.989254 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 121105us
I20260709 13:09:36.946309 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.947098 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:36.942389 27318 rpcz_store.cc:276] 0709 13:09:35.792736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.797490 (+  4754us) service_pool.cc:224] Handling call
0709 13:09:36.866680 (+1069190us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400642dd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:36.866831 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191480192}
I20260709 13:09:36.955042 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.847143 32556 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:36.958638 26679 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:36.858114 32632 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:37.000254 26678 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:37.002990 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:36.990092 26760 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:37.030730 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.028339 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.033710 31752 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.034212 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:37.035169 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.036226 26753 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:37.006197 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:36.988287 32537 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:37.034317 31752 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.043402 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:37.049868 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:37.051120 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:37.051880 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:36.857072 32606 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.052515 26680 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:37.055884 26678 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:37.006511 32491 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.045009 32537 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:37.056571 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49717.2us
I20260709 13:09:37.068874 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:37.045892 32535 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:09:36.956570 32417 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.082692 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.065448 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.053805 32679 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:37.100744 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:37.073559 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:36.865561 26759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:37.055626 32566 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:37.102145 26759 raft_consensus.cc:606] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.045305 32254 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.007153 32556 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.108536 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:37.119833 26678 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.988782 32538 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:09:37.066833 32537 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:37.123291 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.001509 32674 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.000553 32497 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:37.130990 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57528.1us
I20260709 13:09:37.072474 32465 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:09:37.134860 32606 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:37.135802 32492 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.108678 32566 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.073000 32548 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:09:37.138671   318 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:37.134945   325 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:09:37.143785 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.176678 26760 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
W20260709 13:09:37.143568 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 153632us
I20260709 13:09:37.178506 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.100354 32679 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:37.028116   321 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.098143 32491 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.157829 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.199070 26607 raft_consensus.cc:2410] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:09:37.159423 27284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.882s (SENT) [suppressed 27 similar messages]
I20260709 13:09:37.201591 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:37.202430 26685 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.208530 32249 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.208666   324 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:37.209312   324 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.209681   324 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:37.159309 32566 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:37.124883 32254 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:37.210997 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68595us
I20260709 13:09:37.215061 31752 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:37.218076 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.196010 32679 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:37.227967 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.224804 26576 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.231220 26679 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:37.233142 32674 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:37.234428 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.228789 26760 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:37.144166 32632 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.243021 32497 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:37.219830   322 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:37.181303 32492 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:37.250926 27317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.011s
W20260709 13:09:37.266129 27317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.019s	sys 0.011s
W20260709 13:09:37.273114 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94715.3us
I20260709 13:09:37.240036 32664 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:37.280342 26760 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:37.281817 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.284701 26608 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20. Ops: [18.9-19.10]
I20260709 13:09:37.286813 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.251928 32433 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:37.292692 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:37.303237 27319 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 13:09:37.303058 32250 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:37.303802 27319 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:37.304417 32250 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.330735 26760 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:37.279163 32664 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:37.290086 32404 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:37.337350 27319 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:37.340606 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.326386   322 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:37.359256 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.367216 26760 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:37.326068 32433 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:37.369477 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:37.371229 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 295354us
I20260709 13:09:37.374603 27319 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:37.380720 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.341688 32589 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.342048 32404 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:37.381767 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.333634 32497 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:09:37.401890 26678 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:37.430879 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.439565 27318 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:37.431555 26605 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:37.441720 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:37.448478 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.450922 26678 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:37.424175 32404 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.452387 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.380123 26603 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:37.382061 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.371135   318 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:09:37.425045   322 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:37.392753 32417 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:37.419369 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.505692 31752 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.475872 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 316470us
I20260709 13:09:37.477344 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.508929 26605 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:37.391850 32556 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:37.377408 32148 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:09:37.484705 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.487047 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:37.516158 27314 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:37.488306   322 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.489483   317 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 13:09:37.493379   335 log.cc:927] Time spent T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:37.493824 32332 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:37.533785 32332 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:37.524392 32465 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.534878 32465 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.523887 32664 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.537360 32465 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:37.537881 32465 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:37.497300   321 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:37.500362 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79252.1us
W20260709 13:09:37.510222 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.377126 32674 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:09:37.477985 32640 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.506309 31752 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.518450 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.367600 32250 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:37.524303 26610 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:37.457227 32546 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.527711 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.534725 32332 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.482223 32491 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:37.539469 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.467506 32613 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:37.576251 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.577639 26606 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.580156 26755 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:09:37.580518 26755 pending_rounds.cc:85] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 13
I20260709 13:09:37.580747 26755 pending_rounds.cc:107] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:09:37.580996 26755 raft_consensus.cc:2889] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:37.546922 27320 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.005s
I20260709 13:09:37.592872 32606 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:37.593147 27320 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:09:37.598389   336 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:09:37.598819 32537 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.539587 32474 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:09:37.604171 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.605297 26760 raft_consensus.cc:2410] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:09:37.591007 32332 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.606261 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.608078 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.608827 26610 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:37.571214 32640 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.612309 32492 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:37.613503 26494 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 687d192f79a044ce838f0bf292f0c09f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:09:37.614589 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44945.6us
I20260709 13:09:37.617851 32254 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:37.618469 32679 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.620898 26759 raft_consensus.cc:1240] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:37.604197 32474 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:37.621943 32474 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:37.623008 32474 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.607446 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.629838 26760 raft_consensus.cc:2410] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:37.630505 26685 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:37.634428 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 106451us
W20260709 13:09:37.552489 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 183126us
I20260709 13:09:37.555840 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.539201 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.533102 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3451) took 1971 ms. Trace:
I20260709 13:09:37.514374 26686 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:09:37.561003 26752 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:37.561872 26605 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:09:37.557742 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:37.436592 32589 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.566018 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.567612 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.635648 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.644318 26611 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.556753 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:37.570206 31752 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:37.644542 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 86905.7us
W20260709 13:09:37.645020 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 88356.8us
I20260709 13:09:37.566555 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.646173 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.566355 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.581573 32613 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:37.569275 26603 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:37.574442 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.569871 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.539153 32465 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:37.575855 32546 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.640271 27319 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:09:37.640619   339 log.cc:927] Time spent T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.067s	user 0.001s	sys 0.002s
W20260709 13:09:37.640894   347 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.188s	user 0.000s	sys 0.003s
W20260709 13:09:37.641170   331 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
W20260709 13:09:37.642086   341 log.cc:927] Time spent T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
I20260709 13:09:37.643244 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3512) took 1662 ms. Trace:
I20260709 13:09:37.707540 26608 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:09:37.648327 26606 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:37.651593 26612 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
W20260709 13:09:37.651722 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 85248us
I20260709 13:09:37.637712 26686 pending_rounds.cc:85] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 12
W20260709 13:09:37.639894   332 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:09:37.651257 26726 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:37.686482 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 130694us
I20260709 13:09:37.714625 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.593418 32606 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:37.691126 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.685592 26754 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:37.625844 32474 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.696935 31752 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:37.697839 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:37.737234   321 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.737963   321 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:37.647894   344 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.108s	user 0.002s	sys 0.002s
I20260709 13:09:37.700873 26758 raft_consensus.cc:1240] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:37.700326 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:37.703738 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57589.2us
I20260709 13:09:37.638113 26604 rpcz_store.cc:276] 0709 13:09:35.561623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.564755 (+  3132us) service_pool.cc:224] Handling call
0709 13:09:35.565687 (+   932us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:35.581947 (+ 16260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:35.582336 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.738950 (+156614us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:36.805860 (+1066910us) spinlock_profiling.cc:243] Waited 944 us on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:09:36.806904 (+  1044us) log.cc:844] Serialized 624 byte log entry
0709 13:09:36.807086 (+   182us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:36.952473 (+145387us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.304887 (+352414us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.475763 (+170876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.532785 (+ 57022us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.532838 (+    53us) raft_consensus.cc:1685] finished
0709 13:09:37.532856 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.533020 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151635,"prepare.queue_time_us":114239,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":9569,"raft.queue_time_us":130966,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":22459,"spinlock_wait_cycles":2171136,"thread_start_us":543131,"threads_started":3,"wal-append.queue_time_us":333749}
I20260709 13:09:37.466938 32538 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:09:37.709379 26686 pending_rounds.cc:107] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:09:37.707877 26683 rpcz_store.cc:276] 0709 13:09:35.980328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.584297 (+603969us) service_pool.cc:224] Handling call
0709 13:09:36.611162 (+ 26865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.634859 (+ 23697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.634905 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.663350 (+ 28445us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.077224 (+413874us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.122798 (+ 45574us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.350398 (+227600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.350492 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.643026 (+292534us) raft_consensus.cc:1685] finished
0709 13:09:37.643052 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.643184 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51010,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":36236,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":25315,"thread_start_us":568917,"threads_started":2,"wal-append.queue_time_us":604080}
I20260709 13:09:37.755347 26686 raft_consensus.cc:2889] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:37.713507 26761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
W20260709 13:09:37.714669 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63483.9us
I20260709 13:09:37.756167 26761 raft_consensus.cc:606] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.756554 26761 raft_consensus.cc:614] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:37.691018   317 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:37.782043   317 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.782512   317 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:37.743592 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:37.673714 32640 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:37.785399 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:37.722188   352 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:09:37.674757 32481 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:37.723323 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:37.792709 27318 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:37.679306 32465 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:37.715507 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.725654 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3516) took 1731 ms. Trace:
I20260709 13:09:37.725328 32606 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.690809 32492 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:37.727950 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:37.723325 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 825) took 1168 ms. Trace:
I20260709 13:09:37.562479 32433 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.741788 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.774091 32612 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:09:37.682734 32613 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:37.675637   334 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260709 13:09:37.700327 32254 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.643400   324 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:37.765025   362 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:37.708526 32148 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.769642 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.770424 32685 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:09:37.770824 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:37.771008 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.771507 32667 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.771617   319 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:09:37.773325 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3513) took 1783 ms. Trace:
I20260709 13:09:37.777086 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3520) took 1616 ms. Trace:
I20260709 13:09:37.700169 32250 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:37.798669 27317 rpcz_store.cc:276] 0709 13:09:36.555413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.555586 (+   173us) service_pool.cc:224] Handling call
0709 13:09:36.579122 (+ 23536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.659649 (+ 80527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.659715 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.707910 (+ 48195us) log.cc:844] Serialized 52 byte log entry
0709 13:09:37.266652 (+558742us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:37.266694 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.266769 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.723047 (+456278us) raft_consensus.cc:1685] finished
0709 13:09:37.723069 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.723238 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38397,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4956,"thread_start_us":558230,"threads_started":1,"wal-append.queue_time_us":809934}
I20260709 13:09:37.792966 26611 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:37.740432 32535 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:37.769131 26686 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:09:37.808426 32728 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.003s
I20260709 13:09:37.796900 26682 rpcz_store.cc:276] 0709 13:09:35.994514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.733935 (+739421us) service_pool.cc:224] Handling call
0709 13:09:36.741042 (+  7107us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.741581 (+   539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.741620 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.776959 (+ 35339us) log.cc:844] Serialized 52 byte log entry
0709 13:09:37.213611 (+436652us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:37.213665 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.213752 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.725401 (+511649us) raft_consensus.cc:1685] finished
0709 13:09:37.725426 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.725590 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1641,"thread_start_us":436176,"threads_started":1,"wal-append.queue_time_us":676741}
I20260709 13:09:37.750264 32674 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:37.793679 32621 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:37.795835 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:37.810073 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 94645.1us
I20260709 13:09:37.808301 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3515) took 1817 ms. Trace:
I20260709 13:09:37.833003 32474 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:37.812008 26607 raft_consensus.cc:2368] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
W20260709 13:09:37.835090 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 64338.8us
I20260709 13:09:37.793179   316 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:37.873734 26687 rpcz_store.cc:276] 0709 13:09:35.990805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.713331 (+722526us) service_pool.cc:224] Handling call
0709 13:09:36.713641 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.714210 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.714237 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.714640 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.146099 (+431459us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.146213 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.146336 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.614644 (+468308us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:37.807890 (+193246us) raft_consensus.cc:1685] finished
0709 13:09:37.807922 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.808223 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"spinlock_wait_cycles":24564480,"thread_start_us":430907,"threads_started":1,"wal-append.queue_time_us":710042}
I20260709 13:09:37.720069 32404 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.869859 26680 rpcz_store.cc:276] 0709 13:09:36.160932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.097802 (+936870us) service_pool.cc:224] Handling call
0709 13:09:37.123266 (+ 25464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.302337 (+179071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.314063 (+ 11726us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.330680 (+ 16617us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.550528 (+219848us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:37.570744 (+ 20216us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.570954 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.571030 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.776692 (+205662us) raft_consensus.cc:1685] finished
0709 13:09:37.776736 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.776983 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3415,"prepare.queue_time_us":36653,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":53,"raft.queue_time_us":13140,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":6620,"thread_start_us":357980,"threads_started":2,"wal-append.queue_time_us":431291}
I20260709 13:09:37.801769 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3517) took 1798 ms. Trace:
I20260709 13:09:37.857532 32481 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:37.799993 26605 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:37.797371 32679 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:37.875393 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:37.855808 26681 rpcz_store.cc:276] 0709 13:09:35.990225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.645567 (+655342us) service_pool.cc:224] Handling call
0709 13:09:36.645985 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.728229 (+ 82244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.728273 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.742162 (+ 13889us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.218592 (+476430us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:37.460132 (+241540us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.508263 (+ 48131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.508362 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.773024 (+264662us) raft_consensus.cc:1685] finished
0709 13:09:37.773053 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.773252 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68266,"prepare.queue_time_us":30681,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":30,"raft.queue_time_us":93807,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":16044,"thread_start_us":646448,"threads_started":2,"wal-append.queue_time_us":1010602}
I20260709 13:09:37.801843 32612 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:37.876870 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2194) took 1053 ms. Trace:
I20260709 13:09:37.800886 32537 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:37.886169 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 115257us
W20260709 13:09:37.814249 32566 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.003s
I20260709 13:09:37.888844 26684 rpcz_store.cc:276] 0709 13:09:36.003115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.738079 (+734964us) service_pool.cc:224] Handling call
0709 13:09:36.745752 (+  7673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.752117 (+  6365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.752155 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.757082 (+  4927us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.218876 (+461794us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:37.305879 (+ 87003us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.306113 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.306184 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.801557 (+495373us) raft_consensus.cc:1685] finished
0709 13:09:37.801579 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.801709 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31346,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"raft.queue_time_us":5754,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":4128,"thread_start_us":516494,"threads_started":2,"wal-append.queue_time_us":1020091}
I20260709 13:09:37.797621 32606 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.857980 32250 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:37.917721 26679 rpcz_store.cc:276] 0709 13:09:36.830221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.444777 (+614556us) service_pool.cc:224] Handling call
0709 13:09:37.468026 (+ 23249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.876429 (+408403us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:37.876469 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:37.876521 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.876551 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.876626 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.876801 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25357,"raft.queue_time_us":56216,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":368292,"threads_started":1}
I20260709 13:09:37.871616   362 raft_consensus.cc:2764] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:37.916460 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.807139 32254 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:37.938041 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62718.1us
I20260709 13:09:37.857395 32148 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.877350 32474 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:37.944657 26757 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:09:37.888324 32674 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:37.872987 32535 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:37.949316 26608 raft_consensus.cc:2410] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:37.952795 26756 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:37.917650 32612 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:37.963771 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.946484 32250 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:37.963992 32249 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.002s
I20260709 13:09:37.888765 32667 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.964510   320 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:09:37.969918 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:37.944151   352 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:38.042629   352 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.043251   352 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:38.045027 32612 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.046105 32612 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:37.975140 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.975642 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.050598 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:37.977419 31752 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:37.978165 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.011962 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:37.980335 32537 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.976835   362 consensus_queue.cc:1059] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:38.000964 32535 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.015182 26608 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:37.997088 32674 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.999650   349 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:09:37.939640 32566 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:37.952310 32474 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.014148 32492 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.027622   367 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.027789 26753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:38.029757 32613 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.034204 32404 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:38.084820 26605 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:38.053798 26609 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:38.054637 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:38.059379 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 89583.8us
W20260709 13:09:38.065097 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.069381 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.070603 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:38.076102 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.079540 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:38.051967 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.062001 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:38.076870 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.091533 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.102598 26609 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:38.104143 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.091948 26604 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:38.041560 32249 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:38.081854 26753 raft_consensus.cc:606] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:38.092475 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:38.092983 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.110553 26753 raft_consensus.cc:614] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:38.111872 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:38.112772 26755 raft_consensus.cc:1240] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:38.114849 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.109234 26754 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:38.054216   373 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.097s	user 0.003s	sys 0.003s
W20260709 13:09:38.051640   368 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 13:09:38.093588 26606 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:38.117254 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:38.095042 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.120939 26605 raft_consensus.cc:2368] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:38.055374   362 raft_consensus.cc:3055] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:38.144398 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.124868 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:38.059556 31929 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:38.079891 32492 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:38.205978   385 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:38.206614   385 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.145882 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.144127 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.208947   385 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.215858 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.056383 32148 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.053670 32667 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.212188 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.085821 32566 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.081749 32546 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.226764 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.227764 26681 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:38.226222   362 raft_consensus.cc:740] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:38.229137 32566 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:38.229286 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.231509 32566 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:38.232647 32148 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:38.233013 32148 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:38.233915 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.233841 32148 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.235118 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.144891 32728 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:38.109668   316 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.054927 32254 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.162068 26608 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:38.240170 31929 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:38.240777 31929 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:38.241251 31929 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:38.244125 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 119366us
I20260709 13:09:38.247282 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:38.249020 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:38.250083 27320 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:38.253640 27318 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:38.168849 32474 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.154386 32481 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:38.145118 32679 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:38.266569 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 295340us
I20260709 13:09:38.179032 32677 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.062345 32250 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.087580   367 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.186790 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.147867   380 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:38.054903 32537 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.192968 32613 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:38.293861 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.294409 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:38.294718 26608 raft_consensus.cc:2376] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16. Re-sending same reply.
I20260709 13:09:38.200584 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2207) took 1167 ms. Trace:
I20260709 13:09:38.277628 26679 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:38.296106 26683 rpcz_store.cc:276] 0709 13:09:37.033218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.781179 (+747961us) service_pool.cc:224] Handling call
0709 13:09:37.781526 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.782240 (+   714us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:37.782579 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.944790 (+162211us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.950262 (+  5472us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.950417 (+   155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:37.950813 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.957286 (+  6473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.957358 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.200304 (+242946us) raft_consensus.cc:1685] finished
0709 13:09:38.200333 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.200494 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37046,"prepare.queue_time_us":796,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":21252,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":27072,"thread_start_us":161658,"threads_started":1,"wal-append.queue_time_us":276832}
I20260709 13:09:38.053122   319 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.123916 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.106644   317 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.235203 32148 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.073524   349 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.231217 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.320645 26681 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:38.262877   316 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.266559 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.321718 26680 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:38.266863 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.176446 32589 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.268997 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.300506 26610 raft_consensus.cc:2410] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:09:38.324244 26687 raft_consensus.cc:2410] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:38.328176 26612 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:38.299831   359 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:38.307921 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:38.267865 32481 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.331843 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:38.405380 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 84610.3us
I20260709 13:09:38.400745 26684 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:38.400970 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:38.406128 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.406896 26604 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:38.270803 32728 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:38.407555 26754 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:38.294613 32546 consensus_queue.cc:1059] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:09:38.408455 26753 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.414201 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:38.410553 26611 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:38.258363   389 consensus_queue.cc:1059] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:09:38.411818 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:38.411873 26603 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:38.423205 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:38.423313 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.424113 26683 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:38.274262 32254 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 13:09:38.400206   385 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:38.428979 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.319898   349 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:38.271159 32574 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 13:09:38.433764 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.439370 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.402473 32332 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:38.411818 32481 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:38.428532   391 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:09:38.426783 32679 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.497637 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.294085 32677 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.428831   322 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:38.319932   319 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.528391 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:38.517267 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.530548 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.513980 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.521447 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:38.452980 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.537786 27312 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:38.538321 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.539608 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:38.539899 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.496050 31929 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.542098 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.546600 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:38.432399   359 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.439476   385 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:38.528700 32621 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.568692 32621 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.561069   401 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.572552 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.574010 26758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:38.574638 26758 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:38.572585   401 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.557926 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.579774   401 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.584991 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2208) took 1507 ms. Trace:
I20260709 13:09:38.585527 26686 rpcz_store.cc:276] 0709 13:09:37.077873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.857999 (+780126us) service_pool.cc:224] Handling call
0709 13:09:37.858450 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.887816 (+ 29366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.887851 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.919358 (+ 31507us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.409795 (+490437us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:38.409852 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.409944 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.584724 (+174780us) raft_consensus.cc:1685] finished
0709 13:09:38.584753 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.584921 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2156,"raft.queue_time_us":7219,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2814,"thread_start_us":454848,"threads_started":1,"wal-append.queue_time_us":486190}
I20260709 13:09:38.587952   400 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.588639   400 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.588869 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:38.591178   400 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.594007 26577 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.598920 26753 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:38.560263 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:38.549160   352 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 13:09:38.565400 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.536180 32632 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:09:38.566960 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.545691   349 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.599566 26755 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:38.558817 31929 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.606269 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:38.526239 32679 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.613404 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.619828 26684 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:38.615775 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:38.618544 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.624523 26758 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:38.624748 26686 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:38.636531 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:38.640072 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.533576   322 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.600152   385 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.658179 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.659013 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:38.547574 32332 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.665508 26686 raft_consensus.cc:2410] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:09:38.670421 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:38.670930 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:38.671314 26684 raft_consensus.cc:2410] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:09:38.674762   384 raft_consensus.cc:3055] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:38.675171   384 raft_consensus.cc:740] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:38.676138   384 consensus_queue.cc:260] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.677356   384 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.616963   352 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:38.605014 32728 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.685365 27312 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:38.718657 26606 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:38.646725   349 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.642555 32640 raft_consensus.cc:2764] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:38.724006 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923e107aa6da49eb820049f53360fba9"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:38.724673 26755 raft_consensus.cc:606] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
W20260709 13:09:38.687431 32606 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.003s
I20260709 13:09:38.646389 32474 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.729843 26682 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:38.682643   317 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:38.732035 26756 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:38.681206 32677 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.683861 32537 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:38.736675 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 194998us
I20260709 13:09:38.738852 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.681712   319 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.719803   406 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:38.678829 32492 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.741962 32677 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:38.745395   397 log.cc:927] Time spent T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:09:38.758693   375 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.746s	user 0.000s	sys 0.002s
I20260709 13:09:38.745894 32492 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.746421 26611 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:38.748172   406 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.760300   367 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.752840 32332 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.762154 32679 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:38.762192   406 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.764559 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2233) took 1149 ms. Trace:
I20260709 13:09:38.764832   327 raft_consensus.cc:3055] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.765386   327 raft_consensus.cc:740] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:38.766186   352 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.764958 26607 rpcz_store.cc:276] 0709 13:09:37.615129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.948264 (+333135us) service_pool.cc:224] Handling call
0709 13:09:37.957386 (+  9122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.021763 (+ 64377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.021815 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.087314 (+ 65499us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.552324 (+465010us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:38.564492 (+ 12168us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.564950 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.565018 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.764335 (+199317us) raft_consensus.cc:1685] finished
0709 13:09:38.764352 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.764490 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172,"prepare.queue_time_us":11645,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":54808,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":16085376,"thread_start_us":400104,"threads_started":1,"wal-append.queue_time_us":627430}
W20260709 13:09:38.768599   373 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.615s	user 0.002s	sys 0.000s
I20260709 13:09:38.770150 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:38.771981 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:38.772632   378 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.730s	user 0.003s	sys 0.000s
I20260709 13:09:38.773389   359 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:38.773800 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2200) took 1932 ms. Trace:
I20260709 13:09:38.774156 26678 rpcz_store.cc:276] 0709 13:09:36.841081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.452025 (+610944us) service_pool.cc:224] Handling call
0709 13:09:37.484191 (+ 32166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:37.541703 (+ 57512us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:37.587797 (+ 46094us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.880160 (+292363us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.888767 (+  8607us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:37.939901 (+ 51134us) log.cc:844] Serialized 52 byte log entry
0709 13:09:37.940058 (+   157us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:37.940091 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.940161 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.053601 (+113440us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:38.066809 (+ 13208us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b180042e080. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f
0709 13:09:38.556759 (+489950us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b48002826d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:09:38.768356 (+211597us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b24000fd4d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e209d 00007f40f2e1410e 00007f40f2e2b88c 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221
0709 13:09:38.773600 (+  5244us) raft_consensus.cc:1685] finished
0709 13:09:38.773620 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.773748 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34696,"prepare.queue_time_us":39939,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":63891,"raft.run_cpu_time_us":27009,"raft.run_wall_time_us":706300,"spinlock_wait_cycles":323722368,"thread_start_us":193502,"threads_started":1,"wal-append.queue_time_us":319352}
I20260709 13:09:38.777755 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2185) took 1147 ms. Trace:
I20260709 13:09:38.778133 26752 rpcz_store.cc:276] 0709 13:09:37.630644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.740612 (+109968us) service_pool.cc:224] Handling call
0709 13:09:37.766549 (+ 25937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.766836 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.766873 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.767486 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.953325 (+185839us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:37.953362 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.953427 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.772048 (+818621us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:38.777479 (+  5431us) raft_consensus.cc:1685] finished
0709 13:09:38.777499 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.777700 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12984576,"thread_start_us":184676,"threads_started":1,"wal-append.queue_time_us":275047}
W20260709 13:09:38.742364   358 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.784s	user 0.000s	sys 0.004s
I20260709 13:09:38.893530   384 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:38.904454   411 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.903626 26610 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:38.908856 26607 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:38.909451 26607 pending_rounds.cc:85] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 8
I20260709 13:09:38.909724 26607 pending_rounds.cc:107] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:38.909137   411 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.896070 27320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:38.910563 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 171789us
I20260709 13:09:38.901546   322 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:38.909967 26607 raft_consensus.cc:2889] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.914034 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:38.822788 27312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:38.922259 27312 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:38.908875   384 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:38.902468 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.904481 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 830) took 1667 ms. Trace:
I20260709 13:09:38.861779   327 consensus_queue.cc:260] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:38.816694 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0217224700000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:09:38.911932   411 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:38.881070   408 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:38.814751 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:38.930645 27316 rpcz_store.cc:276] 0709 13:09:37.236977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.237565 (+   588us) service_pool.cc:224] Handling call
0709 13:09:37.243892 (+  6327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.248011 (+  4119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.248055 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.251035 (+  2980us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.459275 (+208240us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:37.459326 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.459412 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.532659 (+1073247us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:38.902388 (+369729us) raft_consensus.cc:1685] finished
0709 13:09:38.902408 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.904388 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5154,"spinlock_wait_cycles":206480256,"thread_start_us":138872,"threads_started":1,"wal-append.queue_time_us":608642}
W20260709 13:09:38.941675 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0190224700000954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:09:38.944834   374 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.900s	user 0.003s	sys 0.000s
I20260709 13:09:38.945453 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:38.946028 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.946775 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:38.953255   369 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.953s	user 0.002s	sys 0.007s
W20260709 13:09:38.953874 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.957255 26650 connection.cc:256] RPC call timeout handler was delayed by -1.0172224700000925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:09:38.962355 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.968350 26607 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:38.969209 26608 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:38.973558 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.973955 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.974869 26603 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
W20260709 13:09:38.977428 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.976742 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:38.980329 26577 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:38.982756 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.982853 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:38.989063 26752 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:38.979287   359 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:09:38.984392 32632 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:38.984961 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:38.979777 32433 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:38.968861   411 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:38.986685 32465 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:38.979655   352 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.008668 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:39.009239 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.991722 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:38.977070 32640 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:39.003230 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:38.976153   327 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.994702 32632 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.998304 32148 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:39.007869 32612 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.960s	user 0.005s	sys 0.008s
I20260709 13:09:39.020406 32433 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.021459 32640 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.022763 26608 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 10.
I20260709 13:09:39.026252 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:39.013759 32465 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:39.028285 32640 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.015877 32632 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:39.031771 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.034210 26678 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:39.036274 26685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2205) took 2177 ms. Trace:
W20260709 13:09:39.014899 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52184.1us
W20260709 13:09:39.038133 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.036712 26685 rpcz_store.cc:276] 0709 13:09:36.858789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.631304 (+772515us) service_pool.cc:224] Handling call
0709 13:09:37.634019 (+  2715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.647576 (+ 13557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.647656 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.648149 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.898228 (+250079us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.898294 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.898403 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.902870 (+1004467us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:39.035920 (+133050us) raft_consensus.cc:1685] finished
0709 13:09:39.035961 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.036207 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52074,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":47747,"spinlock_wait_cycles":9708800,"thread_start_us":171257,"threads_started":1,"wal-append.queue_time_us":327382}
W20260709 13:09:39.038605 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.038980 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.038808 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47191.3us
I20260709 13:09:39.049386 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:38.968353   408 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.057602 26685 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:39.052963 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:39.056125 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.010175   411 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:39.063560 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79453.6us
I20260709 13:09:39.013533   352 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.059677 32640 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.051016   406 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.065975 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.064112 32249 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.076714 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.069734 32667 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:39.088855 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.058795 32433 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:09:39.092007 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.076892 32148 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.071609 32640 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.093510 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.104262   411 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.105340   385 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.076458   406 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.089903 32249 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.109489   406 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.109719 32249 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.107512   385 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:39.112583 32481 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 13:09:39.113066 32481 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.116071 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.117358 27318 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:39.121042   352 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.093792 32566 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.124338 32481 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.129647   390 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.130409   384 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.125944   408 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.091566 32491 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.130996 32148 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:39.092963 32332 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:39.131969 32332 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.132355 32332 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.128317 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.133436   360 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.133713 26650 leader_election.cc:400] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:39.131276 32491 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.134114 32148 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:39.134378 32491 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.134575 32148 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:39.091900 32667 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.134054 26650 leader_election.cc:403] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:39.138085 32667 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:39.146976 26752 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:39.148108 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.149124 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.149928 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.150338 26678 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:39.150918 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.151407 26678 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:39.145628 32465 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15.
I20260709 13:09:39.152469 26678 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:39.152048   362 consensus_queue.cc:260] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.153296   362 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.153779 26678 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:39.154881 26678 pending_rounds.cc:85] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:09:39.155097 26678 pending_rounds.cc:107] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:09:39.155303 26678 raft_consensus.cc:2889] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.155529 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:39.164295 26680 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:39.163075 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 723) took 1047 ms. Trace:
I20260709 13:09:39.166445 26754 rpcz_store.cc:276] 0709 13:09:38.116093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.156203 (+ 40110us) service_pool.cc:224] Handling call
0709 13:09:39.162855 (+1006652us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002dc3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:39.163009 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411232128}
I20260709 13:09:39.135500 32640 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.168017 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.166885 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.225544 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2214) took 1007 ms. Trace:
W20260709 13:09:39.190308 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56735.1us
I20260709 13:09:39.229995 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.230019 26682 rpcz_store.cc:276] 0709 13:09:38.218473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.232030 (+ 13557us) service_pool.cc:224] Handling call
0709 13:09:38.232354 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.733083 (+500729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.204915 (+471832us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000b4d54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:39.225479 (+ 20564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141324672}
I20260709 13:09:39.231258 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.140002   384 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:39.196209 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.158475   324 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.134011   360 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:39.161532   372 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.148s	user 0.010s	sys 0.000s
W20260709 13:09:39.228410 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.244397   321 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.232887 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.233520 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:39.244066 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 77259us
I20260709 13:09:39.233820 31752 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.228132 32566 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.235323   371 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.201s	user 0.003s	sys 0.009s
I20260709 13:09:39.228441   350 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:39.240893 26680 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:39.241365 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:39.244565   343 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.293s	user 0.000s	sys 0.013s
I20260709 13:09:39.246378 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:39.228715 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.232776   366 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.276s	user 0.000s	sys 0.009s
I20260709 13:09:39.235219 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.256870 26605 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:39.257176 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:39.248064   363 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.251010   350 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:39.232993 32148 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.254937 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.257822 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.256995 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.264103 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.264201 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.264426 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.264567 26603 raft_consensus.cc:2376] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18. Re-sending same reply.
I20260709 13:09:39.264770 26680 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:39.261286 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.266722 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.267985 26605 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:39.268945 26603 raft_consensus.cc:2393] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:39.268934 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.270447 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.271811 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.272454 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.273765 31752 raft_consensus.cc:2764] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:09:39.274214 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.274488 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:39.275260 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:39.275597 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.278069 26603 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:39.280800   363 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.280964 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:39.280718   327 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.281635   384 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.282366   322 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:39.282493 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.280666 32677 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.282943   322 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:39.283026 32677 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.283179 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.283577 32677 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.284341 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:39.283982   322 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:39.285272   425 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:39.287019 32404 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:39.270270 32679 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.288172   350 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.289222   350 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.292632 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:39.293555 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:39.294373 26605 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.296636 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.254420 32566 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.304834 32566 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.306002 32148 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.305882 26612 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:39.307827   325 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:39.308552   325 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:39.309713   325 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.300957 31752 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:39.295511   327 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:09:39.291914 32613 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:09:39.291170 32677 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.305882 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:39.313149 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:39.324637 26603 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:39.299728 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:39.328181   429 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:09:39.329739 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2179) took 1750 ms. Trace:
I20260709 13:09:39.330057 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.316985 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.300057   324 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:09:39.342901 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.343963 26680 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:39.313271 31752 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.344412 31752 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:39.344213 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:39.346609 26650 leader_election.cc:400] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:39.347060 26650 leader_election.cc:403] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:39.357702 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.413861 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69754us
I20260709 13:09:39.267554 32632 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:39.417207 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70893.7us
I20260709 13:09:39.421949 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.330183   320 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.428508 26605 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:39.330420 32679 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.330144 26760 rpcz_store.cc:276] 0709 13:09:37.578897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.700017 (+121120us) service_pool.cc:224] Handling call
0709 13:09:37.739423 (+ 39406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.739656 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:37.898726 (+159070us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.894017 (+995291us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b480015c258. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:09:39.329161 (+435144us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800425260. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287
0709 13:09:39.329367 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.329419 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:39.329472 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.329552 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.329683 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17577,"prepare.queue_time_us":17250,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":112804,"raft.run_cpu_time_us":1222,"raft.run_wall_time_us":367701,"spinlock_wait_cycles":21794432,"thread_start_us":755472,"threads_started":3,"wal-append.queue_time_us":308705,"wal-append.run_cpu_time_us":1294,"wal-append.run_wall_time_us":1021022}
I20260709 13:09:39.438781 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:39.446732 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.345674   321 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:39.455178 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.457024 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.418707   384 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.418083 32612 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:39.475610 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.476392 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.478340 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.430521   352 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 13. Current term is 14.
I20260709 13:09:39.459728 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.436331 32674 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.330057 32332 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.493278 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.448807   359 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.471930 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.432672   390 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.488523 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.457072   385 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.461052 32249 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.462492   321 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.470948 26678 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:39.507393 26678 raft_consensus.cc:1240] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:39.474311 32433 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:39.459307   324 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.465121   406 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.464506   411 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:39.491405   381 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.327s	user 0.005s	sys 0.000s
I20260709 13:09:39.460311 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.512391 27314 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:39.512554 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:39.513149 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 98174.4us
I20260709 13:09:39.521485 26680 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:39.489606   367 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:39.584888 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.609313 26724 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.613968 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.509773   321 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:39.613991 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153752us
I20260709 13:09:39.503960   384 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.509197   352 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:39.626525 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 114055us
I20260709 13:09:39.628777 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:39.629278 31752 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.632814 26680 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:39.646543 26682 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:39.627408   327 consensus_queue.cc:1059] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:39.654125 32332 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.655328 32632 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.655938 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 834) took 1969 ms. Trace:
W20260709 13:09:39.657042 32667 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:09:39.509644 32249 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.660467 32677 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.612836 32674 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:39.662860 32640 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.614909   385 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.615658   325 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.625156   362 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.505824 32491 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.510375   390 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.503433   359 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.664204   352 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.667881 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:39.699070 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 85198.3us
W20260709 13:09:39.702737 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 80614.3us
I20260709 13:09:39.700070   349 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.704035 32433 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:39.705773 32249 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.696297 27319 rpcz_store.cc:276] 0709 13:09:37.686994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.687363 (+   369us) service_pool.cc:224] Handling call
0709 13:09:37.687763 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.749385 (+ 61622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.749421 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.792581 (+ 43160us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.143682 (+351101us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:38.143748 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.143831 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.451223 (+1307392us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b240032e778. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e209d 00007f40f2e1410e 00007f40f2e2b88c 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221
0709 13:09:39.655599 (+204376us) raft_consensus.cc:1685] finished
0709 13:09:39.655623 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.655879 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25719,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":16635,"spinlock_wait_cycles":77381888,"thread_start_us":232725,"threads_started":1,"wal-append.queue_time_us":328515}
I20260709 13:09:39.724212 26606 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:39.766215 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:39.710844 32667 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.703953   319 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:39.730624 31752 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.755632   438 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:39.724650 32674 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.760418 32433 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:39.805366   327 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:09:39.830904   438 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:39.824293   431 log.cc:927] Time spent T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:09:39.841888 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 174093us
I20260709 13:09:39.731472   348 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:39.842833 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:39.849372 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 83384.3us
I20260709 13:09:39.726961 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2217) took 1505 ms. Trace:
I20260709 13:09:39.853621 26687 rpcz_store.cc:276] 0709 13:09:38.223003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.234865 (+ 11862us) service_pool.cc:224] Handling call
0709 13:09:39.726662 (+1491797us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b54001db854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:39.726875 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203034368}
I20260709 13:09:39.860795 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.853312   362 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.862439 32640 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.864300   352 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.866510   362 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.867056   362 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.868693 32491 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.869076   362 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:39.866508   438 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:39.877111 32667 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.879400 32674 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:39.860071   349 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:39.884414   349 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:39.884725   390 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.885556   349 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.823441 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:39.891014   428 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.658s	user 0.001s	sys 0.009s
I20260709 13:09:39.892555   435 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:39.853787   367 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.894496   367 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:39.895023   367 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:39.896960   444 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:09:39.900743   359 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.902024 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:39.903465 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.904837   435 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:39.905864 32433 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.906610   316 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.905138 32674 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.907145 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.909072 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.909804 26687 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 11: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:39.910287 26686 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:39.910892 26687 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:09:39.911233 26687 pending_rounds.cc:85] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:09:39.911432 26687 pending_rounds.cc:107] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:09:39.911640 26687 raft_consensus.cc:2889] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:39.912817 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 108774us
I20260709 13:09:39.913069 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 721) took 1887 ms. Trace:
I20260709 13:09:39.907042 32433 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:39.916827 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:39.923405 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.925559 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.913601 26759 rpcz_store.cc:276] 0709 13:09:38.026158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.089426 (+ 63268us) service_pool.cc:224] Handling call
0709 13:09:38.089879 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.205224 (+115345us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:38.205657 (+   433us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.435531 (+229874us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.635042 (+199511us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.635636 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.636847 (+  1211us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:38.637391 (+   544us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.660781 (+ 23390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.766528 (+105747us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400138b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:38.766667 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.770491 (+  3824us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b18000fcd60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3522 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:39.908192 (+1137701us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18000fcd60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:39.912856 (+  4664us) raft_consensus.cc:1685] finished
0709 13:09:39.912875 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.913015 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7852,"prepare.queue_time_us":10031,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":11232,"raft.queue_time_us":156363,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":111411,"spinlock_wait_cycles":283827712,"thread_start_us":420554,"threads_started":2,"wal-append.queue_time_us":336515}
I20260709 13:09:39.931511 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:39.933363 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.933800 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 73071.7us
I20260709 13:09:39.935338 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:39.935472 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:39.941836 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:39.943818 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:39.944396 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:39.951656 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:39.944114 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:39.953147 31752 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:39.958314 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.947378 26679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3540) took 1538 ms. Trace:
I20260709 13:09:39.946550 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 682) took 1160 ms. Trace:
I20260709 13:09:39.941512 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:39.945308 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:39.970767 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 683) took 1159 ms. Trace:
I20260709 13:09:39.923408   352 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:39.944715 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:39.980432 27314 rpcz_store.cc:276] 0709 13:09:38.811338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.811546 (+   208us) service_pool.cc:224] Handling call
0709 13:09:38.902927 (+ 91381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.612455 (+709528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.970498 (+358043us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:39.970706 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401086336}
I20260709 13:09:39.975718 27317 rpcz_store.cc:276] 0709 13:09:38.786565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.786757 (+   192us) service_pool.cc:224] Handling call
0709 13:09:38.815586 (+ 28829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:38.823659 (+  8073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.823721 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:38.824458 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 13:09:39.070091 (+245633us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:39.076373 (+  6282us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.946004 (+869631us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b1800399820. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:39.946167 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.946234 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.946275 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:39.946371 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.946495 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13596,"prepare.queue_time_us":7775,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1649,"raft.queue_time_us":886107,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":26659,"spinlock_wait_cycles":15374080,"thread_start_us":202199,"threads_started":1,"wal-append.queue_time_us":236810}
I20260709 13:09:39.990895 26761 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:39.973609 26679 rpcz_store.cc:276] 0709 13:09:38.409253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.953934 (+544681us) service_pool.cc:224] Handling call
0709 13:09:38.954270 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.954600 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.954623 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.969007 (+ 14384us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.058715 (+ 89708us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:39.058782 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.058875 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.890344 (+831469us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:39.947076 (+ 56732us) raft_consensus.cc:1685] finished
0709 13:09:39.947101 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.947321 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":586,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7728,"spinlock_wait_cycles":10313984,"thread_start_us":60067,"threads_started":1,"wal-append.queue_time_us":123715}
I20260709 13:09:39.970024 32711 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.015173 32711 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.967805   402 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:40.018182   402 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:39.948755 32491 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:39.949934 32640 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:09:40.007725 32728 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.024283 32728 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.024485   321 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:39.948208   325 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.026357 32728 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.029455   367 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.035840   435 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:39.989811   406 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.040129   406 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.042824   406 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:39.944697   350 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 13:09:40.043109 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.043435 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.044111 27317 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:39.936395 32667 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:40.048727 26650 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:40.065685 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.068997 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.069221 32728 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.071031 32728 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.073307 32728 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:40.075888   352 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:40.076442   352 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.076875   352 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.077749   325 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.045971   367 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:39.967154   384 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:40.089511 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.090226 27317 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:40.092172 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.065416 32667 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.100008 32667 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.100486 32417 raft_consensus.cc:993] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:40.101835 32250 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.102677 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.103506 26685 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:40.103849 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 734) took 1580 ms. Trace:
I20260709 13:09:40.104275 27318 rpcz_store.cc:276] 0709 13:09:38.523200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.523326 (+   126us) service_pool.cc:224] Handling call
0709 13:09:38.535036 (+ 11710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.117767 (+582731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.103570 (+985803us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540052f8d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:40.103791 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338622720}
I20260709 13:09:40.104681 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:40.105350 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:40.106370 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:40.106914 26681 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:40.111336 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.112114 26754 raft_consensus.cc:2368] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:09:40.113016 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.114045 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.114519 26754 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.114840 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:40.112140 26687 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:40.095710 26678 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:09:40.096851 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:39.989288   401 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.049748   316 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.124037 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.126241 26752 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:09:40.129365 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.132524 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.133140 26678 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:40.135002 26679 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:40.137110 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.137359 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.137708 26760 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 10.
I20260709 13:09:40.138195 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.138577 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.139184 26756 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:40.140120 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.140928 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.128568 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:40.142306 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.141434 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.141557 26759 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:40.143916 26605 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:40.143216 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.145519 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.146718 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.146968 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.147178 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.147369 26605 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:40.147763 26678 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:40.150327 27313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 840) took 1956 ms. Trace:
I20260709 13:09:40.155397 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.156250 26609 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:40.157523 26681 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:40.143913 32640 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:40.160823 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.161561 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.162772 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.163918 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.150695 27313 rpcz_store.cc:276] 0709 13:09:38.194453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.196650 (+  2197us) service_pool.cc:224] Handling call
0709 13:09:38.197042 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.425276 (+228234us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:38.629746 (+204470us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.638389 (+  8643us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.638457 (+    68us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:38.638524 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.150114 (+1511590us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54005c62d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:40.150159 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.150276 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7763,"prepare.queue_time_us":249075,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":45069,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":524314880,"thread_start_us":191847,"threads_started":1}
I20260709 13:09:40.136762   411 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.185506 26603 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:40.197943 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.198720 26603 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:40.169818 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.170176 26605 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:40.200690 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.158986 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.201828 26612 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:40.194519 26610 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:40.149569   321 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.158591 32148 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:40.204677 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.125696   401 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.209426 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.139854   426 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:09:40.205754 26603 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:40.232550 26609 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:40.240293 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
W20260709 13:09:40.233470   425 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:40.142625   316 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:40.257561 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 260077us
I20260709 13:09:40.206043   411 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.205711 32491 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:09:40.229696 32640 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:40.273236 26608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 758) took 1294 ms (client timeout 1671 ms). Trace:
W20260709 13:09:40.274812 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2195) took 2001 ms (client timeout 1788 ms). Trace:
W20260709 13:09:40.276736 26753 rpcz_store.cc:269] 0709 13:09:38.268090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.307614 (+ 39524us) service_pool.cc:224] Handling call
0709 13:09:40.269349 (+1961735us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b54000b95d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:40.269464 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8426880}
I20260709 13:09:40.263101   362 raft_consensus.cc:1081] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:40.299346 26651 leader_election.cc:400] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:09:40.299820 26651 leader_election.cc:403] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:09:40.275929 26608 rpcz_store.cc:269] 0709 13:09:38.972577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.980599 (+  8022us) service_pool.cc:224] Handling call
0709 13:09:40.266391 (+1285792us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b540035f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:40.266552 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27899264}
W20260709 13:09:40.295842 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 181647us
I20260709 13:09:40.263543   320 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:40.281744 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.306461 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:40.308763 26651 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:40.310205 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.313508 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.314293 26752 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:40.300730   448 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:09:40.314877 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 145264us
I20260709 13:09:40.313544 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:40.317653 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.322804 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.326126 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.304747   321 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:40.346264 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.346434 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:40.278471   324 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:40.349646 26757 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:40.313925   408 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:40.317557   349 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:40.342478 32250 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:40.305656 32404 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:09:40.344578   384 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:40.307586   320 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.377527 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2240) took 1054 ms. Trace:
I20260709 13:09:40.379142 26684 rpcz_store.cc:276] 0709 13:09:39.323092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.731639 (+408547us) service_pool.cc:224] Handling call
0709 13:09:39.731996 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.833883 (+101887us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:39.833928 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.834568 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.972222 (+137654us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:39.972262 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.972335 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.377302 (+404967us) raft_consensus.cc:1685] finished
0709 13:09:40.377321 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.377467 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60167,"raft.queue_time_us":61563,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":137211,"threads_started":1,"wal-append.queue_time_us":336456}
I20260709 13:09:40.357008   350 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:40.359748 26754 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:40.365044   349 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:40.387804 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81452.4us
I20260709 13:09:40.366070 32250 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:40.392831 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.393258 26608 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:40.393869 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.412235 26612 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:40.404662   464 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.433452   464 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.378670 32621 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.405697 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3493) took 1969 ms. Trace:
I20260709 13:09:40.437297 26611 rpcz_store.cc:276] 0709 13:09:38.436609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.438368 (+  1759us) service_pool.cc:224] Handling call
0709 13:09:38.508726 (+ 70358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.760216 (+251490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.405381 (+1645165us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002391d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:40.405627 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546089728}
I20260709 13:09:40.439049 26611 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:09:40.406953 32404 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:40.412360 27318 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:40.394709 32566 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:40.440538 32566 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:40.441371 32566 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.442448 32566 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:40.413533 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:40.412091 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.444205 26603 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:40.380194   362 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:40.414645   452 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:09:40.417593 32640 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.419533   411 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.385874 32674 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.447925 32674 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.451363 32674 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:40.451908   466 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:40.452397   407 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.453639   408 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:40.462457 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.509327 26754 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:40.421118   401 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.468945 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:40.441891   455 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:09:40.463762 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:40.513870 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 50208.8us
W20260709 13:09:40.514544 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.483609 26752 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:40.469208 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:40.517987 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48907.8us
I20260709 13:09:40.500249 26761 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:40.504756   316 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.390004   349 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.466493 32250 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:40.549132 26605 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:40.471009   362 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:40.511404   408 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:40.555781 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.559453 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.542337   350 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:40.509876 32404 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:09:40.509522   463 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:09:40.578742 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.592595 32566 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.593282 32566 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.512893   407 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.572978   316 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.606552 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.586479   401 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.587330   350 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:40.589569   324 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:40.620497 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 105471us
I20260709 13:09:40.605240 32640 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:40.608834 32417 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:40.634709 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.612149   457 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:40.638950 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 486993us
I20260709 13:09:40.639492 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.643256 27319 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:40.642578 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.644268 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.646225 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.621249   464 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:40.637688   352 consensus_meta.cc:287] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.000s
I20260709 13:09:40.660462 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:40.629814 32728 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.661368 27313 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 20: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:40.631462   411 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:40.640508 32417 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.642640   457 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.628264   401 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.662740   406 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:40.693884 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.660832 32433 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:40.698272 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 739) took 2130 ms. Trace:
I20260709 13:09:40.661626   320 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:40.711414 26683 rpcz_store.cc:276] 0709 13:09:38.568140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.036808 (+468668us) service_pool.cc:224] Handling call
0709 13:09:39.037045 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.076069 (+ 39024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.076112 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.076153 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:39.076193 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.697930 (+1621737us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b54003c64d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:40.698003 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.698197 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89336576}
I20260709 13:09:40.614154   316 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.630282   324 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.719033 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.720148 27313 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:40.720498 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:40.719247 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 208129us
I20260709 13:09:40.695736 32417 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:40.731015 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:40.731899 27317 raft_consensus.cc:2393] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:40.660794   459 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:09:40.704797   457 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:40.645468 32640 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.754788 32640 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:40.756572   459 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:40.757081   459 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:40.754659   468 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.370s	user 0.000s	sys 0.000s
I20260709 13:09:40.758093   459 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.763010   402 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:40.727321 32667 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.003s
I20260709 13:09:40.689098 32728 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:40.782611   451 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:09:40.642800   362 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.786568   407 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:40.727643   350 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.700073   411 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.745764 26752 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:40.724798   456 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:40.765802   472 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:09:40.707573   406 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.797008   316 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.797441   406 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:40.798132 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 496214us
I20260709 13:09:40.798945 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:40.770653 27318 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:09:40.800305   360 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.801806 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.802798   322 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.803218   322 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:40.803632   322 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:40.804222 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2262) took 1540 ms (client timeout 1728 ms). Trace:
W20260709 13:09:40.804791 26606 rpcz_store.cc:269] 0709 13:09:39.263781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.263986 (+   205us) service_pool.cc:224] Handling call
0709 13:09:40.804020 (+1540034us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540028b254. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:40.804149 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906430848}
I20260709 13:09:40.806277 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:40.808425 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:40.809492 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.809729 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:40.810706 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.741366 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.779835 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:40.812096 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 233031us
I20260709 13:09:40.780793 32667 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.795354   401 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.781229 32711 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:40.813135 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.681692   352 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.811470 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:40.818599 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 172454us
I20260709 13:09:40.814795 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.823431 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.793329   459 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:40.811829   384 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:40.816037   319 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:40.819990   407 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.823608   475 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:40.815758   408 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:40.822408   435 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:40.826304 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.826845 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:40.846838 26610 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:40.880002 26754 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 11.
I20260709 13:09:40.883175 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.875718 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.830727 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:40.854557 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 160741us
I20260709 13:09:40.888870 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.890848 26577 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:40.861294 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.893365 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:40.887217 26609 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:40.907254 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:40.911844 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.914584 27319 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:40.829288   411 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:40.846390 32404 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:40.929445 26681 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:09:40.929986 26681 pending_rounds.cc:85] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 11
I20260709 13:09:40.930290 26681 pending_rounds.cc:107] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:09:40.930644 26681 raft_consensus.cc:2889] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.922542 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:40.923388 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50484.2us
I20260709 13:09:40.932801 26678 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:40.861503 32728 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.903422   475 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.938118   384 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:40.943428   384 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.921689 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.946425 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.917832   463 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:40.951313 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:40.826555   482 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:09:40.856918   456 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:09:40.918270   360 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:40.925419   348 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.929270 32404 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.967549 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.911173   407 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:40.956738   467 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:40.954502   493 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:40.935904 32613 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:40.994578 32667 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:40.976516   324 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:40.989424   493 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:40.974399 32404 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:41.020792 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 58521.5us
W20260709 13:09:41.021044 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53601.3us
I20260709 13:09:41.022172 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:40.982831 32677 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:41.053439 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.060434 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.054136 26759 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:40.982532 32433 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:09:41.066646 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:41.068954 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46896.9us
I20260709 13:09:41.067135 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:41.077581 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.080063 26754 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:41.081683   502 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:41.083506   360 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:41.076515 32640 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.090667 32640 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.093701 32640 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.096192 27313 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:41.084362   360 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:41.102057   360 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:41.037931   321 consensus_meta.cc:287] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.685s	user 0.013s	sys 0.001s
I20260709 13:09:41.108850   321 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:09:40.986867   411 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:09:41.114517 32566 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.116562   463 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.120217 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.121774 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:40.975176   348 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:41.122640 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 173379us
W20260709 13:09:41.126837 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.127470 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.128119 26759 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.128688 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.116907   503 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:41.122443 26684 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:41.138161 26684 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:41.047243 32148 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:41.141812 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.156040 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.155510 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.147917 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:41.162494 26756 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:41.164949 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:41.143316   349 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.003s
I20260709 13:09:41.117103   463 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.117578   505 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.174819 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.174854 26681 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:41.023394 32250 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.184381   349 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.186471 32250 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.108860   352 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.069973 32677 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.187317   324 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:41.188768   471 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:41.189213   471 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:41.189257 32677 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.190105 26611 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:41.190303   471 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.191923   408 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.192703 26611 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:41.193593   513 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:41.193998   505 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.196177   505 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.137555   503 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:41.185035   496 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:41.188216   324 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.179030   402 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:41.182910 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.197261 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.207715 26680 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:41.165946   411 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.158439 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.211687 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.200412 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.212714 26756 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:41.213145 26753 raft_consensus.cc:2376] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14. Re-sending same reply.
I20260709 13:09:41.145772 32728 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:41.204510 26606 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:41.183106 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.146386 32148 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:41.209095 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.214658 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.210518 26682 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:41.145308   401 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:09:41.196833   503 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.187368   349 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.226861 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:41.227983 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.229534 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.222412 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:41.206892 32621 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:41.207370   402 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.234391 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.204965   471 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.196171   457 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.226382 32148 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.232682   476 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:41.222081 32677 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:41.251451 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.251995 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.238436   402 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:41.255759 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.235023   390 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.256511 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.237655   325 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:41.264247 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.216220   411 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.266096 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:41.266342 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146205us
I20260709 13:09:41.268155 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.247390   349 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.271346 26756 raft_consensus.cc:2393] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:41.270913 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.251037   505 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.255002 32677 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.273403 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.250913   380 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:09:41.275904 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.276482 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.276504 26680 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:41.278801 27286 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:41.278947 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.278663 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.263657   325 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.279793 26756 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 15: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:41.270313   316 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:41.268244   477 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:41.284808   506 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:09:41.291712   316 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.294505 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.295279   316 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.295506   495 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.296120 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.296797 26756 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.276283 32677 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.297791 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.265446   406 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.277671   482 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.282626   408 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:41.283138   325 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.273840   438 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:09:41.283882 26680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55252
I20260709 13:09:41.309484 26680 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.309930 26680 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.306923 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.312927 26759 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:41.314445 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.314785 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.280705   492 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:09:41.304032   390 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.316432   473 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:09:41.317490   512 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:41.317804   384 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:41.318379   384 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:41.318869   411 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.319252   384 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:41.308403   322 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 13:09:41.321130   406 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.321281   322 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.322544 26758 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:41.323140 32728 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:41.323632   348 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.324941 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.323715 32728 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:41.326025 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.326730 26760 raft_consensus.cc:2393] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:41.326794 32728 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.275604   349 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.329520 26682 raft_consensus.cc:2368] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:41.330181 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.331060 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.331851   475 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:41.334098 26577 leader_election.cc:400] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:41.334444 26577 leader_election.cc:403] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.327533 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.337100 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.338064 26682 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 10.
I20260709 13:09:41.336277 26760 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:41.340116 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.314534 26680 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.340622 26760 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.341041 26685 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:41.341904 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.344095 32632 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.345065   523 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:41.345463 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.352967 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.281163   505 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.404217 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:41.431213 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 89382.2us
I20260709 13:09:41.432646 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.435302 26680 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:41.437604 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 100918us
W20260709 13:09:41.437676 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 100479us
I20260709 13:09:41.342478 32728 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:41.444058 26680 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:41.451117 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:41.335518   467 raft_consensus.cc:3060] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.298725   477 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.296082   495 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.437304 32632 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:41.472719 26610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3517) took 1082 ms. Trace:
I20260709 13:09:41.473194 26610 rpcz_store.cc:276] 0709 13:09:40.390579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.391641 (+  1062us) service_pool.cc:224] Handling call
0709 13:09:40.391925 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.884352 (+492427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.472471 (+588119us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540037a0d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:41.472654 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005559040}
I20260709 13:09:41.451881   490 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:41.504967   516 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:09:41.447279   316 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.483770 32728 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.446727   463 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.518097 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:41.491155   490 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:41.521530 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.530520 26679 raft_consensus.cc:2368] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:41.510066   349 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.535022 32148 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.525427   438 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.527551   457 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:41.550032 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81652.8us
W20260709 13:09:41.544795   470 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 1.139s	user 0.000s	sys 0.006s
I20260709 13:09:41.518524   319 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 13:09:41.571120 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 56683.4us
I20260709 13:09:41.563627   466 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:41.532153   402 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.566769   322 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.568553   510 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.568972   438 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.596999 32677 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.598979   438 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:41.594787   459 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.764s	user 0.006s	sys 0.004s
W20260709 13:09:41.595131 32404 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.000s
I20260709 13:09:41.596184   316 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.585701   319 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:41.596481   463 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:41.622820 26756 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:41.623705 32677 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.629050 26755 raft_consensus.cc:1240] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:41.596944   402 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.632829 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:41.629619   362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.010s	sys 0.008s
W20260709 13:09:41.637077   362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.013s	sys 0.008s
I20260709 13:09:41.591537 32148 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.632740 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:41.624264   533 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:41.639110 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.631008 26760 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:41.632943 26651 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.640692 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:41.643518 26683 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:41.643996   526 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:09:41.645628 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.646842 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.647414 26760 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:41.647369   406 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:41.648377   406 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:41.649477   406 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.584545   466 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.653561   466 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:41.655794 26760 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:41.640875 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.660288 26651 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.624732   319 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:41.625823   505 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.667321 26683 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:41.669356 26682 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:41.669895 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.671469 26760 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:41.671541 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:41.671620 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:41.673784 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.672508 26683 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:41.624917 32404 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.666199 32148 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.678321 26759 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:41.667477   411 raft_consensus.cc:2804] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:41.682857 32404 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.688657 26760 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:41.689244   325 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.691349   325 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.670483   477 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.661506   495 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.700400 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:41.701808 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.708668 27319 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:41.709148 26610 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:41.709007 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:41.707115 27314 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:41.714469 26610 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:41.576887   490 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.715842 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:41.714481 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.720547 26608 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:41.720476 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.722626 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:41.723170   490 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.723742 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:41.697799 32148 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.725996 32148 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:41.726418 32417 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.950s	user 0.012s	sys 0.000s
I20260709 13:09:41.726878 32417 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.729799 26754 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:09:41.737267 27318 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:41.715693   464 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:41.719339   319 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.753723   459 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:41.759096   459 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:41.759521   459 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.755784   464 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:41.764246   464 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.765594   464 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.756003 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.768355 26608 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:41.744186 32417 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:41.756788 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.782573 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:41.745623   503 consensus_meta.cc:287] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:09:41.787626 26611 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:41.791121 26606 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 11.
I20260709 13:09:41.795099 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.757340   324 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.796293 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:41.802542 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.802124 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.803531 26752 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.808512 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.809367 26611 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.789999   503 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:41.818104 26752 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:41.793205 32417 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:41.830516 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:41.819339 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.793146   411 raft_consensus.cc:697] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:41.835297 26758 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:41.837689 26752 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:41.838938 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.841818 26755 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.841905 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.842512 26752 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:41.843622 26611 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:41.845129 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.859244   458 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:41.839079   548 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:41.861241   548 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.861641 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.862442 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 774) took 1037 ms. Trace:
I20260709 13:09:41.862759 26609 rpcz_store.cc:276] 0709 13:09:40.824804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.915261 (+ 90457us) service_pool.cc:224] Handling call
0709 13:09:41.861496 (+946235us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b58000b0198. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016ba22 00007f40f9084c09 00007f40f81deee0 00007f40f82a80ab 00007f40f82a8131 00007f40f82560a0 00007f40f8255984 00007f40f17d06d4 00007f40f17d0662
0709 13:09:41.862387 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25559936}
I20260709 13:09:41.815802 32612 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:41.867753   493 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.821589   503 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:41.819835   492 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:09:41.876696 32612 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:41.877084 32612 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:41.877882 32612 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.878829   482 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:41.879093 32612 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.879251   482 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:41.880184   482 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.881510   482 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.884510   435 raft_consensus.cc:993] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:41.885026   435 raft_consensus.cc:1081] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:09:41.888679   476 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:41.889295   476 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.893256 26759 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:41.894281 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:41.894690 26726 leader_election.cc:400] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:41.895002 26726 leader_election.cc:403] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.898988 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:41.900456   479 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.123s	user 0.000s	sys 0.004s
I20260709 13:09:41.901314 32613 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.904325 26752 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:09:41.906183 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49996.3us
I20260709 13:09:41.906821   458 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:41.907620   532 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:41.908170   532 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.907852   458 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.910399   532 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:41.907110 26576 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.911564 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.912321 32566 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:41.912629   325 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:41.912842 32566 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:41.913069   325 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.913098   475 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:41.913713   325 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.913764 32566 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.915474 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.916090 26612 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:41.923148   503 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:41.924270   503 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:41.926204   503 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:41.926580   503 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:41.927330   503 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:41.928598   503 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:41.930799 32613 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12.
I20260709 13:09:41.932588 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:41.933314   487 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.005s	user 0.007s	sys 0.000s
I20260709 13:09:41.933475 26753 raft_consensus.cc:2368] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:09:41.938876 26651 leader_election.cc:400] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:09:41.939316 26651 leader_election.cc:403] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:41.940119 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 126906us
I20260709 13:09:41.841500 32417 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:41.935365 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.943894 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.945819 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:41.950309 26755 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:41.954702 26686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "923e107aa6da49eb820049f53360fba9"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55252
I20260709 13:09:41.978508 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:41.979864 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.980477 26612 raft_consensus.cc:2376] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18. Re-sending same reply.
I20260709 13:09:41.980764 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.981498 26606 raft_consensus.cc:2368] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:09:41.981505 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:41.982414 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47127.3us
I20260709 13:09:41.986032 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:41.987529 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.990450 26610 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 15: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:41.988922 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.993463 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.996862 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.999030 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:41.999801 26611 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.954128   508 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.006697 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:42.007869 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.018358 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.018919 26576 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:42.057595 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:41.991787   505 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:41.977406   493 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:41.990873   352 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.978367   548 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:42.065394 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46550.7us
I20260709 13:09:42.073601 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:42.081341 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.083230 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:42.084435 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:41.977324 32417 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.056501 32677 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:42.070835   457 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:42.090006 26752 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:09:42.090410 26752 pending_rounds.cc:85] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 10
I20260709 13:09:42.090653 26752 pending_rounds.cc:107] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:09:42.090905 26752 raft_consensus.cc:2889] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:42.062414   505 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.068161   530 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:42.093792   406 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.098737 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:42.103442 26609 raft_consensus.cc:3060] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:42.004791   514 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 13:09:42.061657   456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.007s	sys 0.017s
I20260709 13:09:42.089510 32621 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:42.069837   495 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:09:42.090969   316 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:42.088411   384 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:42.095904   505 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:42.092257 32677 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.090737   535 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.138787 26686 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.153146 26686 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:42.071952   352 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.034368   411 consensus_queue.cc:237] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.106045   530 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:42.114265   456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.007s	sys 0.017s
I20260709 13:09:42.111225   457 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:42.138303 32621 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.139289   528 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:42.166328 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3523) took 1753 ms. Trace:
I20260709 13:09:42.171030 26603 rpcz_store.cc:276] 0709 13:09:40.412856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.444894 (+ 32038us) service_pool.cc:224] Handling call
0709 13:09:40.518195 (+ 73301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.518728 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.518770 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.519331 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.665521 (+146190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:40.665581 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.665691 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.766641 (+100950us) raft_consensus.cc:1685] finished
0709 13:09:40.766662 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.159336 (+1392674us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b5400031e50. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:42.166237 (+  6901us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23411,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6386,"spinlock_wait_cycles":167657856,"thread_start_us":111268,"threads_started":1,"wal-append.queue_time_us":216157,"wal-append.run_cpu_time_us":1817,"wal-append.run_wall_time_us":1003723}
I20260709 13:09:42.111186   324 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:42.111155   406 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.186944   406 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.157213 32677 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.158550   513 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.191139 26609 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:42.169714 32621 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.169150   514 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:42.168587   530 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.201490 26686 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.154785   325 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.191553   513 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.190958   459 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:42.214107 32491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.418s	user 0.022s	sys 0.016s
I20260709 13:09:42.161198   535 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.219849 32491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.022s	sys 0.016s
I20260709 13:09:42.221899   513 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.206240   514 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:42.226176 26606 raft_consensus.cc:1240] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:42.225718   359 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:09:42.233788 32677 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.236797   467 consensus_meta.cc:287] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.002s
I20260709 13:09:42.237386   467 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15.
I20260709 13:09:42.242512 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.243165 26683 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:42.244645 26612 raft_consensus.cc:2468] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:42.246285 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.247816   402 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:42.248018 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.248366   402 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.225147   514 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.250169   514 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.250407   402 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:42.251457 26683 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:42.251847   547 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:42.252231   547 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:42.253211   547 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.254544   547 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:42.256592 32417 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.258575 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2252) took 1143 ms. Trace:
I20260709 13:09:42.258965 26678 rpcz_store.cc:276] 0709 13:09:41.114865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.115076 (+   211us) service_pool.cc:224] Handling call
0709 13:09:41.115471 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.115933 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.115968 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.116537 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.251341 (+134804us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:41.251381 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.251447 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.239571 (+988124us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b24000fd448. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:09:42.258283 (+ 18712us) raft_consensus.cc:1685] finished
0709 13:09:42.258303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.258516 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1388,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":25604352,"thread_start_us":134380,"threads_started":1,"wal-append.queue_time_us":183044}
I20260709 13:09:42.263482 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.263929 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.264179 26687 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:42.230151   352 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.263118 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.265023 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.265415 26683 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.266163 26679 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:42.269218 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.270100 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.271678 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:42.272588 27317 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:42.244706   493 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.274514 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:42.276647   316 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:42.277390   316 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.278841   319 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:42.280346   553 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:09:42.280870 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.274413 26683 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
W20260709 13:09:42.281950   546 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:42.290853   535 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:42.291970 27285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 1.671s (SENT) [suppressed 17 similar messages]
I20260709 13:09:42.307080 27284 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:42.309675 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:42.248379   490 consensus_meta.cc:287] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.003s
I20260709 13:09:42.318068 26758 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:42.321548 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56607.9us
I20260709 13:09:42.230281   325 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.328886 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:42.334910 26756 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
W20260709 13:09:42.335922 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 349928us
I20260709 13:09:42.336918 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.351017 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:42.319505   557 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:09:42.358840 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:42.367934 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.372618 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.380231 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.381129 26760 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:42.320722   438 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.382843 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.390127 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:42.341856   473 raft_consensus.cc:2804] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:42.394133 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.395345 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.396425 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.385471 26682 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:42.397681   534 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.398380 26681 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:42.399339   503 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.369027   316 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.399839   406 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:42.400275   406 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.400352   316 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:42.400699   406 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:42.402835 32612 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.523s	user 0.013s	sys 0.000s
I20260709 13:09:42.230720   457 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.404364 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.405750   401 raft_consensus.cc:3055] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:42.406307   401 raft_consensus.cc:740] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:42.407896   348 raft_consensus.cc:2764] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:09:42.395241   438 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.409158 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:42.384549 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62132.2us
I20260709 13:09:42.410035   438 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.410503   348 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:42.411031   348 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:42.328235   510 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:42.415035 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 123101us
I20260709 13:09:42.412355 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.307108   493 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.425315 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:42.413023 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 406391us
I20260709 13:09:42.362619   535 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:42.428450 26724 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:42.385782   349 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:42.432773 26724 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:42.384426   467 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.431595 26577 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.447232 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.453516 26606 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:42.414577   494 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:42.449318 26612 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:42.449180 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:42.451921 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.428592   438 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.428889   473 raft_consensus.cc:697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:42.458997   447 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:42.460064   327 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:42.407428   401 consensus_queue.cc:260] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.461612 26609 raft_consensus.cc:1240] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:42.459293 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.463263 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.501868   560 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:42.503281 26758 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:42.464978   493 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.465534   348 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.398399   534 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.435645   349 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.472141 26607 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:42.440088 32677 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.430667   549 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:42.430637   535 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:42.520335 26727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.014s
I20260709 13:09:42.478812   406 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.438505 32612 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:42.483089   476 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:09:42.426015   510 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.496531 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47407.2us
I20260709 13:09:42.453066   490 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:42.504860 32433 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:42.485615 26686 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.517305 26607 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:42.517269 26605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.016s
I20260709 13:09:42.444106   467 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.564790 26605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.004s	sys 0.016s
I20260709 13:09:42.522722 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.521625 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:42.520810 26727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.014s
I20260709 13:09:42.526341 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.576967 26684 raft_consensus.cc:2410] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:42.524507 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:42.539251 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.505461   359 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:42.455971   503 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:09:42.523940   350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.727s	user 0.016s	sys 0.013s
W20260709 13:09:42.578128   350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.787s	user 0.017s	sys 0.013s
I20260709 13:09:42.519429 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.578799   490 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:42.580173   490 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.582398 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 60883.5us
I20260709 13:09:42.583536 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.585785 26724 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:42.587082 32417 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:42.588061   568 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:42.589066   568 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:42.518580   493 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.519229   349 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:42.591099 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 205929us
I20260709 13:09:42.591415   493 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:42.594856 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92901.1us
I20260709 13:09:42.595937 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.596335 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.597668   523 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:42.597944 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.599573 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.599882 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.600338 26686 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:42.600450 26679 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.601117 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:42.601895   523 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:42.600567 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:42.602152 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44304us
I20260709 13:09:42.603355   523 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:42.525686   535 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:42.534953   508 consensus_meta.cc:287] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:09:42.516038   402 consensus_queue.cc:1059] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:09:42.605979 26607 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.505059   438 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.594350   493 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:42.622161 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 83003.1us
I20260709 13:09:42.622475 26607 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.622896 26760 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:42.623826 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.628253 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:42.633982 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 129695us
I20260709 13:09:42.637974 26650 leader_election.cc:400] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:09:42.638343 26650 leader_election.cc:403] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.607352 32677 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.643736 26753 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:42.646341 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:42.636132 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:42.666630 26752 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:42.646529 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.647962   561 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:09:42.658617 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:42.541314   476 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.606305   503 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.619868   548 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:42.668527 26758 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:42.693799   438 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.694486 32250 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:42.675509 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:42.621848   508 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:09:42.659631 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:42.605420   523 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:09:42.671952 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.672653 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:42.718961 26679 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:42.719383 27318 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:42.660887   459 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.669721 32677 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.676719 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:42.677819   497 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.407s	user 0.008s	sys 0.001s
I20260709 13:09:42.678654 32621 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.679795   552 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.679982   494 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:42.681559   493 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:42.682725 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.685465   565 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:42.688478 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:42.729477 27313 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:09:42.705204 26756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 2297) took 1265 ms (client timeout 1624 ms). Trace:
I20260709 13:09:42.730060 26611 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:42.730299 26756 rpcz_store.cc:269] 0709 13:09:41.439468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.632546 (+193078us) service_pool.cc:224] Handling call
0709 13:09:42.704993 (+1072447us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54000dbbd4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:42.705135 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584239488}
I20260709 13:09:42.703492 26760 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:42.641917   411 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:42.727502 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55626.8us
I20260709 13:09:42.736450 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:42.728499 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 98096.6us
I20260709 13:09:42.731649 26760 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:42.703486   503 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.742727 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.720602   549 raft_consensus.cc:2764] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:09:42.741798 26760 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.756323 26760 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:42.754827 27316 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:42.729022   561 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:42.734820   411 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.798583 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2227) took 2060 ms. Trace:
I20260709 13:09:42.760388   352 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:42.753710   562 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:42.799018 26761 rpcz_store.cc:276] 0709 13:09:40.738576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.749496 (+ 10920us) service_pool.cc:224] Handling call
0709 13:09:40.749900 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.750178 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.756948 (+  6770us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.757585 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.910812 (+153227us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:40.910850 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.910924 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.677187 (+1766263us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:42.793835 (+116648us) raft_consensus.cc:1685] finished
0709 13:09:42.793857 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.798517 (+  4660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7271168,"thread_start_us":152720,"threads_started":1,"wal-append.queue_time_us":482333}
I20260709 13:09:42.813392 26760 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:09:42.797719   411 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.738123   552 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:42.826556 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81960.5us
I20260709 13:09:42.789073   494 consensus_queue.cc:1059] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:09:42.834059 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:42.839789 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:42.667461   473 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.848037 26678 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:42.850301 27313 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:09:42.837356   530 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
W20260709 13:09:42.843391   505 consensus_meta.cc:287] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
W20260709 13:09:42.858251 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 222376us
I20260709 13:09:42.829896   534 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.872649   401 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:42.843840   406 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:42.898180   319 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260709 13:09:42.850966   467 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:42.862452   578 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:09:42.900027 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.900905 26760 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:42.849833   352 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:42.884353   510 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.885259   523 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.890195 32677 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.895181   476 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:42.899338 26761 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:09:42.883836   569 log.cc:927] Time spent T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:09:42.916467 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:42.947810 27313 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.917749 26609 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:42.918300 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.949186 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:42.949616 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:42.919070 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:42.944574 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.950543 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:42.944197 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.947034 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.951751 26610 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:42.949138 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:42.954967 26609 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:42.881552   456 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:42.956732   456 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:42.957103   456 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.959482 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:42.961023 26612 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:09:42.978356   494 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:42.979168   494 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.861586   530 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:42.984143 26754 raft_consensus.cc:2410] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:09:42.882071   505 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:42.986799 26685 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.014533 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.009949   493 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:43.019865   493 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.035992 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.037192 26612 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.048581   349 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.054601   528 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:43.056309 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 102173us
I20260709 13:09:43.086187 26761 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:43.091405 26609 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:09:43.096463   459 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.096797   494 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.097051   459 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.099102   459 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.102355   327 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.102897   327 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.104310 32621 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.105108   327 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.105808 32621 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.105966 32667 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:09:43.106336 32621 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.106693 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2292) took 1119 ms. Trace:
I20260709 13:09:43.097368   530 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:43.107221 26607 rpcz_store.cc:276] 0709 13:09:41.986796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.986934 (+   138us) service_pool.cc:224] Handling call
0709 13:09:42.037168 (+ 50234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.472019 (+434851us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002d4c20. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:09:43.105649 (+633630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.105683 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.105731 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:43.105774 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.106504 (+   730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.106634 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246263,"spinlock_wait_cycles":428910336}
I20260709 13:09:43.109117   493 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.111160 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:43.111188 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 164816us
I20260709 13:09:43.112428   552 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:42.947160   523 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.113823 27318 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:43.114873   523 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:43.116896   547 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.005s
I20260709 13:09:43.112428 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:43.120711   514 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.870s	user 0.021s	sys 0.000s
I20260709 13:09:43.123826 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:43.111528 32612 consensus_meta.cc:287] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.008s
W20260709 13:09:43.127473 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 287798us
I20260709 13:09:43.126853   494 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.143644 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.093642   495 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.138433 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:43.161011 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.161727 26612 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.162009 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.163712 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.160357 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.164671 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:43.155134   476 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:43.231572 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.154351   390 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.240088 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.241716 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:43.157239   552 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:43.141860   530 consensus_queue.cc:1059] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:43.172048   568 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:43.148993   483 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:09:43.166859   324 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:09:43.229058   352 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.306438   352 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.308545   352 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.308154   411 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.310511   582 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:43.310930   582 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:43.311005   411 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.294317   505 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.171597   495 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.241041   494 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:43.270810   518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.024s	sys 0.059s
I20260709 13:09:43.255434   476 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:43.262007   552 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.229104   595 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:09:43.297119 27313 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
W20260709 13:09:43.355583 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 294851us
I20260709 13:09:43.256088   390 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.257210   596 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:09:43.282944 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.318277   411 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:43.402550 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.403291 26610 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:09:43.348445   505 raft_consensus.cc:3055] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:43.407523 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.408591 26609 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:43.163427 32612 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:43.316068 26607 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:43.296893 32621 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:43.312729   503 consensus_meta.cc:287] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.528s	user 0.018s	sys 0.000s
I20260709 13:09:43.410542 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:43.411036   503 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.411734 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:43.412043 26687 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:43.412523   316 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:43.412756 32621 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:43.412926   316 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.413182 32621 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.413326   316 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.413559 32621 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.326444   567 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:43.332015   601 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:09:43.318102   582 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.417059   582 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:43.327551   598 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:09:43.326315   552 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:43.320762   518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.024s	sys 0.059s
I20260709 13:09:43.301364   349 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.168371   514 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:43.323009   494 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:43.360244 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 77433.2us
I20260709 13:09:43.314735   568 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.358734   560 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:43.359519 26612 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:09:43.360322   476 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:43.315338 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75374.9us
I20260709 13:09:43.420703 26757 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.422415 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:43.429039 26686 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.423795 27317 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.429387 26650 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.424849 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:43.425855 27321 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:43.403746   551 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:43.431515 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:43.433360 26683 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 12: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.433022 26724 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.431937 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.435030 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:43.435372 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:43.420925   505 raft_consensus.cc:740] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:43.439147 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.439653 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.441502 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:43.437907 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:43.442590 27317 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.443215 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.433473   349 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:43.425726   514 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.440281 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.445549 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.432991   551 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.481956 26612 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:43.470206 26757 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:43.480521 26758 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:43.446321 32612 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:43.507957 32621 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.511349 32612 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:43.511857 32612 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.511942 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.513056 32621 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:43.513391   599 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:09:43.519884   572 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:43.521605 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.522111 27313 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:43.522243 26612 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.440646   352 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:43.447423   514 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.461094   411 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.428635   560 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.462430   319 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:43.540043 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.540290   319 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:43.448864   406 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.540669 26760 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:43.444657 32148 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:43.541277   319 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.447381   530 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:43.468281   316 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.536173   352 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:43.536844   597 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:09:43.541545   560 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:43.542635 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.543313 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.531042 26612 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:43.556878 26609 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:43.461520   483 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:43.475059   495 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.541469 32148 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.561957 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.562747 26607 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:43.520653   493 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:43.509918   551 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.476190   390 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.553810 26758 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:43.447820   508 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:09:43.448585   565 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.098s
I20260709 13:09:43.557821 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:43.568114 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:43.547259 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:43.572584   456 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.014s
I20260709 13:09:43.552662   316 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.551122   530 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:43.473337   505 consensus_queue.cc:260] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.576942   494 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.579561   568 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.583388 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.584412   503 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.584422   587 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:43.585177   352 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.585610 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.611707 26607 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
W20260709 13:09:43.587074   535 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.950s	user 0.023s	sys 0.003s
I20260709 13:09:43.594300 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.624629 26758 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:43.559527   483 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.604753 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:43.618965 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.626546 26760 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:43.550732 32612 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.614346   607 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:43.628029   483 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.628271   390 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:43.615701   456 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.631397   505 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.630239   535 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.633762   565 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:43.659449   607 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:43.681984   548 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:43.682487   607 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.689455   359 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.690224   359 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.696313 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2264) took 1194 ms. Trace:
I20260709 13:09:43.696564   571 raft_consensus.cc:3055] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:43.697052   571 raft_consensus.cc:740] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:43.696887 26757 rpcz_store.cc:276] 0709 13:09:42.502245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.502730 (+   485us) service_pool.cc:224] Handling call
0709 13:09:43.696099 (+1193369us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400139054. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:43.696234 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939254016}
I20260709 13:09:43.698033   571 consensus_queue.cc:260] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.698486 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.699429   571 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.700282 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.701017 26757 raft_consensus.cc:2376] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15. Re-sending same reply.
I20260709 13:09:43.702049 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.703043 27286 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:43.709363 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.712842 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.668947   390 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.719795 26606 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:43.721175 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.726927 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.682551   548 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.727918 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
W20260709 13:09:43.750898   608 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.327s	user 0.000s	sys 0.000s
I20260709 13:09:43.758352 26752 raft_consensus.cc:1275] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:43.760571 26754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 2313) took 1095 ms. Trace:
I20260709 13:09:43.756547 32148 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:43.760998 26754 rpcz_store.cc:276] 0709 13:09:42.665295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.682475 (+ 17180us) service_pool.cc:224] Handling call
0709 13:09:43.760354 (+1077879us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540014f5d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:43.760514 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585487744}
I20260709 13:09:43.761441   350 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:43.761890   350 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:43.762625 26754 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:43.762768   350 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.764000 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39266 (request call id 698) took 1455 ms. Trace:
I20260709 13:09:43.764601   350 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.764386 27316 rpcz_store.cc:276] 0709 13:09:42.308847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.309378 (+   531us) service_pool.cc:224] Handling call
0709 13:09:43.763807 (+1454429us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54008516d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:43.763936 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021482752}
I20260709 13:09:43.766280 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:43.766669   591 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.898s	user 0.000s	sys 0.002s
I20260709 13:09:43.768704 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 768) took 1113 ms. Trace:
I20260709 13:09:43.770386   535 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.769073 26680 rpcz_store.cc:276] 0709 13:09:42.655152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.655274 (+   122us) service_pool.cc:224] Handling call
0709 13:09:42.655656 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.656121 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:42.656426 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.823231 (+166805us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.823712 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.823838 (+   126us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:42.823870 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.823935 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.766041 (+942106us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:43.768372 (+  2331us) raft_consensus.cc:1685] finished
0709 13:09:43.768476 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.768649 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":146,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":102,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":133864192,"thread_start_us":166560,"threads_started":1,"wal-append.queue_time_us":211929}
I20260709 13:09:43.774864   552 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.829348 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.776499 26605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3539) took 2075 ms. Trace:
I20260709 13:09:43.783694 32612 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.673491   495 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:09:43.785516   514 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.787134 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55264 (request call id 2271) took 1539 ms. Trace:
I20260709 13:09:43.834699 26678 rpcz_store.cc:276] 0709 13:09:42.247644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.263603 (+ 15959us) service_pool.cc:224] Handling call
0709 13:09:43.786900 (+1523297us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54000b6154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:43.787060 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068606848}
I20260709 13:09:43.836383 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.837913 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:43.716375   589 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.710681   518 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:43.840389   518 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:43.841666   518 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.843320   518 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:43.839248 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.846625 26678 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.705507   565 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:43.704602   530 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.720620   390 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:43.792971 26684 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:43.858724 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.796485 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3553) took 1352 ms. Trace:
I20260709 13:09:43.796746   549 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:43.800525 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.859572 26603 rpcz_store.cc:276] 0709 13:09:42.444511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.449641 (+  5130us) service_pool.cc:224] Handling call
0709 13:09:42.449953 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.606645 (+156692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.606679 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.606734 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:42.606775 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.796261 (+1189486us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400088c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:43.796307 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.796424 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359908096}
W20260709 13:09:43.860198 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59774.4us
I20260709 13:09:43.803479 26686 raft_consensus.cc:1240] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:43.804951 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:43.806756 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.810433 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.811491 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.813927 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3602) took 1286 ms. Trace:
I20260709 13:09:43.861867 26679 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:43.862157 26687 rpcz_store.cc:276] 0709 13:09:42.527231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.527384 (+   153us) service_pool.cc:224] Handling call
0709 13:09:42.527817 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.412421 (+884604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.813680 (+401259us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540002a3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:43.813867 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033138560}
I20260709 13:09:43.862850 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.863162 26679 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:43.814255   411 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.863545 26687 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.819151 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.819913 27317 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
W20260709 13:09:43.820149 26685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3597) took 1301 ms (client timeout 1633 ms). Trace:
W20260709 13:09:43.865103 26685 rpcz_store.cc:269] 0709 13:09:42.518900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.519068 (+   168us) service_pool.cc:224] Handling call
0709 13:09:43.799609 (+1280541us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000b5754. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:43.820068 (+ 20459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937036544}
I20260709 13:09:43.825448 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:43.866092 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.828137 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:43.830072 26756 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:09:43.867175 26681 raft_consensus.cc:2393] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.790087 26682 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:09:43.833004 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 196444us
I20260709 13:09:43.867215 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.868654 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.868935 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:43.869905 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.830086 26605 rpcz_store.cc:276] 0709 13:09:41.701150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.701278 (+   128us) service_pool.cc:224] Handling call
0709 13:09:41.701536 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.731069 (+ 29533us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:41.938410 (+207341us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.609188 (+670778us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.837918 (+228730us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b18004a4c40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f01a5a40 00007f40f01a04e4 00007f40f01a0455 00007f40f3288060 00007f40f329a716 00007f40f32ab287 00007f40f32ab208
0709 13:09:43.126304 (+288386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.126357 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:43.126405 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.694722 (+568317us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b18004a4c40. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:43.776260 (+ 81538us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001f5c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:43.776308 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.776443 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70032,"prepare.queue_time_us":46786,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":516622,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6998,"spinlock_wait_cycles":88665472,"thread_start_us":1132441,"threads_started":3,"wal-append.queue_time_us":761899,"wal-append.run_cpu_time_us":1564,"wal-append.run_wall_time_us":1005448}
I20260709 13:09:43.872655 26685 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.873705 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:43.874195 26612 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:43.874255 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 55219.6us
I20260709 13:09:43.874897 26651 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.875947 26651 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.880445 26755 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 21: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:43.880681 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:43.881253 26650 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:43.881486 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:43.885129 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3557) took 1439 ms. Trace:
I20260709 13:09:43.885665 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.885490 26611 rpcz_store.cc:276] 0709 13:09:42.445770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.451230 (+  5460us) service_pool.cc:224] Handling call
0709 13:09:42.451504 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.730523 (+279019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.884918 (+1154395us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400162954. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:43.885079 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640214784}
I20260709 13:09:43.887476 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:43.891603   411 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.891790   316 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:43.892351   316 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:43.893164   316 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.902640   548 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.903373   514 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.903851 26679 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.856724   551 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.878444 32621 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:43.879033   476 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:43.878964   494 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.906364   551 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.866196   547 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:43.907099   547 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:43.907940 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:43.934947 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:43.938127 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:43.946467 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 65294.7us
I20260709 13:09:43.853053   562 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:43.873905   589 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.040503 26757 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 14: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:44.066207 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 178795us
I20260709 13:09:44.038544 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.066948 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:44.067792 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.068552 26754 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:44.069891 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.072177 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:43.994131 27313 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:43.879627 32612 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.070876 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:44.058765   612 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:09:44.090899 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:43.906366   476 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.880832   508 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:44.093254 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.099390 26754 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.077725   348 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.038340 32621 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.059213   582 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.108727 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:44.110035 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:43.904438   359 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:43.910542   493 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:43.910239   560 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:43.887450   360 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:44.154575   360 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.154641   560 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:44.155194   360 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.156054   560 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.065030   349 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.077520   494 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:44.079953   562 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.160043   349 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.060348   503 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:43.993566   401 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:43.880189   549 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.097427 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.095072   532 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:44.065970   587 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.111186   534 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:44.111819   606 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.112267   588 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.115551   565 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.115906   603 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:44.116410   456 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:44.210955   579 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.426s	user 0.000s	sys 0.011s
I20260709 13:09:44.119381 26684 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:09:44.214777   483 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
I20260709 13:09:44.116808 32621 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.217370 32621 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:44.083850   552 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.098803   411 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:44.223104   411 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.223501   411 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:44.098810   476 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:44.226882   349 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.228026   562 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.201848   494 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.229876   494 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.208214   588 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.231909   494 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.232380 26682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2282) took 1628 ms. Trace:
I20260709 13:09:44.205804   606 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.232856   603 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:44.233260   603 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:44.234125   603 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.234642   606 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.232892 26682 rpcz_store.cc:276] 0709 13:09:42.604009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.604137 (+   128us) service_pool.cc:224] Handling call
0709 13:09:43.789653 (+1185516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.867811 (+ 78158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.232156 (+364345us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000b6150. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:44.232316 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725769984}
I20260709 13:09:44.235380   603 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:44.162328 26610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.036s
W20260709 13:09:44.240082 26610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.017s	sys 0.036s
I20260709 13:09:44.202302   587 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:44.178534 26575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.046s	sys 0.087s
W20260709 13:09:44.241828 26575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.047s	sys 0.087s
I20260709 13:09:44.242170   548 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.098630   595 consensus_queue.cc:1048] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:09:43.993497   490 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.085726   547 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.248054   490 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.250442   490 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:44.250254   360 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.252656   547 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.198628   503 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:44.254335   503 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:44.255966   505 consensus_meta.cc:287] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:09:44.132735   582 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.257601 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.258013   582 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.258797 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.232378   588 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.134030   508 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.260701   508 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.263259   508 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.264232 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.264212   411 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.202566 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.177796   438 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.266323 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.266845   438 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.268977   438 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:44.269793   549 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:44.209146 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.241856   587 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.210572   534 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:44.192265   401 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:43.355583 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.276906 26682 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
W20260709 13:09:44.280355 26502 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 117) took 31442 ms (client timeout 15000 ms). Trace:
I20260709 13:09:44.281684   401 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.221948 26503 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.195724   532 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.283902   532 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.285924   476 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.289609   360 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.289088 26503 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.290814 26753 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:44.294516 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.296489 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:44.200533 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 103203us
I20260709 13:09:44.107359   348 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.300300 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.301697 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.274961 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.304250 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.272517   534 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.306710 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.160454 32612 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.263969   508 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.314056   595 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:44.313994   588 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:44.313890   548 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.310019   587 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.313934   549 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.291332 26503 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 13 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:44.159555   390 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.319875 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.317471 26681 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
I20260709 13:09:44.327399 26759 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:44.326754 27319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.016s	sys 0.027s
I20260709 13:09:44.205366   493 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:44.339679 26758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.008s	sys 0.030s
W20260709 13:09:44.341289 26758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.030s
W20260709 13:09:44.328572 27319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.016s	sys 0.027s
I20260709 13:09:44.289125   411 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:44.390041 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.011s	sys 0.011s
W20260709 13:09:44.390506 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.011s
I20260709 13:09:44.312477   360 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:44.317382   588 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:44.215272   483 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.314406   505 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.402035 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.316864   348 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.416905 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.421468 26503 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 11 to 13, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 13 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:09:44.413048   402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.007s	sys 0.016s
W20260709 13:09:44.413314 26577 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.002s	sys 0.026s
W20260709 13:09:44.423149   402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.016s
W20260709 13:09:44.423170 26577 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.002s	sys 0.026s
I20260709 13:09:44.389232   532 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:44.423882 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 599816us
I20260709 13:09:44.425442   532 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.427595 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.428625 26753 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:44.314654 32612 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.430022 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.434016 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.435480 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.436142 26679 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:44.436301 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.436434 26759 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
W20260709 13:09:44.433573 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.439404 26756 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:44.440166 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.444846 26759 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:44.319216   587 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.319234   508 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.441308 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.441769 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.405217   493 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.442806 26752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.018s
I20260709 13:09:44.442930 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:44.453732 26752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.018s
I20260709 13:09:44.455148 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.423292 26503 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.470125 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.467286 26679 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:44.473430 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.476354 26686 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:44.458576   505 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.493022 26759 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:44.470927   476 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.471836   492 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:44.501858 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.520004 26753 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:44.505041 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.507053 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.515892 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:44.522068 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:44.522727 26759 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:44.470628   493 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:44.499948   473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.013s	sys 0.024s
I20260709 13:09:44.530718   548 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.540025   513 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:09:44.540809 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.541070   456 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.537616 32433 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:44.540516   548 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:44.516747 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.542740 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.539278 26753 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:44.567214   473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.014s	sys 0.025s
I20260709 13:09:44.567958   621 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.568629   621 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.567220   586 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:44.567517   622 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:44.574321 26761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.013s
W20260709 13:09:44.585966 26761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.013s
W20260709 13:09:44.575589 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 435865us
I20260709 13:09:44.530913   407 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.500347   505 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.572865   476 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.532766   508 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.531206   552 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.582464 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:44.503894   360 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:09:44.595152 26760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.023s	sys 0.032s
I20260709 13:09:44.500648   588 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:44.629949 26760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.026s	sys 0.035s
I20260709 13:09:44.626271   390 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.588757   532 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:44.536111   492 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.628139   567 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.580253   586 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:44.632819 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.678356 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:44.686183 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53443.5us
I20260709 13:09:44.689396   438 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:44.637606   552 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.689977   438 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.691694   552 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.592154   602 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:09:44.692736   438 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.693089   602 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:44.693441   602 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:44.693639   551 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:44.280804 26502 rpcz_store.cc:269] 0709 13:09:12.837698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.838616 (+   918us) service_pool.cc:224] Handling call
0709 13:09:44.280257 (+31441641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:36.252628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:36.525143 (+272515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:36.525208 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:09:36.525236 (+    28us) tablet.cc:662] Decoding operations
0709 13:09:36.526841 (+  1605us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:36.526986 (+   145us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:36.527037 (+    51us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:36.708947 (+181910us) tablet.cc:701] Row locks acquired
0709 13:09:36.709002 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:09:36.709205 (+   203us) write_op.cc:270] Start()
0709 13:09:36.709367 (+   162us) write_op.cc:276] Timestamp: P: 1783602576709126 usec, L: 0
0709 13:09:36.709409 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:09:36.796071 (+ 86662us) log.cc:844] Serialized 5300 byte log entry
0709 13:09:37.616732 (+820661us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328be28 00007f40f6cc6581 00007f40f6cc5d58 00007f40f6cca9f1 00007f40f6cca9a9 00007f40f6cca939 00007f40f6cca901 00007f40f6cc9b2d 000000000038f354 000000000038f199
0709 13:09:38.043639 (+426907us) op_driver.cc:464] REPLICATION: finished
0709 13:09:38.235562 (+191923us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f01860ac 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f6cc6ef0
0709 13:09:38.729663 (+494101us) write_op.cc:301] APPLY: starting
0709 13:09:38.734635 (+  4972us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:38.894752 (+160117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:38.894810 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:38.943547 (+ 48737us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:38.944958 (+  1411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:09:38.945084 (+   126us) write_op.cc:312] APPLY: finished
0709 13:09:38.945759 (+   675us) log.cc:844] Serialized 121 byte log entry
0709 13:09:39.073952 (+128193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.093149 (+ 19197us) write_op.cc:454] Released schema lock
0709 13:09:39.136213 (+ 43064us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:39.242336 (+106123us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.245961 (+  3625us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":954681,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":614030,"apply.run_cpu_time_us":42542,"apply.run_wall_time_us":500401,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":402523,"prepare.run_cpu_time_us":76367,"prepare.run_wall_time_us":1364372,"raft.queue_time_us":619712,"raft.run_cpu_time_us":13409,"raft.run_wall_time_us":495830,"replication_time_us":1334041,"spinlock_wait_cycles":48620032,"thread_start_us":1373763,"threads_started":5,"wal-append.queue_time_us":692655,"wal-append.run_cpu_time_us":29664,"wal-append.run_wall_time_us":2410016}]]}
I20260709 13:09:44.694221   551 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.687490 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:44.710736 27287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.017s	sys 0.055s
W20260709 13:09:44.711108 27287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.017s	sys 0.055s
I20260709 13:09:44.712050 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:44.713807 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:44.687240   483 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.702230   411 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:44.709945   494 raft_consensus.cc:2764] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
W20260709 13:09:44.725961 26687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.012s	sys 0.030s
W20260709 13:09:44.714102   571 consensus_meta.cc:287] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 1.014s	user 0.006s	sys 0.005s
W20260709 13:09:44.737820 27284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.008s	sys 0.013s
I20260709 13:09:44.738529 26679 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
W20260709 13:09:44.738647 27284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.013s
I20260709 13:09:44.738941 26679 pending_rounds.cc:85] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 11
I20260709 13:09:44.712193   587 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.740875 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.741081 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:44.741560 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.731014 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:44.742367 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.739399 26679 pending_rounds.cc:107] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 18.12
W20260709 13:09:44.731434 26687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.013s	sys 0.030s
I20260709 13:09:44.713120 32612 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:44.730273 26754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.018s	sys 0.014s
I20260709 13:09:44.688086   567 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.751569 26679 raft_consensus.cc:2889] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:44.752692 26754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.014s
I20260709 13:09:44.750030 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:44.752461 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.750833 26684 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:44.756605 26759 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:44.713013   352 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:09:44.721685   411 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:44.765260 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.759305 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.754185 27321 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:44.694235   602 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:44.739202   607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.006s
I20260709 13:09:44.730010   634 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:44.739796   530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.001s	sys 0.018s
W20260709 13:09:44.778254 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 197298us
W20260709 13:09:44.764870 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 724110us
I20260709 13:09:44.755532   316 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:44.779281   530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.002s	sys 0.019s
W20260709 13:09:44.792997   632 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:09:44.760653 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.767717   411 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:44.767747   586 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.801563 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.802775 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:44.810698 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:44.776475 26759 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:44.793366   360 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:44.815366 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:44.779580   493 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:44.775259   607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.013s	sys 0.006s
W20260709 13:09:44.876199 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 74707.4us
I20260709 13:09:44.777567 32433 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:44.821907 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:44.822485   584 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:44.875792   624 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:09:44.883786 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 709) took 1204 ms. Trace:
I20260709 13:09:44.884334   505 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.813961   602 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:44.884191 27319 rpcz_store.cc:276] 0709 13:09:43.679575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.679764 (+   189us) service_pool.cc:224] Handling call
0709 13:09:43.680195 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.684209 (+  4014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.684247 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.684807 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.343100 (+658293us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:44.343162 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.343260 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.883517 (+540257us) raft_consensus.cc:1685] finished
0709 13:09:44.883537 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.883653 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1200,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":657859,"threads_started":1,"wal-append.queue_time_us":852999}
I20260709 13:09:44.885910 32148 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.883786 32417 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:44.886487 32417 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:44.828038   627 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:09:44.828114 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:44.829783 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:44.832644 26612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2316) took 1038 ms. Trace:
I20260709 13:09:44.759579 26503 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.793294   551 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:44.834548 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3604) took 1033 ms. Trace:
W20260709 13:09:44.836912   625 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:09:44.839464   611 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 1.079s	user 0.013s	sys 0.012s
I20260709 13:09:44.842496   567 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:44.844040   630 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:09:44.805603   548 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.812332   316 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.934943   316 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.846518 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2315) took 1149 ms. Trace:
I20260709 13:09:44.790306   634 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:44.936484 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2283) took 1157 ms. Trace:
I20260709 13:09:44.936906 26680 rpcz_store.cc:276] 0709 13:09:43.779516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.785356 (+  5840us) service_pool.cc:224] Handling call
0709 13:09:43.785686 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.786003 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.786031 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.786460 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.390933 (+604473us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:44.390989 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.391076 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.936260 (+545184us) raft_consensus.cc:1685] finished
0709 13:09:44.936285 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.936424 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3507,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12095,"thread_start_us":604086,"threads_started":1,"wal-append.queue_time_us":786617}
I20260709 13:09:44.937763   634 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:44.848049 26756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 750) took 1035 ms. Trace:
I20260709 13:09:44.938572 26756 rpcz_store.cc:276] 0709 13:09:43.812624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.884593 (+ 71969us) service_pool.cc:224] Handling call
0709 13:09:44.847857 (+963264us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54000dcad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:44.847997 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855928576}
I20260709 13:09:44.849141 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:44.849673   637 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:44.940469 26757 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:44.842630   631 log.cc:927] Time spent T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:09:44.941993   644 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:09:44.942549 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2285) took 1366 ms. Trace:
I20260709 13:09:44.944024 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2318) took 1246 ms. Trace:
I20260709 13:09:44.942917 26761 rpcz_store.cc:276] 0709 13:09:43.576152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.614576 (+ 38424us) service_pool.cc:224] Handling call
0709 13:09:43.616888 (+  2312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.617355 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:43.798567 (+181212us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b480015c258. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f81b9aa1 00007f40f81b0b37 00007f40f81b09ca 00007f40f82a826f 00007f40f82a7f37 00007f40f82bc55c 00007f40f82bc508 00007f40f82bc488 00007f40f82bc443 00007f40f82bb6ec 00007f40f71e5a96
0709 13:09:44.007639 (+209072us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.660467 (+652828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.682301 (+ 21834us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.682460 (+   159us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:44.682492 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.682557 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.942279 (+259722us) raft_consensus.cc:1685] finished
0709 13:09:44.942368 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.942494 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73911,"prepare.queue_time_us":70675,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":95481,"raft.run_cpu_time_us":2492,"raft.run_wall_time_us":187336,"spinlock_wait_cycles":3971968,"thread_start_us":958900,"threads_started":2,"wal-append.queue_time_us":766479}
I20260709 13:09:44.944396   621 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:44.850999 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.945503 26760 rpcz_store.cc:276] 0709 13:09:43.696861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.699745 (+  2884us) service_pool.cc:224] Handling call
0709 13:09:43.700099 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:43.700492 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:43.721391 (+ 20899us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.635514 (+914123us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:44.636254 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:09:44.636425 (+   171us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:44.636469 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.636556 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.846219 (+209663us) raft_consensus.cc:1685] finished
0709 13:09:44.846239 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.846436 (+   197us) inbound_call.cc:177] Queueing success response
0709 13:09:44.853472 (+  7036us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003dfae0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a3557 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
Metrics: {"mutex_wait_us":37269,"prepare.queue_time_us":24159,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":3296,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":35729,"spinlock_wait_cycles":7371648,"thread_start_us":843558,"threads_started":1,"wal-append.queue_time_us":963327}
I20260709 13:09:44.852313   635 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:44.856156   622 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:44.856436 26605 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:44.949990 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.857910   348 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:09:44.812016 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 51445.9us
I20260709 13:09:44.957921 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.865957 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.867623 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.961406 26754 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:09:44.871040 26606 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:44.964043 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.964813 26758 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:44.872646 27318 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 14.
W20260709 13:09:44.884660 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62843.5us
I20260709 13:09:44.884207 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.893245 27313 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 11.
I20260709 13:09:44.895010 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.967114 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:44.967438 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:44.968727 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.968828 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:44.868788 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.972035 26759 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:44.867609   503 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:44.897542 26610 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:44.894804 26612 rpcz_store.cc:276] 0709 13:09:43.793802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.793957 (+   155us) service_pool.cc:224] Handling call
0709 13:09:43.794227 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.874622 (+ 80395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.832440 (+957818us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54003f0f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:44.832589 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183503104}
I20260709 13:09:44.911978 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:44.984136 26756 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:44.896529 26608 raft_consensus.cc:2393] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:44.920562   492 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:44.922587 26503 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:44.887262   360 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:44.886912 32417 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.999147 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.956681 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:45.001084 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:44.823693   532 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:44.974789 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:44.984433 27319 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.002312 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:44.913141 26683 rpcz_store.cc:276] 0709 13:09:43.801299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.805629 (+  4330us) service_pool.cc:224] Handling call
0709 13:09:43.805901 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.883630 (+ 77729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.883697 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.883736 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:43.883767 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.834343 (+950576us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54000b5c54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:44.834389 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.834496 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178368896}
I20260709 13:09:44.983994 26605 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:44.939548   547 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.000s
W20260709 13:09:44.948400   560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.001s	sys 0.051s
I20260709 13:09:44.988855 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.032498 26682 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:44.990607 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:45.034646 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:45.035053 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:45.030231 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.037318 26610 raft_consensus.cc:2393] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:44.987582 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:44.944365 26752 rpcz_store.cc:276] 0709 13:09:43.697673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.759518 (+ 61845us) service_pool.cc:224] Handling call
0709 13:09:43.787990 (+ 28472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.792958 (+  4968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.793002 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.833116 (+ 40114us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.454347 (+621231us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:44.454402 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.454495 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.842011 (+387516us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:44.943727 (+101716us) raft_consensus.cc:1685] finished
0709 13:09:44.943748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.943969 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4688,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":14032,"spinlock_wait_cycles":11061504,"thread_start_us":554004,"threads_started":1,"wal-append.queue_time_us":827289}
I20260709 13:09:45.002247 26756 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:45.037892 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:45.009023   652 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:45.009423 32667 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:45.013137   360 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.004647   458 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:45.005564   611 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:45.017659 26759 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:44.989297   503 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:45.017465 26503 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 8 to 10, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 10 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.019456 27319 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:45.023964   562 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:44.989204   548 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:09:44.956202   348 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:44.957381   635 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.103708   348 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.104686   635 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.105499   348 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:45.004956   494 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:45.107947   494 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.108475   494 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:45.028504 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.112064 26605 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:45.029328 26607 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:45.016566   492 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.113835   492 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.055546   411 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.116727   492 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.117033   411 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.056389   551 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:45.057744   319 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:45.062232 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.119237 26610 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:45.063319 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:45.031919   560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.001s	sys 0.051s
I20260709 13:09:45.087591 27318 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:45.091562   652 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:45.122484   458 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:45.122989   652 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.123692   458 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.095773 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.101732 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:45.131647 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:45.043154   508 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.042757   547 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.143452 26608 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:45.133843 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:45.053812   390 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:45.090396   503 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.088405   534 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.088254   360 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:45.166711 26759 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:45.171116 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.179699 32640 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.180239 32640 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.157258   407 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:45.181630   407 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:45.182056   407 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:45.157452   651 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.183179   651 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.184073   490 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:45.184509   490 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:45.185536   651 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.185357   490 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.186736   490 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:45.189414 32148 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:45.189504 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:45.195443 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.190055 32148 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.202768 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.146142   319 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:45.005293 32433 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.155826   513 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:45.210482 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:45.088032 32667 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:45.228528 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 94771.7us
I20260709 13:09:45.234402   552 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:45.182281 32640 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.235931   622 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:45.240212   562 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.241081 26503 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 15, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 15 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.243904 32148 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.164721   508 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.128189 32612 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:09:45.247558 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 752) took 1329 ms. Trace:
I20260709 13:09:45.246590 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:45.264112 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.265599 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.265741 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.165158   547 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:45.267459 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.027s
I20260709 13:09:45.228845   587 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:45.272087 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.027s
I20260709 13:09:45.275064   552 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:45.223387   494 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.276124   552 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.276669   513 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.277143   513 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.277489   513 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.277942   494 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.246030   319 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:45.279073 32417 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:45.295536 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.294509 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:45.285003 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.303843 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.282806 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.305347 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:45.307410 26687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.017s	sys 0.016s
W20260709 13:09:45.307829 26687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.017s	sys 0.016s
I20260709 13:09:45.308768 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 776) took 1490 ms. Trace:
I20260709 13:09:45.309092 26687 rpcz_store.cc:276] 0709 13:09:43.818200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.864323 (+ 46123us) service_pool.cc:224] Handling call
0709 13:09:43.864572 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.864786 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:44.751954 (+887168us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.308359 (+556405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.308440 (+    81us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:45.308505 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.308588 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.308722 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":958895,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":10878,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9638,"thread_start_us":1442897,"threads_started":2}
I20260709 13:09:45.310848 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.311856 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.311928 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:45.275009 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 469132us
I20260709 13:09:45.313259 26611 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:45.314015 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.314136 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.315472 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.201542   534 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.316669 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:45.304944 26608 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:45.288347 26755 rpcz_store.cc:276] 0709 13:09:43.918364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.234359 (+315995us) service_pool.cc:224] Handling call
0709 13:09:44.234714 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.235075 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:44.235396 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.211382 (+975986us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.214232 (+  2850us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.228855 (+ 14623us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.247153 (+ 18298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.247220 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:45.247285 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.247366 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.247507 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31113,"prepare.queue_time_us":216029,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":137,"raft.queue_time_us":30656,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":5444,"thread_start_us":975348,"threads_started":2,"wal-append.queue_time_us":573461}
I20260709 13:09:45.283474   530 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.338038   316 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:45.352891 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:45.356560 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:45.357328 26683 raft_consensus.cc:2376] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20. Re-sending same reply.
I20260709 13:09:45.359790 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.360703 26683 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:45.377560 26605 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:45.380946 26681 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:45.284679 32612 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:45.283798   319 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.274102   587 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:45.377370   549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.001s	sys 0.015s
W20260709 13:09:45.396375 27316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.013s
I20260709 13:09:45.268791   562 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:45.399792 27316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.005s	sys 0.013s
I20260709 13:09:45.401072 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.431795 26685 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:45.432613 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 142091us
I20260709 13:09:45.424559 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.279624   494 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:09:45.392194   587 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:45.426862 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.434502 26679 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:45.437409   407 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.447908 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.448668 26679 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:45.386719   319 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:45.388548   603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.024s	sys 0.017s
W20260709 13:09:45.398291   588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.011s
W20260709 13:09:45.398054   549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.001s	sys 0.016s
I20260709 13:09:45.446350 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.394658 32417 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.461262 26682 raft_consensus.cc:2410] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:09:45.384049   530 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.391353   595 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:09:45.467397 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 427775us
W20260709 13:09:45.457393   588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.012s	sys 0.012s
I20260709 13:09:45.392055 32612 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:45.457557   603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.024s	sys 0.017s
I20260709 13:09:45.474838   549 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.464934   654 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:09:45.468791   547 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.472273   407 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:45.460140   650 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:09:45.497416   508 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.490345   549 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.514142   534 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.523797   530 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.525764   562 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.530361   513 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.531863   505 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:45.540292   505 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.542944   505 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.547857   549 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.533209   508 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:45.548885   508 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.535974   503 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.553494   503 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.551339   508 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.545697   513 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.557976   587 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.588527 26503 catalog_manager.cc:5697] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 9 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:45.595235 26503 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:09:45.602416 26503 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 6 to 11, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.605932 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3566) took 2165 ms. Trace:
W20260709 13:09:45.607218 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 430581us
I20260709 13:09:45.657797   587 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.668489 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.669842 26760 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:45.735697 26680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.033s
W20260709 13:09:45.736213 26680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.011s	sys 0.033s
I20260709 13:09:45.739809   352 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:45.739497 26503 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.743882 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2335) took 1324 ms. Trace:
I20260709 13:09:45.744367 26753 rpcz_store.cc:276] 0709 13:09:44.403203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.567347 (+164144us) service_pool.cc:224] Handling call
0709 13:09:44.567825 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.809602 (+241777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.809632 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.815029 (+  5397us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.312319 (+497290us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:45.312356 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.312429 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.683181 (+370752us) raft_consensus.cc:1685] finished
0709 13:09:45.703164 (+ 19983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.727411 (+ 24247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24264,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6742,"thread_start_us":732008,"threads_started":2,"wal-append.queue_time_us":663476}
I20260709 13:09:45.735424 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.751626 26761 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:09:45.608079 26604 rpcz_store.cc:276] 0709 13:09:43.440456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.441067 (+   611us) service_pool.cc:224] Handling call
0709 13:09:43.441364 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:43.441770 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:43.463851 (+ 22081us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.666828 (+202977us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:43.667517 (+   689us) log.cc:844] Serialized 52 byte log entry
0709 13:09:43.667687 (+   170us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:43.667733 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.667823 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.839174 (+1171351us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b2400139b38. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e209d 00007f40f2e1410e 00007f40f2e2b88c 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221
0709 13:09:45.525906 (+686732us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b2400139a18. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00299c4 00007f40f0027acb 00007f40f01e2dc9 00007f40f01e2a55 00007f40f01e1fb0 00007f40f2e58488 00007f40f2e58be8 00007f40f2e30398 00007f40f2e2b76a 00007f40f2e2abb6
0709 13:09:45.605090 (+ 79184us) raft_consensus.cc:1685] finished
0709 13:09:45.605178 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.605618 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50127,"prepare.queue_time_us":21959,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":61834,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":19206,"spinlock_wait_cycles":163818112,"thread_start_us":163208,"threads_started":1,"wal-append.queue_time_us":262277}
I20260709 13:09:45.739513 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:45.774156 26687 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.785169 32612 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.785506 32417 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:45.785830 27321 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:45.786008 32612 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:45.788815 26686 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:45.789250 26686 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:45.786139 32417 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:45.798246 32417 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.786123   684 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.801419   684 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.803833 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.804194 26754 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:45.804577 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.805424 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
W20260709 13:09:45.804052 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 67055.8us
I20260709 13:09:45.808426   670 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.809252   411 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.809428   670 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.810139   411 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.811914 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:45.812534 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:45.815328 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:45.816661 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.816982 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:45.818058 26605 raft_consensus.cc:2368] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21.
I20260709 13:09:45.787006 32612 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:45.819058 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.835804 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.836097 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:45.836633 26758 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:45.836885 26761 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:45.837657 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.840000 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:45.851328   548 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:45.854794 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:45.855057 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:45.860661 32417 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:45.861814 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:45.862671 26604 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.865051 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.865896 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:45.866401 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.867055   685 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:45.868091   685 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.868819   595 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:45.869580   595 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.870819   685 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.871963 32566 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:45.872411 32566 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:45.872773 32566 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:45.873034 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.855096 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:45.851933 26685 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:45.877017 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:45.867221 26752 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:45.858484 27321 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:45.880887 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:45.881175 26758 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:45.892362   571 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.893260   571 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.893693 26761 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:45.897047 32667 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.897590   571 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.897806 26681 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:45.902468 26681 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:45.898521   513 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:45.903774   513 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:45.903785 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.852581 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 297592us
W20260709 13:09:45.901176 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.895323 26760 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:45.871528   685 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:45.912058   685 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:45.913514 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:45.918082 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50409.9us
I20260709 13:09:45.918926   352 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:45.743068 26503 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 11 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:09:45.922562 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 71883.1us
I20260709 13:09:45.929180 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:45.930033 26679 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 12.
I20260709 13:09:45.934510 32417 consensus_queue.cc:1059] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:45.940928 32612 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.941982 26753 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:45.921223   685 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:45.915944   684 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:45.956573 26687 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:45.962163 27321 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:09:45.962977 26503 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 4 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 14 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.921732   548 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:45.969579   411 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:45.972421 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:45.981985 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:45.990800   548 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.946313   595 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:45.994100   348 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.888s	user 0.016s	sys 0.005s
I20260709 13:09:46.002895 26760 raft_consensus.cc:2368] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:45.997951 26686 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.011485 26604 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:45.999902   670 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:45.966369 26503 catalog_manager.cc:5697] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 10 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:46.042870 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52254.7us
I20260709 13:09:45.997413   352 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:46.044175   651 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.044906   651 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.045336   654 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:46.046401 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 66035.2us
I20260709 13:09:46.048344 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.036787 26753 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:46.053939   654 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:46.054507   654 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:46.058190 26503 catalog_manager.cc:5697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 12, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 12 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.060189   654 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.064936   654 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.064531 26503 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 13 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:46.068121 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 86342.9us
I20260709 13:09:46.071350   494 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:46.072075   494 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.073155   513 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.074554   494 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.077201   567 raft_consensus.cc:3055] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:46.077656   567 raft_consensus.cc:740] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:46.078660   567 consensus_queue.cc:260] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.078208 26503 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 9 to 15, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 15 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:46.081389 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 135933us
I20260709 13:09:46.047487 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.049288   681 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:46.090626 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.092154 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.093713   682 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:46.094194 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 167563us
I20260709 13:09:46.094302   587 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:46.094755 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:46.095734 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.088259 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.047461   651 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.115487 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:46.120448 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 73012.4us
I20260709 13:09:46.130226 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.130746 26754 raft_consensus.cc:2368] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:46.131601 26757 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
W20260709 13:09:46.132139 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43521.1us
I20260709 13:09:46.132368   584 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.131469 26651 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.135401 26681 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.125942   571 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:46.143941 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.143839   682 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.145248 32640 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:46.145274   407 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.006s
I20260709 13:09:46.148052   552 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:46.151968 26612 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:46.151837 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:46.196285 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 77332.5us
I20260709 13:09:46.155849   585 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:46.156229 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.156821   348 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.157284 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.157662 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.159266   458 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:46.160037 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.164304 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.168192   636 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:46.175735 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.176431   670 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:46.189169 26758 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:46.190112 26503 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 5 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 10 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:46.192438 26752 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:46.193038 26761 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:46.184911 32640 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.194000 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.138209   567 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.197811 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:46.218641 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62591.9us
W20260709 13:09:46.209626 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.196117   495 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:46.213981 26681 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.214756 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.207971 26756 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:46.205638   657 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.202406   348 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.207684   636 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:46.217622 32640 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.229627 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.241361 26605 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:46.211885   571 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:46.218549   352 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:46.250252 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:46.257688 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 98055.7us
I20260709 13:09:46.258288 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.258488 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:46.259760   319 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.678s	user 0.018s	sys 0.000s
I20260709 13:09:46.259984   548 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:46.237326   348 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.213877   670 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.267930   686 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:46.268985 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.269173 26686 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.269706   595 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:46.270020   547 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:46.270561 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53396.2us
I20260709 13:09:46.271130   671 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:46.273708 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.277621 26681 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
W20260709 13:09:46.285094   695 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:09:46.284976 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:46.286624   696 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.138s	user 0.002s	sys 0.001s
I20260709 13:09:46.289505   635 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:46.292923   682 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.294602 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.294653   495 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.248160   636 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.259342 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.269042   360 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.301967   547 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:46.283185 32566 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:46.304698   678 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:09:46.309238 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.261824   352 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.312810   699 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:46.314015 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.317739 26681 pending_rounds.cc:85] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 7
W20260709 13:09:46.323625 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 233909us
I20260709 13:09:46.260854   548 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:46.328922 26756 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:46.260381   319 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:46.331827 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58271.1us
I20260709 13:09:46.334612 26686 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:09:46.336165 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 155701us
I20260709 13:09:46.302593   595 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:46.350286 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.341230 26681 pending_rounds.cc:107] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:09:46.350761 26681 raft_consensus.cc:2889] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.316732   685 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.338877   654 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:46.327865   686 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:46.338086   547 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:46.341868 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 82613.4us
W20260709 13:09:46.374070 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 64940.7us
I20260709 13:09:46.352046 32433 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.348796 26686 pending_rounds.cc:85] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 8
I20260709 13:09:46.340395   352 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.342408   587 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:46.372922 26651 leader_election.cc:400] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:46.346196   458 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:46.376706 26686 pending_rounds.cc:107] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:46.378075 26651 leader_election.cc:403] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.371253 26759 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:09:46.350319   682 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:46.352672   595 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.384151 26686 raft_consensus.cc:2889] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:46.368034   493 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:09:46.373127   671 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.358021   670 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.363971 32612 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.370944   635 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.401448 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2322) took 1002 ms. Trace:
I20260709 13:09:46.382151   587 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:46.423331   587 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.424366 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3591) took 1139 ms. Trace:
I20260709 13:09:46.424211 32433 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.424762 26606 rpcz_store.cc:276] 0709 13:09:45.284489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.284875 (+   386us) service_pool.cc:224] Handling call
0709 13:09:45.285188 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.285527 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.285558 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.285988 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.787193 (+501205us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:45.787264 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.787371 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.295344 (+507973us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:46.423940 (+128596us) raft_consensus.cc:1685] finished
0709 13:09:46.423960 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.424186 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":232,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":12482432,"thread_start_us":437758,"threads_started":1,"wal-append.queue_time_us":712649}
I20260709 13:09:46.426688 32433 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.405880   534 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:46.415740 26686 rpcz_store.cc:276] 0709 13:09:45.399424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.401611 (+  2187us) service_pool.cc:224] Handling call
0709 13:09:45.401933 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.788515 (+386582us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400491220. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3207dc0 00007f40f32921c0 00007f40f3293231 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c
0709 13:09:46.268940 (+480425us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400491220. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3205a1d 00007f40f31ec1a4 00007f40f326e447 00007f40f3286fe7 00007f40f32887de 00007f40f3292b49 00007f40f3293416 00007f40f328fd8f 00007f40f328f83e 00007f40f8254419
0709 13:09:46.395525 (+126585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.401373 (+  5848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775203328}
I20260709 13:09:46.430984   411 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.431583   411 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.433826   411 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:46.434500   560 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:09:46.430480   635 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.435149   635 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.435858   596 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:09:46.437649   635 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:46.438566   635 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:46.438916 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 125058us
I20260709 13:09:46.439190   635 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.439857 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.441999   685 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.386950   682 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:46.407050   683 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
I20260709 13:09:46.407778   490 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:46.378455   699 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.406638   586 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:09:46.452527   682 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:46.448105 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75446.1us
I20260709 13:09:46.452042   670 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:46.461213 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.402077   654 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:46.474085   494 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.474306 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.474473   586 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:46.474967   586 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:46.474731   494 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.475966   586 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.477224   494 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.477314   586 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:46.468497 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69894.2us
W20260709 13:09:46.480378 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87598.3us
I20260709 13:09:46.475104   657 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:46.481401 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.480265 26726 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:46.487910 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.372272   548 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.494405 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.465278   411 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.459515   699 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.500909 26651 leader_election.cc:400] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:46.485702   685 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:46.502157 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.503202 26651 leader_election.cc:403] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.505394 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:46.453670 32612 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.496065 26759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:46.501032   407 raft_consensus.cc:2764] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:09:46.503188   684 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.510324 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.464355 32640 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.537940   671 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:46.538322   671 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:46.538681   671 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.539479 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.508582   657 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:46.509940 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48837.8us
I20260709 13:09:46.528422 26759 raft_consensus.cc:606] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.563148 26759 raft_consensus.cc:614] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.540061 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:46.515762 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.517975   701 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:09:46.419514   571 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.541477 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:46.502887   319 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:46.511965 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 217594us
I20260709 13:09:46.565951 26755 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:09:46.566139 26681 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:46.568827 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.572836 26754 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:46.510499   685 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:09:46.570431 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.573455 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:46.570951 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47279.9us
I20260709 13:09:46.568305 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.536459   684 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.510205   635 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.528487 32612 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:46.577502 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:46.580293 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 134373us
I20260709 13:09:46.585340   352 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.536360   547 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.575815 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.589957 26759 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:46.594702 32640 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.596944   352 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.531240   587 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.578171   684 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.608948 26754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:46.609751 26754 raft_consensus.cc:606] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.610177 26754 raft_consensus.cc:614] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.578173   651 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:46.540100   654 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.539646   348 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.562199   494 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:09:46.602967 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:46.604549 26758 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:46.612071 32612 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.613394   352 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:46.614945   547 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.616444 26611 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:46.577443   411 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.580912 32566 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:46.622416   704 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:46.613749   587 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.497359   686 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.628783   584 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:46.613579   636 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.632840   411 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.631063 32612 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.640749   636 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:46.641160   411 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.641674 32612 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:46.642094 27313 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:46.643167   360 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:46.643718   682 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.645985   682 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.646931   682 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:46.650255   567 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:46.651208   567 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.633209   699 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.653821   567 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:46.661410   348 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.669872 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.670607 27316 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
W20260709 13:09:46.671517 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 183514us
I20260709 13:09:46.672251   681 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:46.672643   681 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:46.672684   476 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:46.673489   476 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:46.673589   681 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:46.675165 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 174025us
I20260709 13:09:46.674810   476 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:46.677712 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 155268us
I20260709 13:09:46.683108 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.683858 26756 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:46.685451 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.690459 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.690636   560 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:46.693809   560 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.694288   560 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.694584   682 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:46.695005   682 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.695366   682 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:46.691536 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.696231 26758 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.688450 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.692420 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:46.698827 26756 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:46.702458 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.713593   657 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.720263   596 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:46.721117   495 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.721472   596 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:46.721882   596 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:46.724603 26757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:46.725224 26757 raft_consensus.cc:606] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.725526 26757 raft_consensus.cc:614] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.740270 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:46.737957 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49284.4us
I20260709 13:09:46.736940   717 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:46.737214   596 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.748741 26603 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:46.748541   717 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:46.749787 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.750329 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:46.750854 26752 raft_consensus.cc:606] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.751168 26752 raft_consensus.cc:614] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.751569   717 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:46.752102 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:46.752717 26678 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.758646 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.761294 26758 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:46.758338 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:46.767427 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 91616.8us
I20260709 13:09:46.768831   714 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:46.769423   714 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.769771   714 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.780618 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.744864   681 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:46.790619 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.791424 26681 raft_consensus.cc:2368] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:46.795025 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.793051 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.796809 26752 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.797410 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:46.797981 27321 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.800222 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.793843 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.801785 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:46.771649   657 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.802723 26651 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.809034 26755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:46.809702 26755 raft_consensus.cc:606] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:46.810082 26755 raft_consensus.cc:614] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:46.813062 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.813683 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.805706 26687 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:46.821739 26678 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:46.822716 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.826289 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:46.826650 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:46.809422   670 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:46.815397   685 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16.
I20260709 13:09:46.836122 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:46.837697   713 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:46.835213 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:46.838202   650 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:09:46.839313 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:46.839753   493 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.843587   585 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.845961 26752 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:46.851356 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.867641 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:46.851650 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47405.9us
I20260709 13:09:46.809012   657 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:46.815167   352 raft_consensus.cc:2804] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:46.837832 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.766340   684 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.861471 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:46.865895 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 75269.6us
I20260709 13:09:46.875973 26687 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:46.871016   596 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:46.805356   560 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.816764   699 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:46.854290   670 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.849380 32566 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.872273 26603 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:46.857910   494 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.886648   699 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:46.887066   670 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.887571 32566 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.893218 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.901365 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:46.874735   657 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:46.904048   595 consensus_meta.cc:287] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.005s
I20260709 13:09:46.904999 27314 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 2 to 9, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:46.911825 27321 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:46.873936   584 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:46.925770 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:46.992259   685 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:47.052946 32612 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:47.052714   685 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.053779 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.053586 32612 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.055569 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.056403   685 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.913370   699 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:47.055922 32612 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.057693   699 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.058274   595 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.058754   699 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:47.059365 26686 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.060240 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.912575   352 raft_consensus.cc:697] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:46.957296   494 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.061841   352 consensus_queue.cc:237] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.917459   411 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.996115 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.067937   411 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.070701   411 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.071070   584 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.071481   584 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:47.022094 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:46.912678   547 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:47.073714   547 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.075273 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:47.075882 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.076095 26757 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16.
I20260709 13:09:46.884593   348 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.076668   348 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.079722   348 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.081401 26757 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:09:47.081840 26757 pending_rounds.cc:85] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 13
I20260709 13:09:47.082144 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.082828 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.083540 26680 raft_consensus.cc:2368] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:47.083606 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.084421 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.084887 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.085599 26683 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 12.
I20260709 13:09:47.086756 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.087950 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.088451 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:47.082109 26757 pending_rounds.cc:107] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:09:47.089038 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.089380 26757 raft_consensus.cc:2889] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:47.091365   494 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.060850   595 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:46.879575   493 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:46.867431   713 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.096840 26680 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:47.100374 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.103809 26685 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:47.100876 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:47.050619 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 249231us
I20260709 13:09:47.125048   493 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.131109 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:47.131862 27315 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.133499 32566 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.134632   715 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:47.135327   715 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.115193   547 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.137069   571 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:47.137492   571 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:47.137669   715 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.138439   571 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.142396 26680 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:47.143782 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:47.161398   731 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:09:47.163591   571 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:47.168910   725 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:47.164656   560 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:47.170989   723 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:47.173246   684 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:47.175900 26610 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
W20260709 13:09:47.177977   671 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.001s
I20260709 13:09:47.178485   671 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.186367   713 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.189805 27315 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
W20260709 13:09:47.192461 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.315444 26753 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:09:47.316170 26753 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
W20260709 13:09:47.366313 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 478704us
W20260709 13:09:47.392930 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 485481us
I20260709 13:09:47.400833 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:47.405906 26679 raft_consensus.cc:2393] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:47.409056 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:47.410584 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:47.410651 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.411499 26761 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:47.414144 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:47.414881   732 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.415448   732 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.417971   732 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.419013   732 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.420645   352 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:47.421448   352 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.420279   732 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.423882   352 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.389309   684 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.427000   684 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.429476   684 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:47.427986 26650 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:47.429591   732 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.434253   670 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.440496 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.440671   476 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:47.440500   587 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:47.443899 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:47.446596   681 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
W20260709 13:09:47.494478   714 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
I20260709 13:09:47.405186   713 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:47.449959   571 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.414878 27317 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:47.470815   671 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.490298 26680 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:47.490549 26679 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:47.389226   493 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:47.504586 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 76927.6us
W20260709 13:09:47.506049 26576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.029s	sys 0.054s
I20260709 13:09:47.516964 26687 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
W20260709 13:09:47.534040 26576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.030s	sys 0.054s
W20260709 13:09:47.448700   682 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.002s
I20260709 13:09:47.517802 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.474256   584 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:47.519853 26578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.022s	sys 0.065s
I20260709 13:09:47.535625 26684 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 13:09:47.535722 26578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.023s	sys 0.065s
I20260709 13:09:47.537906 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:47.520278 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.534451 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 658055us
I20260709 13:09:47.516341   595 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:47.520452 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.545452 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:47.548995 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.549363 26576 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:47.544415 27285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.195:42613 timed out after 2.009s (SENT) [suppressed 7 similar messages]
I20260709 13:09:47.551293 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.552213 26680 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
W20260709 13:09:47.539271   712 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.037s
W20260709 13:09:47.555246 27319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.015s	sys 0.034s
W20260709 13:09:47.555630 27319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.015s	sys 0.034s
I20260709 13:09:47.555606 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:47.556111 26611 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:47.557080 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.550719 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:47.559484 26612 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.506172   657 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.570026 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.570250 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.552254 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.573071 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.573954 26681 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.539538   713 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:47.582334 26753 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:47.586906 26607 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:47.590946 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.598716 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.600190 26678 raft_consensus.cc:2393] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:47.594434 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:47.602795 26611 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:47.568569   552 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:47.558501   595 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:47.535199   571 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.542676   493 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.529335   714 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.613184 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.546065   682 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.607642 26687 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.617394 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:47.698941 26679 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:47.624356 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.624732 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:47.666370 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.619989 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.669903   713 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.678339 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.630856 26761 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:47.690667 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.681034 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:47.714172 26753 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:47.697657 26686 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:47.698621 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:47.715289 26754 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.700350 26758 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:47.671933   595 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.701882 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.699564 26684 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:47.696944 26755 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:47.715848 27316 raft_consensus.cc:2368] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18.
I20260709 13:09:47.715857 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.732704 26678 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:47.723719 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.736157 26761 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:47.721374 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:47.665699 32433 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:47.726294 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.733448 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.739387 26757 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16.
I20260709 13:09:47.726148 26752 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:47.741360 27319 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:47.743810 26684 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 17: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:47.747291 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.748370 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.722409   684 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:47.758201 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.739451   732 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.756682 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.716642   552 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:47.737447   699 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.749564 26680 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:47.723294   671 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:47.769652 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:47.770489 26757 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:47.757711   587 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:47.771517   587 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.773918   587 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.780244   571 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.781121 27312 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:47.782820   732 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.784329   532 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.785131   732 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.784885   532 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.791011   532 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.732919   654 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:09:47.749548   742 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:47.792483   742 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:47.792848   742 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:47.765796 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:47.780378   657 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:47.801910 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.805225 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.806679 26680 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:47.803619 26681 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 13.
I20260709 13:09:47.810616   552 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.814461   671 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.815130 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.816972   671 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.818358 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.819497 32640 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:47.820039 32640 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:47.821992 32640 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:47.822666 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:47.824011 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.761927   684 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.830921 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:47.831522 26756 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:47.833746 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.803791   699 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.839979 26754 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:47.840811 26758 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.836416 26755 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:47.841849 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.844756 26687 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:09:47.848291 26756 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:47.849004 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:47.743142 32433 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:47.849614 26759 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:47.860637 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:47.861713 26678 raft_consensus.cc:2410] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:09:47.864780 26726 leader_election.cc:400] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:47.866117 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:47.867710 26760 raft_consensus.cc:1240] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:47.808676   584 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.830968   684 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:47.805500   636 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:09:47.858347   571 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.882905   735 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:09:47.886231 32612 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:47.933090 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65864.4us
I20260709 13:09:47.936446   699 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:47.941772   710 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:47.973212 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:47.975417   746 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:09:47.975998 32433 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.987202 26612 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:47.991827   493 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.996264   682 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:47.968226   571 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.005671 26754 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:48.014055   654 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:48.019070 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.021373 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 460297us
I20260709 13:09:47.958670 26757 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:47.967741   710 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:48.042734 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63579.7us
I20260709 13:09:48.044157 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.041913   596 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.003574   571 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:48.058480 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 331950us
I20260709 13:09:48.059144 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:48.062131 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 115685us
I20260709 13:09:48.042435   714 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.073307   635 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:48.075838 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.070756 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.077004   635 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:48.081575 27285 leader_election.cc:400] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16.
I20260709 13:09:48.082041 27285 leader_election.cc:403] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.082852   635 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16.
I20260709 13:09:48.086357 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:48.090329 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:48.095554 26726 leader_election.cc:400] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 12 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13.
I20260709 13:09:48.007192   739 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:09:48.059963   745 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:48.097741 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.098985 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.092936 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.060134   682 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:48.102598 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.106369 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.107004 26604 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:09:48.057845   596 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.104472 26724 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.110889 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:48.114295 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:48.099078   657 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:48.118256   699 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:48.119254 32612 raft_consensus.cc:2804] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:48.119976 32612 raft_consensus.cc:697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:48.121119 32612 consensus_queue.cc:237] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.131426 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:48.132710   699 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.137115 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:48.139798   699 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:48.140446   699 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:48.141187   699 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:48.149150   670 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.149113 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:48.151176   650 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.153889 26726 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:48.156278 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:48.104177   671 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:48.163437 27316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39254 (request call id 912) took 1400 ms. Trace:
I20260709 13:09:48.104074   681 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:48.167884 27314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.020s
I20260709 13:09:48.069571   742 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:48.196135 27314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.021s
I20260709 13:09:48.192754 27316 rpcz_store.cc:276] 0709 13:09:46.763072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.772699 (+  9627us) service_pool.cc:224] Handling call
0709 13:09:48.163135 (+1390436us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540067f7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:48.163323 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074457856}
I20260709 13:09:48.111910   493 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:09:48.170578   657 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:48.211612 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.112691   682 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:48.221892 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 435362us
I20260709 13:09:48.223692 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.223991 27319 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:48.197922   681 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.214658   571 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:48.240636 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:48.249732 26679 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.003s
I20260709 13:09:48.250283 26679 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
W20260709 13:09:48.252221 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.225898   671 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:48.256275 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:48.166258   710 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.230890   681 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.285069   715 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:48.285844   715 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.289671   715 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.293906 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:48.297029 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.325152 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.326001 26604 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:48.256340   671 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:48.293535   654 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:48.344556 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:48.343403 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46471.9us
I20260709 13:09:48.345101 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.292341   670 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.346596 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.348402 26612 raft_consensus.cc:2368] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21.
I20260709 13:09:48.348834 26575 leader_election.cc:400] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18.
I20260709 13:09:48.352232 26575 leader_election.cc:403] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.353729 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.354127 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.301584   745 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:48.356962 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.357822 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.359740 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.362938 32433 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.364899   699 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.367029   699 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.354960   710 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:48.347357   654 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.372726   654 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.373661 32433 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18.
I20260709 13:09:48.387189   745 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.390230   745 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.346463   715 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:48.396003   715 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.396517   715 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:48.401829   764 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:48.402745 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.345331   671 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.361739 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:48.357127   751 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:09:48.422773 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.292737   756 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:09:48.427471 27319 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:48.386421   684 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:48.434219 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72815.3us
I20260709 13:09:48.417251   596 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.417479   745 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:48.445214   584 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:48.454924 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 255030us
I20260709 13:09:48.457234 26753 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:48.496735 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.506778 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.357266   657 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:48.500931 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 383342us
I20260709 13:09:48.531220 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:48.502133 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 348310us
I20260709 13:09:48.525461 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.454389   595 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.540896 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.503933 32612 raft_consensus.cc:3055] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:48.539149 26651 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.550069 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.552783 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.536574   654 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.448638 32433 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.529448   571 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.529109   699 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.551272 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.556340   352 raft_consensus.cc:2804] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:48.548597 32612 raft_consensus.cc:740] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:48.564203 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.576685 26609 raft_consensus.cc:3060] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.564875 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.565161 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.566557 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.577653 26603 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:48.567431 26610 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:48.577783 26612 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
W20260709 13:09:48.568560   753 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:09:48.573099   596 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:48.535276   682 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.561295 26683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2338) took 1061 ms. Trace:
I20260709 13:09:48.557420   742 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.577847 26604 raft_consensus.cc:2368] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21.
I20260709 13:09:48.580770 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.547204   670 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:48.530364   758 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:48.557147   494 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:48.564749   654 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:48.542150   595 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.619688 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:48.577062   571 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.589563 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.530150   745 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.586194 26683 rpcz_store.cc:276] 0709 13:09:47.492128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.492319 (+   191us) service_pool.cc:224] Handling call
0709 13:09:47.492820 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.493390 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.493434 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.494052 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.753971 (+259919us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:48.069003 (+315032us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.069937 (+   934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.070015 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.553442 (+483427us) raft_consensus.cc:1685] finished
0709 13:09:48.553474 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.553637 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476539,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":9320,"raft.queue_time_us":11653,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":17129,"thread_start_us":522735,"threads_started":2,"wal-append.queue_time_us":483114}
I20260709 13:09:48.623687 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.610317 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.624367 26604 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:48.624393 26682 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:48.608395   494 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.628569 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.629024 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.629703   571 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.630201 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.630489 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.630834 26681 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:48.631198 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.631963 26603 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:09:48.632792   775 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:48.627079 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.635018 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.628611   494 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:48.636112   650 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.630527 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.636652   650 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.631193 26685 raft_consensus.cc:2368] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20.
I20260709 13:09:48.637135 26680 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:48.629743 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.640550 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.641551 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.644088 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.642580 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.648097 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.651801 26612 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:48.666523 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.578953   699 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.611171   493 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:48.680969 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 147638us
I20260709 13:09:48.696722 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.700155 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.619390   670 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:48.704245 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.706862 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.711563 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:48.714038 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:48.703109 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.669782   760 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.668620   780 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.701170   758 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.680425   654 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:09:48.726365 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.745193 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:48.726418 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:48.701938   476 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:09:48.764171 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 213060us
I20260709 13:09:48.760201 26684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 800) took 1034 ms. Trace:
W20260709 13:09:48.760987 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 208424us
I20260709 13:09:48.786712 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.794181 26761 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:48.796825 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.797724 26759 raft_consensus.cc:2410] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:09:48.791277 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:48.810660 26611 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:48.815442 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 133431us
I20260709 13:09:48.781713 26684 rpcz_store.cc:276] 0709 13:09:47.725445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.801109 (+ 75664us) service_pool.cc:224] Handling call
0709 13:09:47.837194 (+ 36085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.837395 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:48.171235 (+333840us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.759255 (+588020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.759322 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:48.759900 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.759970 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.760144 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7237,"prepare.queue_time_us":444113,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":84268,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":20518,"thread_start_us":892991,"threads_started":3}
W20260709 13:09:48.818011 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.820147 26753 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:48.823884 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.824478 26753 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:48.830274 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:48.725206   760 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.836305 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:48.701771 32612 consensus_queue.cc:260] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.799012   571 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:48.840559 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.803534   635 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.841516 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:48.849282 26757 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:48.841615 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 138329us
W20260709 13:09:48.841804 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.746402   780 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.843959 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:48.851320 26761 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.813851   682 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.851948 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.819916   495 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:48.860098 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.868263 26755 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:48.870607 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.877092 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.805073   650 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.810398   788 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:48.888068 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:48.888729 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 722) took 1979 ms. Trace:
I20260709 13:09:48.889969 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:48.889110 27314 rpcz_store.cc:276] 0709 13:09:46.875501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.903810 (+ 28309us) service_pool.cc:224] Handling call
0709 13:09:46.904218 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.904654 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:47.531298 (+626644us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.214648 (+683350us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.216022 (+  1374us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:48.217108 (+  1086us) log.cc:844] Serialized 52 byte log entry
0709 13:09:48.217267 (+   159us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:48.217322 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.217407 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.364256 (+146849us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18003a0300. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1
0709 13:09:48.365715 (+  1459us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18003a0300. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:48.854739 (+489024us) raft_consensus.cc:1685] finished
0709 13:09:48.854774 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.854940 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":980,"prepare.queue_time_us":17404,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":157612,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":12821,"spinlock_wait_cycles":22539392,"thread_start_us":612727,"threads_started":1,"wal-append.queue_time_us":794542}
I20260709 13:09:48.893321 26612 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:09:48.893790 26612 pending_rounds.cc:85] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 11
I20260709 13:09:48.894047 26612 pending_rounds.cc:107] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:09:48.894309 26612 raft_consensus.cc:2889] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.753094   758 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:48.899024 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:48.900904 26685 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.884948   772 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:48.886247   681 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.017s
I20260709 13:09:48.901901 26684 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:48.901378 26678 raft_consensus.cc:1240] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:48.901801 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:48.909649 26686 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:48.909754 26603 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:48.912673 26757 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:48.906605 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:48.888537   794 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:48.917548 26682 raft_consensus.cc:3060] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.915913 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:48.894888 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 136310us
I20260709 13:09:48.889891   788 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.913347 26680 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:48.892033   571 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:48.918318 26683 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 11.
I20260709 13:09:48.905825   654 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:48.924384   784 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:09:48.927556   777 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:09:48.928481   785 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:48.929136   763 log.cc:927] Time spent T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.424s	user 0.003s	sys 0.000s
I20260709 13:09:48.932188   596 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:48.907994   682 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:48.929214   783 log.cc:927] Time spent T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:09:48.843891   670 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:48.918563   771 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:09:48.936877   794 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.937430   799 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:48.938513 26651 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:48.940587   778 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:48.939359 26685 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:48.944554 26682 raft_consensus.cc:2468] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:48.925866 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:48.946077 26761 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:48.891893   493 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:48.981829 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59793.1us
I20260709 13:09:48.984578 26684 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:48.939253 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 769) took 1146 ms. Trace:
I20260709 13:09:48.920994   788 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:49.000748 26752 rpcz_store.cc:276] 0709 13:09:47.793253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.795765 (+  2512us) service_pool.cc:224] Handling call
0709 13:09:47.796146 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.796428 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.796451 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.796982 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.178518 (+381536us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:48.227176 (+ 48658us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.230875 (+  3699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.230973 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.928571 (+697598us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:48.938896 (+ 10325us) raft_consensus.cc:1685] finished
0709 13:09:48.939025 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.939175 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49087,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":75133,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":40858,"spinlock_wait_cycles":24180480,"thread_start_us":381154,"threads_started":1,"wal-append.queue_time_us":606592}
W20260709 13:09:49.009318 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 70909.8us
I20260709 13:09:49.009583   799 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:49.010002   799 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:49.010155   758 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.010857   799 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.012495   736 raft_consensus.cc:3055] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:49.012718   786 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:49.012950   736 raft_consensus.cc:740] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:49.014056   791 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:49.014492   791 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.014881   791 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:49.015473   780 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.017796   794 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.020602   799 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:49.024785   745 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.985287   800 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:49.028662   760 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:48.933383   596 consensus_queue.cc:1059] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:49.030350 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.031059 26610 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:48.913285   681 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.026583   595 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.034925 26609 raft_consensus.cc:2468] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:49.001363   352 raft_consensus.cc:697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:49.038695 27314 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:49.038374   493 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:48.986073   699 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:48.934477   571 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.040227   352 consensus_queue.cc:237] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.044071 26611 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:49.062229 26680 raft_consensus.cc:2368] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 19. Current term is 20.
I20260709 13:09:49.064379 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:49.071936 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 255561us
W20260709 13:09:49.072264 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 179559us
I20260709 13:09:49.073880 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:49.048020   671 consensus_meta.cc:287] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.615s	user 0.017s	sys 0.003s
I20260709 13:09:49.094224 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:49.095916   654 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.096836   654 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:49.098881 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.101317 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.104135 26609 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.106523 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 94586.1us
I20260709 13:09:49.108609 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:49.109248 27313 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:49.110395 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 98775.5us
I20260709 13:09:49.114566 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.115419 26610 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:49.117794 26610 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:49.117710 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.122237 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.119855 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.108239   758 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:49.128428 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.128803 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.129114 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:49.129882 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56110us
I20260709 13:09:49.126883 26609 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:49.130445 26726 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:49.131608 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.132505 26606 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:49.141847 26605 raft_consensus.cc:2393] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:49.118537   772 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.156108 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.156497 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.100754   805 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:49.121819   789 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:49.101007   671 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.112597   552 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:09:49.131742   571 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.167809 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.168680 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.171213 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.158277   793 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:49.172851 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 43792.5us
I20260709 13:09:49.178794 26756 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:49.171409 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.178812 26755 raft_consensus.cc:1275] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:49.122063   657 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:09:49.179608   803 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:49.180199   814 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:09:49.183506   792 log.cc:927] Time spent T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:49.157493   806 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:49.184968   684 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.162020   654 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.189792 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:49.196561   552 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:49.205555   681 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.196043 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:49.198477   805 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:49.202222 26610 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:49.177664   789 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.213387   789 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.203331   788 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.225199   788 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.205971   552 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:49.233069 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:49.233383   552 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.234244 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:49.234655   552 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:49.208066   760 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:49.208365 27313 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:49.196969   793 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:49.203956   806 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:49.213923 26577 leader_election.cc:400] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20.
I20260709 13:09:49.256289 26577 leader_election.cc:403] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.188553   534 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:49.215690   791 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.225948   671 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.281226   793 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.260083   571 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:49.284507   571 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.285038   571 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:49.290427   756 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:49.290989   756 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.291379   756 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:49.292158   745 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.292865   745 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.235858   699 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:49.227732   715 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.831s	user 0.013s	sys 0.001s
W20260709 13:09:49.234658 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.237553 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.167790   772 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.263365 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.235808   760 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:49.262331 26752 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:09:49.263549   806 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.265354   791 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.267385   817 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:49.268123   736 consensus_queue.cc:260] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:49.269116 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 61886.2us
I20260709 13:09:49.308522 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:49.321293 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:49.321998 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:49.269279 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62810.1us
I20260709 13:09:49.269999   735 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:49.322570 27286 leader_election.cc:400] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 19. Current term is 20.
I20260709 13:09:49.274698   714 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.300370 26608 raft_consensus.cc:2393] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 13: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:49.299996   772 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.322073 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:49.307248 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:49.308248 27321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:49.324708 27315 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:49.300058 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:49.313211 26724 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:49.316594 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 81022.8us
I20260709 13:09:49.317736 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:49.318975 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:49.270411   802 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20.
I20260709 13:09:49.322909 27286 leader_election.cc:403] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.322999 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.302721 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:49.331915 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:49.333527 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.334795 26752 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:49.337044 26760 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:49.328868 26724 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.300315   760 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:49.295629   745 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.328887 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.327234   717 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:49.304356   681 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:49.378710 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.346784 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:49.338620 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.327287   635 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:49.349275 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.346103   650 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:09:49.296793   715 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.384824 26606 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:49.340188   735 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:49.327440   739 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:09:49.334447   780 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:49.399049 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60679.8us
I20260709 13:09:49.346078   772 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:49.395395 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48688.1us
I20260709 13:09:49.404148 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.335177   817 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:49.399590 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 61045.3us
I20260709 13:09:49.401180 27285 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:49.354717   671 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:49.385228   717 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:49.392760   494 consensus_meta.cc:287] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.009s
I20260709 13:09:49.385847   791 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:49.330205   714 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.387281   796 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:49.385481   802 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.395006 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 72570.9us
I20260709 13:09:49.411119 26607 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:49.397783   736 raft_consensus.cc:3060] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:49.419194 26681 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:09:49.421527 26681 pending_rounds.cc:85] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 11
I20260709 13:09:49.421840 26681 pending_rounds.cc:107] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:09:49.422130 26681 raft_consensus.cc:2889] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.407967   789 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:49.419693 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.400154   780 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.405553   806 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:49.420416 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.405596   735 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:49.425681 26680 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:49.407061   794 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.429380 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:49.414770   717 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.430887 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.415537   732 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:49.420265   791 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:49.424957   654 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:49.407743   772 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.459646 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:49.452639 26756 pending_rounds.cc:85] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 12
I20260709 13:09:49.458038 26758 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:49.460796 26756 pending_rounds.cc:107] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:09:49.461198 26756 raft_consensus.cc:2889] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.463085 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.412432   816 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:49.427459   780 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:49.427188   789 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:49.410902   681 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.427785   670 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.427824   650 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.463641   791 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:49.421898   494 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.433346   796 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:49.452080   732 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.415323   671 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.458742   654 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:49.465848   813 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:49.470042   789 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:49.549989 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 148911us
I20260709 13:09:49.452080   794 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.565625   834 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:49.566243   834 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.566689   834 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.576493 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 244987us
I20260709 13:09:49.535794   732 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:49.533288   821 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.474828   571 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.505348   805 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:09:49.520316   650 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.603929   796 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:49.606163   824 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:09:49.606612   827 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:49.607386   823 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:09:49.609526   758 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.506152   670 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:49.593084   828 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:09:49.593833   829 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 19. Current term is 20.
I20260709 13:09:49.594893   756 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.599895   772 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.601019   831 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.546718   493 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:49.470408   787 consensus_queue.cc:1059] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.246s
I20260709 13:09:49.547770   813 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:49.675154 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.691211 26608 raft_consensus.cc:3060] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:49.685489 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2350) took 1133 ms. Trace:
I20260709 13:09:49.695917 26607 rpcz_store.cc:276] 0709 13:09:48.552402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.552546 (+   144us) service_pool.cc:224] Handling call
0709 13:09:49.685155 (+1132609us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400031e54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:49.685361 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966805888}
I20260709 13:09:49.550169   779 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.264s
I20260709 13:09:49.708408 26685 raft_consensus.cc:1275] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:49.709434 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.710892 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.711588 26685 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
W20260709 13:09:49.689419 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 106851us
I20260709 13:09:49.699918 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.700806 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:49.713361 26682 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:49.714318 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.718427 26608 raft_consensus.cc:2468] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:09:49.722968 26678 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:49.728649 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:49.729676 26678 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:49.682776   699 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:49.733220   699 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.733817   699 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.737877   699 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.725190 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:49.744581 26685 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:49.747339 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:49.748273 26686 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:49.750067 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:49.584019   811 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.285s
I20260709 13:09:49.757243   715 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.775928 26678 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:49.725230   787 consensus_queue.cc:1243] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:49.799997 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:49.786091 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 194420us
I20260709 13:09:49.656270   821 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.707654   493 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.654546   735 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.812783 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.807942 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:49.813140 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 484300us
I20260709 13:09:49.811115 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.811476 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.811685 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.814708 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.815177 26610 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:49.786504   635 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:49.816296 26753 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:49.698617   831 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:49.817967 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.823922 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.754451   654 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:49.819607 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.719075   834 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.827008 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.831440 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.829660 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.822993   635 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.837226 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:49.804549   714 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:49.820107   820 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.612s	user 0.013s	sys 0.000s
W20260709 13:09:49.839869 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.844372 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.816416   772 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:49.817827   817 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:49.845613   826 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:09:49.862360 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.827169   842 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.838052   494 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.842953   681 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.876152 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:49.847045   811 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:49.872262 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:49.862201   552 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.003s
W20260709 13:09:49.870312 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 68502.5us
I20260709 13:09:49.876873 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:49.887226 26758 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:49.898026 26758 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:49.902141 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:49.925634 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62295.6us
I20260709 13:09:49.927943 27313 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:49.927827 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.933519 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:49.936331 26678 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:49.936266 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:49.938508 26605 raft_consensus.cc:2393] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 16: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:49.935997 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 109017us
I20260709 13:09:49.945417   850 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:09:49.946446   804 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
W20260709 13:09:49.946866   832 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:09:49.902580   571 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.949069 26686 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:49.948508 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.954021 26724 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:49.956053 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.930949   756 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.930707   794 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.962950 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.968583   671 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:49.971995   671 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:49.972918   756 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:49.973330   756 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:49.973688   756 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:49.972026   851 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:49.977133   831 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:49.977932   831 raft_consensus.cc:2804] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:49.978487   831 raft_consensus.cc:697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:49.980407   493 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:49.875325   842 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:49.997372 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.007970 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:49.971194   717 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 13:09:49.964010   772 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:50.015429 26650 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:49.970858   571 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:50.031276   571 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:50.032331   571 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.033666   681 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.030725 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.041712   860 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.009845   794 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:49.979562   831 consensus_queue.cc:237] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:50.047048   736 consensus_meta.cc:287] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.003s
I20260709 13:09:50.026865   493 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.023267   772 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:49.992025   845 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:09:50.079628 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.023159   717 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.083521   860 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.083863   756 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.012571   534 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:09:50.061681   650 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:50.088923 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 134964us
I20260709 13:09:50.073137   794 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:50.088587 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.081367   834 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.081624   793 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:09:50.112471   756 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.114001   842 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.118256   821 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.084436   717 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.099324   838 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:50.101958   760 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.002s
I20260709 13:09:50.120973 26680 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:50.124655 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:50.125136 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.084327   811 consensus_queue.cc:1048] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:50.138702   772 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.130358   838 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.135766 27316 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:50.136364 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:50.137504   802 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.712s	user 0.017s	sys 0.001s
I20260709 13:09:50.141677   802 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.128862   821 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:50.142840   732 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.001s
I20260709 13:09:50.143217   838 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:50.138767   791 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:09:50.139494   869 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.144071   791 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.146066   791 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:50.146275   780 consensus_meta.cc:287] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
W20260709 13:09:50.159319   789 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.001s
I20260709 13:09:50.152860 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.164446 26680 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:50.166352 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.143308   732 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.177983 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:50.160504   856 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:09:50.163121   858 log.cc:927] Time spent T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:09:50.178747 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49536.7us
I20260709 13:09:50.180711 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.182608 26604 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.179543 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:09:50.182684 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53547.7us
I20260709 13:09:50.184633 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.186852 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.188572 26603 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:50.147924   760 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.186564   791 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.202239 26604 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:50.167264   780 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.176772   789 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.205529 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:50.204367   821 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.206928 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.209739 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.210605 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.207190 26604 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:50.207770 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.211933 26608 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:09:50.212827 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.207296 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.208319 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:50.208129 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:50.212875 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.214854 26608 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:50.219303 26606 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:50.221946 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.222957 26612 raft_consensus.cc:2393] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:50.239845 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.239982   671 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:50.241273 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.241954   671 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.242398   861 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:50.244439   780 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.237387   821 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:09:50.247788   732 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.249924   789 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:50.251030 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:50.253248   819 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 1.055s	user 0.000s	sys 0.005s
I20260709 13:09:50.260185 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.264885 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.267230   657 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.267901   657 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.272527 32612 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.272660   657 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:50.278407   876 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:09:50.281685 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.278463 26609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 818) took 1155 ms. Trace:
I20260709 13:09:50.282881 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.285059 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.282589 26609 rpcz_store.cc:276] 0709 13:09:49.122936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.134284 (+ 11348us) service_pool.cc:224] Handling call
0709 13:09:49.134572 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.212182 (+ 77610us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:49.212474 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.312546 (+100072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.312597 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:49.312638 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.276840 (+964202us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b18004e5980. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419
0709 13:09:50.278214 (+  1374us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b54002391d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:50.278267 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.278404 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":561,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":81,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"spinlock_wait_cycles":197298816,"thread_start_us":99761,"threads_started":1,"wal-append.queue_time_us":189991}
I20260709 13:09:50.288092 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:50.297355 26726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.017s	sys 0.018s
W20260709 13:09:50.297749 26726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.017s	sys 0.018s
I20260709 13:09:50.299208 26608 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:50.300099 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.301193 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.301576 27317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39254 (request call id 936) took 1003 ms. Trace:
I20260709 13:09:50.302212 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.303414 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.303973 26608 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:50.304438   809 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:50.304782 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.305537 26608 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:50.310997 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.315213 27313 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:50.304877   809 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.301996 27317 rpcz_store.cc:276] 0709 13:09:49.298591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.300996 (+  2405us) service_pool.cc:224] Handling call
0709 13:09:49.301273 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.433013 (+131740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.433042 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.433091 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:49.433125 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.301360 (+868235us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54006f2f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:50.301407 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.301521 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302498688}
W20260709 13:09:50.286140   877 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:09:50.324352 26608 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:09:50.328656 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:50.329126 26612 raft_consensus.cc:2468] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:50.329429 26757 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.331601 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.338495 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:50.339286 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.340583 26754 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:09:50.320680   803 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.341122 26609 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:50.343245 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.352257 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.355129 26757 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:50.355767   803 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.357642   803 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.358448   802 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:50.362030 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:50.362425 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.320288   838 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:50.363960   789 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.348634   779 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.338927   699 consensus_queue.cc:1048] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:50.362109   809 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.373391   809 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.373554   534 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:50.374730   534 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:50.397960 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.364460   789 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.368196   803 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.367775   717 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:50.369987   756 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:50.406037   880 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:50.406934   596 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:09:50.410360   596 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:50.410709   596 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.411633   596 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.412905   596 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.416417 26755 raft_consensus.cc:2410] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:50.417074   857 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.417583   857 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.421084   805 raft_consensus.cc:3055] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:50.400902   736 consensus_queue.cc:1059] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:09:50.421447   805 raft_consensus.cc:740] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.407807 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:50.422297   805 consensus_queue.cc:260] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.423785   802 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.424073 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2394) took 1260 ms. Trace:
I20260709 13:09:50.424257   802 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:50.424736   802 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.424077 26611 raft_consensus.cc:1275] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:50.426374   805 raft_consensus.cc:3060] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.415365   670 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.428153   682 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:50.428587   682 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:50.428918   833 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.730s	user 0.004s	sys 0.000s
I20260709 13:09:50.429468   682 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.430709   682 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.433503   760 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.424497 26761 rpcz_store.cc:276] 0709 13:09:49.163614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.168951 (+  5337us) service_pool.cc:224] Handling call
0709 13:09:49.184267 (+ 15316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.207931 (+ 23664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.207962 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.208002 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:49.208031 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.423873 (+1215842us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5400200b54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:50.423918 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.424021 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53929216}
I20260709 13:09:50.437155 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2370) took 1018 ms. Trace:
I20260709 13:09:50.437561 26687 rpcz_store.cc:276] 0709 13:09:49.418843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.418969 (+   126us) service_pool.cc:224] Handling call
0709 13:09:49.427124 (+  8155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.824454 (+397330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.824501 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.839522 (+ 15021us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.884346 (+ 44824us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:49.940277 (+ 55931us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.941721 (+  1444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.436757 (+495036us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001e96d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:50.436807 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.436851 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:50.436937 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.437076 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":98819,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":1854,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":18255,"spinlock_wait_cycles":912796416,"thread_start_us":70986,"threads_started":2,"wal-append.queue_time_us":217381}
I20260709 13:09:50.440019 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:50.440380   868 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.302s	user 0.000s	sys 0.005s
I20260709 13:09:50.440932 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 776) took 1011 ms. Trace:
I20260709 13:09:50.440894   352 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:50.441447 26755 rpcz_store.cc:276] 0709 13:09:49.429864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.434368 (+  4504us) service_pool.cc:224] Handling call
0709 13:09:50.440736 (+1006368us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400226854. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:50.440881 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197835648}
I20260709 13:09:50.442988 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.444711   803 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.460389   772 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.460901   803 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.404301   789 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.463081   857 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:50.449249   813 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.452183 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.452419   654 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.455515 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.465234 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:50.467965 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.468483 26684 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:50.448019 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.475787 26680 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:50.493681 26680 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:50.380191   699 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.405774   717 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.491142 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:50.498158 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.384209   836 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:50.502709 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54751us
I20260709 13:09:50.501245 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:50.504464 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.503793 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:50.510959 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.511763 26687 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.513661   657 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.514400   657 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.515772 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.516899 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.518076   772 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:50.518662 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.519117   811 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.519974   798 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.519708   836 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.520780   844 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.521095 26650 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:50.521886   836 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.522964 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.520795   869 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.523700   869 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.523875   732 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:50.524065   869 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.524468   732 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:50.524636   787 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:50.525272   787 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:50.525503   732 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.526196   787 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.528172 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.529486 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.478307   756 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.521236   844 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:50.504112   699 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.504310   857 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:50.501731   717 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.531656   844 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.535712   791 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:50.536253   791 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:50.537171   791 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.532073   756 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.533023   789 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.544600   789 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:50.549800 27318 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:50.552280 26753 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:50.554705 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.562121 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.554787 26609 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:50.557968 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:50.559278 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.551645 26687 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:50.569731 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:50.499068 32612 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.573709 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:50.576917 26606 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:50.519178   772 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:50.585019 26680 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.575688   853 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:09:50.590663   853 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:50.591107   853 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.591995 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.524410   684 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:50.598767   684 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:50.599170   684 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:50.599996   684 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.600981 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:50.601859 26758 raft_consensus.cc:1240] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:50.601723   671 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:50.602835 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:50.604000   871 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.377s	user 0.001s	sys 0.002s
I20260709 13:09:50.605093   352 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:50.605381 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:50.605719 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 87837.5us
I20260709 13:09:50.605667   352 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.557165   813 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.608028 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.608659 26679 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.609280 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.610638   671 consensus_queue.cc:1048] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:50.556020   782 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.615988 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.616559 26604 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:50.617846 26687 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:50.618475 26756 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:50.624802 26755 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:50.601163   684 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.592095   853 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.612247 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:50.639218 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.643258 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.642838 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.644913 26761 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:50.533367   699 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:50.647544 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 78718.4us
W20260709 13:09:50.655915 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.497529   802 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.653657 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.660576 26679 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:50.661077 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.664191 26682 raft_consensus.cc:1240] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:50.664958 26683 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:50.612984   782 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.676911 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.676994 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.678716 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.679230 26678 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:50.680115 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.681464 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.682392 26679 raft_consensus.cc:2393] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:50.670070 26577 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:50.656432   735 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:50.661788   836 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:50.700322 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.700671 26686 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:09:50.687707 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.699584 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.705767 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.706444 26758 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:50.655431   816 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:09:50.711575 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.715916 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.685742   780 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.694183   850 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:50.662890   829 consensus_queue.cc:1059] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:09:50.665205   821 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:09:50.726980 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.720026 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.721225 26678 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:09:50.724614 26758 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:50.725236 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.703408   735 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.729534 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.729941   735 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.732774 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.733964 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:50.734475 26758 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:50.741909   782 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.744319 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.752367 26758 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:09:50.753634 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:50.759423 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.711920   715 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:50.705042   839 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:50.752971   880 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:50.756580   584 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:50.769543 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.771409 26607 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:50.699992   804 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:50.769411 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.775128 26761 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 17: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:50.751801   821 consensus_queue.cc:1243] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:50.780778 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.764015   742 raft_consensus.cc:3055] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:50.762568   801 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.786986 26679 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:50.750175   780 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.788524 26758 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:50.773847   715 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:50.792387 26761 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:50.809052   780 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:50.814193   715 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.816455   853 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.819378 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.820340 26755 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:50.831269 26650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.840822 26682 raft_consensus.cc:1240] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: [19.12-21.14]
I20260709 13:09:50.771567   717 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.788121   742 raft_consensus.cc:740] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:50.852399 26758 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:50.858170 26753 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:50.844899   788 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:50.863473 26727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.864137 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:50.867038   717 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.877297 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.796411   801 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.882833 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.883888   804 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.892204 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 772) took 1463 ms. Trace:
I20260709 13:09:50.893886 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.894369 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.892865 26752 rpcz_store.cc:276] 0709 13:09:49.428392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.428515 (+   123us) service_pool.cc:224] Handling call
0709 13:09:49.428879 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.464957 (+ 36078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.464985 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.467389 (+  2404us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.380114 (+912725us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18004d27e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:09:50.632029 (+251915us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:50.646917 (+ 14888us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.662174 (+ 15257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.662274 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.876434 (+214160us) raft_consensus.cc:1685] finished
0709 13:09:50.891844 (+ 15410us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b18004d27e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f011dc0a 00007f40f985d219 00007f40f716458f 00007f40f01a3571 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd
0709 13:09:50.891936 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.892134 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58345,"prepare.queue_time_us":20956,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3969,"raft.queue_time_us":108087,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":19250,"spinlock_wait_cycles":30285440,"thread_start_us":283037,"threads_started":2,"wal-append.queue_time_us":1246157}
I20260709 13:09:50.896596 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:50.900900   772 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.901425   845 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.901928   845 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.902796   804 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:50.907482 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 268317us
I20260709 13:09:50.880496   802 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.895555   821 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:50.895321   671 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:09:50.911226 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 263042us
I20260709 13:09:50.923343 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.859790   844 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:50.915577 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.911294 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:50.928591 26758 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:50.930128 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.930799 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.923522 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:50.931349 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.934042 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:50.934816 26608 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:50.939872   839 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.940476   788 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.941128   788 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:50.943701   684 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.948179 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:50.931211 26684 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:50.951645 26687 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:50.945152   821 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:50.965076 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.967450   803 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:50.968183   836 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.968032 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:50.968848   836 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.969290   836 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.969434 26681 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:50.969964 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:50.968032   803 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.972007   803 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:50.972590   352 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:50.973115   352 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:50.973809   831 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:50.975464 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:50.962698   867 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.976745   867 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:50.977108   867 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.977432   867 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.922767   671 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:50.989123 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:50.899260   742 consensus_queue.cc:260] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:50.948539   845 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:50.975315   352 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.965677   804 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:51.027774 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57883.9us
I20260709 13:09:50.995196   671 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.993866   831 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:50.994321   782 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:51.067559   699 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.110011 27315 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:51.108008   809 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.021045   760 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.115475 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:51.080652   742 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.105748   782 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.136850   782 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:51.139923 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:51.140600 26761 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.070108   869 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.144577   869 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.145629 26760 raft_consensus.cc:2368] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:09:51.079411   717 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:51.120872   891 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:51.124368   809 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.110177   821 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:51.132340   801 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:51.151118 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.219092 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.242445 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 213164us
I20260709 13:09:51.230772 26680 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:51.232131 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:51.246210 26684 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:51.234427 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.164103 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.236508 26761 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:51.237229 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 313949us
I20260709 13:09:51.237497 27319 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:51.255079 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:51.274708 26756 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:09:51.161945   760 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.148324   699 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.304258 26680 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
W20260709 13:09:51.306871 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56348.6us
I20260709 13:09:51.309160 27284 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.310348 26680 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:09:51.166314   717 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.311724 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:51.344012   899 raft_consensus.cc:2804] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:51.255658   801 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:09:51.355971 27315 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:51.297253   857 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:51.267290   803 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:09:51.310930 26680 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:09:51.380695 26680 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.335942   844 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.344815   899 raft_consensus.cc:697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:51.388700   811 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:09:51.390244   831 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:51.393239 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.393349 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.394207 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.417210 26754 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
W20260709 13:09:51.397015 26712 heartbeater.cc:646] Failed to heartbeat to 127.24.232.254:38345 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.232.254:38345 timed out after 15.000s (SENT)
I20260709 13:09:51.397235 26604 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:51.397485   903 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:51.385849   857 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:51.404529   853 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.001s
I20260709 13:09:51.392310   788 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.407883 26611 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:51.409181 26606 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:51.420974 26607 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 22: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:51.370893   809 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.420166   684 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.465338   684 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.465871   801 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:51.433400   892 log.cc:927] Time spent T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:09:51.444741   899 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.348110   794 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:09:51.446784   789 raft_consensus.cc:3055] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:51.448693   802 consensus_queue.cc:1059] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:51.450287   889 log.cc:927] Time spent T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260709 13:09:51.410398   821 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.451319   760 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.452409   715 consensus_queue.cc:1059] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:51.452832   717 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.450335   699 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.453760   867 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.456418   831 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:51.468688   772 consensus_meta.cc:287] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.001s
I20260709 13:09:51.478657   684 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.474089   789 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:51.487823 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 241438us
I20260709 13:09:51.490336 26726 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:09:51.486742 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 204363us
I20260709 13:09:51.505945 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:09:51.485896   732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.012s	sys 0.014s
I20260709 13:09:51.510052   699 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:51.510490 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.511865   808 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.513033 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.514043 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.526964 26680 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:51.484149   772 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:51.515954 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.467314   903 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:51.518198   732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.013s	sys 0.014s
I20260709 13:09:51.524226 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.533697 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.536484 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.511915   902 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:51.482767   595 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:09:51.537952 26679 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:51.544348 26687 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:51.545163 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.547343 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:51.531124   699 raft_consensus.cc:697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:51.552109 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:51.534700   845 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.546212   772 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.543752   654 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.544000   803 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:51.598181 26679 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:51.548029   779 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:51.543325   902 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.601923 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.558625 26682 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:51.665082 26682 raft_consensus.cc:1275] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:51.550338   799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.017s	sys 0.033s
I20260709 13:09:51.550426   808 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:09:51.674942 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.675840 26680 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:51.556565   671 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:51.686033 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 271425us
I20260709 13:09:51.542725   789 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.557974   780 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
W20260709 13:09:51.657768   836 consensus_meta.cc:287] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.001s
I20260709 13:09:51.557710   772 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:51.669991   799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.017s	sys 0.033s
I20260709 13:09:51.670789   831 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.720877   902 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.721299   772 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:51.729357   671 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.694154   836 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.734091   836 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.736043   900 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.737403   910 log.cc:927] Time spent T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:09:51.738775   789 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:51.739477 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:51.740770 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.743040 26752 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:09:51.743350 26752 pending_rounds.cc:85] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 11
I20260709 13:09:51.745446   867 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.736223   654 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:51.746613   654 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:51.736910   900 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.743549 26752 pending_rounds.cc:107] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:09:51.751020 26752 raft_consensus.cc:2889] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.695819   788 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:51.758913 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:51.688412   829 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:09:51.752830   798 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.747871   654 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.768831 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.755363   857 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:51.693359   699 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.764667   772 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:09:51.764918   914 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:51.780079   809 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:51.796835 26758 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:51.766376   760 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:09:51.805557   804 consensus_meta.cc:287] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.000s
I20260709 13:09:51.806094   804 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:51.806846 26678 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:51.772011   798 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.813581   798 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.814760 26603 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:51.815594 26612 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:51.803354   654 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.802419   809 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.821389   809 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:51.824196   829 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:51.826045   829 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:51.835590   919 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.837095   760 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.858661   919 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.860991   919 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.808389   917 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:09:51.862411   903 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:51.843408   914 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:51.859037   760 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.864444   914 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.865975   760 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.867187   914 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:51.873106 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:51.879315 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:51.880954 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:51.881721 26684 raft_consensus.cc:2393] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:51.884312 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.887885 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.889401 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.892336 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:51.887562   907 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:51.892251 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:51.893711 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:51.894526 26683 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:51.893575 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:51.895130 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.895879   836 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:51.897399   788 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:51.897789   808 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 13:09:51.899788   890 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.873s	user 0.008s	sys 0.007s
I20260709 13:09:51.900027 26612 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:09:51.902328   909 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:09:51.903743 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2402) took 1358 ms. Trace:
I20260709 13:09:51.904103 26757 rpcz_store.cc:276] 0709 13:09:50.545255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.545412 (+   157us) service_pool.cc:224] Handling call
0709 13:09:50.545747 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.546126 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.546156 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.546613 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.784106 (+237493us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:50.784144 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.784206 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.899204 (+1114998us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:51.903404 (+  4200us) raft_consensus.cc:1685] finished
0709 13:09:51.903426 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.903685 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1139,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10529,"spinlock_wait_cycles":91102592,"thread_start_us":237099,"threads_started":1,"wal-append.queue_time_us":398807}
I20260709 13:09:51.905956 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.907311 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:51.893206 27314 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:51.919555 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.921228 26607 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:51.907199   809 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:51.897840   788 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.938726 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.939450 26752 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
W20260709 13:09:51.925132 26753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2419) took 1325 ms (client timeout 1626 ms). Trace:
W20260709 13:09:51.946177 26753 rpcz_store.cc:269] 0709 13:09:50.595304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.600751 (+  5447us) service_pool.cc:224] Handling call
0709 13:09:51.920279 (+1319528us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540014fad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:51.920361 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346026240}
I20260709 13:09:51.940448 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.952656 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.953577 26612 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:51.953924 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.954974 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.963289 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.965833 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.967415 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.968730 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.969265 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.971432 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.924929   903 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.973347 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:51.979363 26609 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:51.980587 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:51.983053 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:51.974120 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:51.892474   857 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:09:51.974793 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:51.975315   894 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:51.940110   788 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.991883   925 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:51.994632 26605 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:52.002624   809 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.002907 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.004971 26752 raft_consensus.cc:1240] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:52.006989 26610 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:52.008713   894 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:51.970924   780 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.009701   894 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.010360   780 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:51.975128   917 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.012066   917 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.014448   917 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.015481   779 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:52.017305 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.034806 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:51.980552   900 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:51.988016   903 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.040185   654 consensus_queue.cc:1048] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:09:52.039635   836 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:09:52.045462 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.024611   861 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.044735   837 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:52.039105   650 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:52.037547   682 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.071916 26612 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:52.078320 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:52.089808 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:52.074568   798 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.091563   798 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:52.093711   922 log.cc:927] Time spent T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:09:52.093894   798 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:52.095499   938 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:09:52.096010   857 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:52.098289   853 raft_consensus.cc:3055] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:52.098801   853 raft_consensus.cc:740] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:52.099174   717 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:52.099566   717 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:52.100653   717 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.102043 26685 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:52.103281 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.104278 26679 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:52.106232 26724 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:52.067767   900 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.069634   804 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.083128   932 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:09:52.110450   874 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:52.107501 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.119309 26612 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:52.115242 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.101769   699 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:52.095485   596 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:52.116492 26683 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:52.077277   837 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:52.116641 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.120595 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:52.122339 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.128923 26761 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:52.123929 26607 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:52.113035   717 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:52.137827 26679 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:52.083724   861 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.087174   919 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:52.088063   682 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.121181   699 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.099646   853 consensus_queue.cc:260] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.124827   596 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:52.118150   900 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.135048   495 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:52.175380   861 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.141238   780 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.157526   699 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:52.167725   937 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:09:52.165254   813 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.164647   495 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.181679   811 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.136548   809 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:09:52.178557   853 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:52.184341 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35540 (request call id 2405) took 1638 ms. Trace:
I20260709 13:09:52.237113 26760 rpcz_store.cc:276] 0709 13:09:50.546148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.547058 (+   910us) service_pool.cc:224] Handling call
0709 13:09:52.184149 (+1637091us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54002ea4d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:52.184288 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322067200}
I20260709 13:09:52.239145 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2403) took 1015 ms. Trace:
I20260709 13:09:52.239745 26687 rpcz_store.cc:276] 0709 13:09:51.223357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.225369 (+  2012us) service_pool.cc:224] Handling call
0709 13:09:51.227939 (+  2570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.545983 (+318044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.238784 (+692801us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001e96d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:52.239054 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718725504}
I20260709 13:09:52.184537 26755 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:52.156116   816 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:09:52.164705   779 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.172639   837 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.244270   837 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:52.244094   779 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.246368   779 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.165808   903 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:52.194550   887 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 1.112s	user 0.000s	sys 0.008s
I20260709 13:09:52.250061 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2397) took 2917 ms. Trace:
I20260709 13:09:52.197803 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.250545 26759 rpcz_store.cc:276] 0709 13:09:49.332419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.333086 (+   667us) service_pool.cc:224] Handling call
0709 13:09:49.346228 (+ 13142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.441477 (+1095249us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800378400. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f3288060 00007f40f3288bfb 00007f40f329364b
0709 13:09:50.441595 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.441619 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.448576 (+  6957us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.839926 (+391350us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:50.839985 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.840082 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.193910 (+1353828us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:09:52.249720 (+ 55810us) raft_consensus.cc:1685] finished
0709 13:09:52.249754 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.249942 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69273,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7564,"spinlock_wait_cycles":38208256,"thread_start_us":476130,"threads_started":2,"wal-append.queue_time_us":510853}
I20260709 13:09:52.252982 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.253671 26685 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:52.203830 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.254630 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.254906   917 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.173089   914 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.121503   804 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.256276 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.255990   917 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.258131   804 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.258733   804 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:52.255059 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51328.1us
I20260709 13:09:52.260550 26650 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.260282   914 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.261938 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.262769   798 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:52.175239   682 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.263484   798 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:52.263931   798 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.264277   798 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:52.264382   914 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.258744   917 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.263309 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.271044 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.272049   804 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:52.272432   804 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.272812   804 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:52.275856   903 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:52.276257   903 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.276638   903 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:52.279327   939 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:09:52.284161 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.295202   917 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:52.296182   917 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:52.296731   917 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.296967 26758 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:09:52.298481 26503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 215) took 47459 ms (client timeout 15000 ms). Trace:
I20260709 13:09:52.295599 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:52.121738 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.299957   893 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:52.300585   595 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.300937   837 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:52.301062   595 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.294515   903 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.303249   595 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.304704   903 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.306114 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2429) took 1665 ms. Trace:
I20260709 13:09:52.306497 26755 rpcz_store.cc:276] 0709 13:09:50.640617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.821028 (+180411us) service_pool.cc:224] Handling call
0709 13:09:52.184362 (+1363334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.241242 (+ 56880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.305910 (+ 64668us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002ea4d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:52.306050 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134542720}
I20260709 13:09:52.308902 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:52.309063   804 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.310101 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:52.311185   804 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.313436 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:52.263252   494 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:52.316210 26759 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:52.317978 26760 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:52.319394 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.321165 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.322427 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.326694 26759 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:52.314970   917 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:52.332161 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.334666   917 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.300051 26509 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:52.339567 26509 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 15, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 15 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.346473 26509 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 13, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.350798 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.352952 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.354005 27315 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:52.358665   917 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.359102 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:52.359413   917 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.361588 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.362058   917 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.367699 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.372110 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.380748   874 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:52.383013   874 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:52.383882   857 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:52.384544   857 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:52.385640   857 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.389024   756 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:52.389531   756 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.390592   874 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:52.391364 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81336.4us
I20260709 13:09:52.391758   756 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:52.392408 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:52.393780   808 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:52.394193   808 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.394550   808 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.396647 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:09:52.298913 26503 rpcz_store.cc:269] 0709 13:09:04.839225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.839581 (+   356us) service_pool.cc:224] Handling call
0709 13:09:05.906506 (+1066925us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:52.298353 (+46391847us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:47.932191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:47.975348 (+ 43157us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:47.975417 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:09:47.975458 (+    41us) tablet.cc:662] Decoding operations
0709 13:09:48.118451 (+142993us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:48.118555 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:48.118583 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:09:48.120237 (+  1654us) tablet.cc:701] Row locks acquired
0709 13:09:48.120301 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:09:48.120523 (+   222us) write_op.cc:270] Start()
0709 13:09:48.120694 (+   171us) write_op.cc:276] Timestamp: P: 1783602588120444 usec, L: 0
0709 13:09:48.120730 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:09:48.121535 (+   805us) log.cc:844] Serialized 8019 byte log entry
0709 13:09:49.013522 (+891987us) op_driver.cc:464] REPLICATION: finished
0709 13:09:49.209168 (+195646us) write_op.cc:301] APPLY: starting
0709 13:09:49.209269 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:49.229762 (+ 20493us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328d32a 00007f40f3212f14 00007f40f3212ec3 00007f40f3212e38 00007f40f3212df3 00007f40f32120dc 00007f40f323be16 00007f40f3223cbb 00007f40f320e39d 00007f40f3211d75
0709 13:09:49.264295 (+ 34533us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:49.264339 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:49.279011 (+ 14672us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:49.279374 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:09:49.279441 (+    67us) write_op.cc:312] APPLY: finished
0709 13:09:49.279943 (+   502us) log.cc:844] Serialized 180 byte log entry
0709 13:09:49.284131 (+  4188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.284305 (+   174us) write_op.cc:454] Released schema lock
0709 13:09:49.284386 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:49.345941 (+ 61555us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.348233 (+  2292us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":484602,"reported_tablets":52,"spinlock_wait_cycles":2213562112,"child_traces":[["op",{"apply.queue_time_us":183668,"apply.run_cpu_time_us":25981,"apply.run_wall_time_us":118041,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87687,"num_ops":20,"prepare.queue_time_us":673414,"prepare.run_cpu_time_us":25045,"prepare.run_wall_time_us":579540,"raft.queue_time_us":285924,"raft.run_cpu_time_us":20874,"raft.run_wall_time_us":296413,"replication_time_us":892621,"spinlock_wait_cycles":155599616,"thread_start_us":995352,"threads_started":4,"wal-append.queue_time_us":468997,"wal-append.run_cpu_time_us":20829,"wal-append.run_wall_time_us":1684495}]]}
I20260709 13:09:52.407223   874 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:52.413177   940 log.cc:927] Time spent T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 13:09:52.233441   813 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:52.417691   943 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:09:52.418166   813 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.165475   788 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.214707   839 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.421226   839 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.422848   788 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:52.428138 27316 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:52.415544 27318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39266 (request call id 745) took 1177 ms. Trace:
I20260709 13:09:52.429587 27318 rpcz_store.cc:276] 0709 13:09:51.238615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.239761 (+  1146us) service_pool.cc:224] Handling call
0709 13:09:52.109889 (+870128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.110081 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.110104 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.110140 (+    36us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:52.110175 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.110220 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.415369 (+305149us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54004c7cd0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328f8ad 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:52.415481 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000345472}
I20260709 13:09:52.230099   495 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:52.477258 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 80711.9us
I20260709 13:09:52.480325 26678 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:52.481967 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.484299 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.484802 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:52.488384 26680 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.485806 26755 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:52.349422 26509 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.490715 27286 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.492821 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.493136 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.502592 26757 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:52.494534   839 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.434155   907 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.500200 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 55277.8us
I20260709 13:09:52.513532 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.514595 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.517091 26757 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:52.520625 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:52.523912 26611 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:52.528987 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.500663   938 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:52.428417   811 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.492002   756 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:52.559580 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.566629 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:52.534075 26678 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:52.536931 27316 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:52.536873 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.540854 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.575757 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:52.434262   596 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.531438   742 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.538053 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:52.582541 27317 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 12: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:52.564414 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.538275   809 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.595715 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.560144   861 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:52.596397 26612 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:52.597213 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:52.525332   715 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:09:52.525256   909 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:09:52.577701 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:52.597793 26612 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:52.531986   907 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.600662 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:52.607288 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.577286   805 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:52.568188   756 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:52.605257 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.607406 26604 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:52.598594   596 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:52.592738   650 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:52.603616   894 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.630254 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:52.527650 26509 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 10 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.616834 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.613694   805 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.638944 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.617637   756 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.631618 26761 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:52.617025 26612 raft_consensus.cc:2468] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:52.633648 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.661413 26609 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:09:52.591178   742 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:52.608570 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 406156us
I20260709 13:09:52.598335   809 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.639039 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:52.660290 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.671643 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.556691 26680 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:52.617304   900 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.664170 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:52.674849 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.693810 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.705219 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.659979   805 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.707310 27319 raft_consensus.cc:2410] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:09:52.675160   932 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:52.709347 26607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.026s	sys 0.029s
I20260709 13:09:52.634919   894 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:52.596947   846 consensus_queue.cc:1175] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9e8388401a74e84a2cc880930412709" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:09:52.733204   947 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:09:52.728770   907 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.767184   805 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.691687   893 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:52.769002 26609 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:52.769907   899 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.770457   899 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.770851   894 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:52.772751   899 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:52.740938 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.721882 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.713230   914 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:52.743638 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.774573   899 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:52.737535 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 67058.2us
I20260709 13:09:52.775039   899 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.727257 26611 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:09:52.752424 26607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.027s	sys 0.029s
W20260709 13:09:52.740271 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.780124 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.780344   899 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:52.781414 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.782368 26612 raft_consensus.cc:2410] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:09:52.785006 26685 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:52.787611 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:52.788362 26683 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.792479   809 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.795331   914 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:52.796671   861 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:52.797087   861 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:52.797952   861 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.798755   657 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.799273   657 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.801259   657 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:52.757139 26650 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.769255   805 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:52.807845 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 50771.8us
I20260709 13:09:52.808531 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.809700   804 raft_consensus.cc:2804] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:52.810174   804 raft_consensus.cc:697] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:52.810986   804 consensus_queue.cc:237] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.813956   595 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:52.814459   595 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:52.814596 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:52.814955   595 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:52.816002 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.816972   596 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:52.817721   596 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:52.826170   861 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:52.818693   596 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.707845   924 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:52.762430 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57313.8us
I20260709 13:09:52.742924   742 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:52.733847   717 consensus_meta.cc:287] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.002s
I20260709 13:09:52.764652   816 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:52.669047   494 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:09:52.852679   816 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:52.853087   494 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:52.853592   494 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:52.853899   816 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.854439   494 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.748771   811 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:52.769351   699 consensus_meta.cc:287] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.540s	user 0.014s	sys 0.003s
I20260709 13:09:52.856106   699 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.855459   816 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:52.858345   699 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:52.859063 26759 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:52.860844   494 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:52.761240 26608 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 12.
I20260709 13:09:52.883785 26651 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:52.703828 26509 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 10 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.807140   495 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:52.893602 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.903086 26650 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:52.908327 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:52.909123   671 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:52.909591   671 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:52.909988   919 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:52.911064   917 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:52.911643   917 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:52.912559   917 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:52.916801 26576 leader_election.cc:400] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:09:52.917199 26576 leader_election.cc:403] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.918543 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.922439 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:52.909989   671 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:52.930573 26686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.033s	sys 0.041s
W20260709 13:09:52.930968 26686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.033s	sys 0.041s
I20260709 13:09:52.937033 26603 raft_consensus.cc:2368] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:09:52.924464   657 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:52.924896   919 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:52.924472   811 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:52.953182 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:52.934772   821 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:52.986136 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 464609us
I20260709 13:09:53.001232 26683 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:09:53.010337 26653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.013711 26757 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:09:53.020393 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:53.010174 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.022571 26761 raft_consensus.cc:2410] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:09:53.025112 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79194.6us
I20260709 13:09:52.935672   901 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:09:53.058800 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53167.8us
I20260709 13:09:53.066876 27315 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:09:53.098767 27315 pending_rounds.cc:85] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 13
I20260709 13:09:53.074466 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:53.099049 27315 pending_rounds.cc:107] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:09:53.099480 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:53.100030 27315 raft_consensus.cc:2889] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.075062 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.076934 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:53.054721 26509 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 10 to 11, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194), now has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 11 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:53.102564 26680 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:09:53.102919 26680 pending_rounds.cc:85] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 13
I20260709 13:09:52.999414   699 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:53.002887   850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.011s
I20260709 13:09:53.001164   779 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.087332 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:53.096249   939 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:53.110373 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 84398.6us
I20260709 13:09:53.089728 26755 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:53.110901 26509 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.090394 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.092057 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:53.021214   893 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.096133 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:53.096383 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:53.113435 27316 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:09:53.112718 26509 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 9 to 10, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 10 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.059441   789 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:53.103137 26680 pending_rounds.cc:107] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:09:53.118438 26680 raft_consensus.cc:2889] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.119872 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.121305 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.104400 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.087581 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:53.108592 26725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.019s
W20260709 13:09:53.125586 26725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.000s	sys 0.020s
I20260709 13:09:53.125662 26761 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:09:53.126173 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:53.058759   894 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:09:53.128574 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.133080 26576 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:53.134238 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:53.138937 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:53.139149 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:53.140213 26604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:53.130085 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:53.140925 26604 raft_consensus.cc:606] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:53.141448 26604 raft_consensus.cc:614] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:53.105590   850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.001s	sys 0.011s
W20260709 13:09:53.145291 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 45904.5us
I20260709 13:09:53.152006 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:53.155742 26612 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:09:53.156148 26612 pending_rounds.cc:85] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 13
I20260709 13:09:53.156374 26612 pending_rounds.cc:107] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:09:53.156603 26612 raft_consensus.cc:2889] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.153728   966 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 13:09:53.168241   950 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:53.169636 26681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3708) took 1291 ms. Trace:
W20260709 13:09:53.169859   954 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:53.170073 26681 rpcz_store.cc:276] 0709 13:09:51.878555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.882446 (+  3891us) service_pool.cc:224] Handling call
0709 13:09:51.882764 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.890756 (+  7992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.890808 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.896370 (+  5562us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.270343 (+373973us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18004c1ec0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:09:52.652821 (+382478us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:52.652889 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.652990 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.169271 (+516281us) raft_consensus.cc:1685] finished
0709 13:09:53.169294 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.169564 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3508,"raft.queue_time_us":8562,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7180,"spinlock_wait_cycles":31779584,"thread_start_us":381932,"threads_started":1,"wal-append.queue_time_us":1105680}
W20260709 13:09:53.172362   948 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:53.179570   595 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.197642   782 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.202275   782 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.185559   961 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:53.204253   961 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.204828   961 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:53.122392   837 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:53.186789 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 52632.8us
I20260709 13:09:53.191111 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3693) took 1029 ms. Trace:
W20260709 13:09:53.214717 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 84711.5us
W20260709 13:09:53.216184 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 83303.1us
I20260709 13:09:53.218304 26509 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 8 to 11, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 11 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.212198 26607 rpcz_store.cc:276] 0709 13:09:52.161768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.162748 (+   980us) service_pool.cc:224] Handling call
0709 13:09:52.178756 (+ 16008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.179223 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.179251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.185816 (+  6565us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.776644 (+590828us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.776679 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.776734 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.190906 (+414172us) raft_consensus.cc:1685] finished
0709 13:09:53.190926 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.191052 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1225,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":590429,"threads_started":1,"wal-append.queue_time_us":798911}
W20260709 13:09:53.192929   798 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.928s	user 0.006s	sys 0.004s
I20260709 13:09:53.203321   595 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:53.184091   952 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:09:53.192011   808 consensus_meta.cc:287] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260709 13:09:53.194628   955 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:09:53.116926   756 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.193187   495 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:53.217895   951 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:53.266355 26509 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 13, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.185070   907 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:53.197902   874 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:53.130409   779 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.137131   893 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.144734   650 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.122s
I20260709 13:09:53.347846   874 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:53.344604   595 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:53.348881 26758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 792) took 1046 ms. Trace:
W20260709 13:09:53.317543 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 102954us
I20260709 13:09:53.349282 26758 rpcz_store.cc:276] 0709 13:09:52.302238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.302391 (+   153us) service_pool.cc:224] Handling call
0709 13:09:52.302696 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.303064 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.303093 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.303566 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.660469 (+356903us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:52.660524 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.660611 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.348620 (+688009us) raft_consensus.cc:1685] finished
0709 13:09:53.348658 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.348819 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1144,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":356434,"threads_started":1,"wal-append.queue_time_us":793417}
I20260709 13:09:53.270810   808 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.342216 26509 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.352538   893 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:53.353324 26760 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:53.264209   798 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.353808 26509 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 10 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 13 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.261991 32433 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:53.264117   853 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:53.362699 26679 raft_consensus.cc:2368] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
W20260709 13:09:53.347679   953 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:53.373586 26509 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.379380 26509 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 14, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.341653   857 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:09:53.400835 27314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 784) took 1080 ms. Trace:
I20260709 13:09:53.406112 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55264 (request call id 2424) took 1079 ms. Trace:
I20260709 13:09:53.405874 27314 rpcz_store.cc:276] 0709 13:09:52.320552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.323417 (+  2865us) service_pool.cc:224] Handling call
0709 13:09:52.323743 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.324080 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.324106 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.324559 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.690026 (+365467us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:52.690068 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.690137 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.400608 (+710471us) raft_consensus.cc:1685] finished
0709 13:09:53.400632 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.400762 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":915,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":346068,"threads_started":1,"wal-append.queue_time_us":622029}
I20260709 13:09:53.406821 26686 rpcz_store.cc:276] 0709 13:09:52.326450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.368929 (+ 42479us) service_pool.cc:224] Handling call
0709 13:09:52.369314 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.369709 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.369731 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.370354 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.931380 (+561026us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:52.931421 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.931512 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.405904 (+474392us) raft_consensus.cc:1685] finished
0709 13:09:53.405927 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.406054 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64256,"raft.queue_time_us":97,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":76405,"thread_start_us":560638,"threads_started":1,"wal-append.queue_time_us":784642}
I20260709 13:09:53.348933   874 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:53.425405   494 consensus_meta.cc:287] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.002s
I20260709 13:09:53.445830   798 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:53.455943 26724 leader_election.cc:400] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:09:53.456640 26724 leader_election.cc:403] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:53.427881   782 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:53.464020   869 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:09:53.464249   969 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:09:53.454375   699 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.449788   804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.016s	sys 0.005s
W20260709 13:09:53.518592 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 302943us
I20260709 13:09:53.460214   960 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.496203   804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.016s	sys 0.005s
W20260709 13:09:53.666793 26651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.014s
W20260709 13:09:53.667322 26651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.008s	sys 0.014s
I20260709 13:09:53.529673   782 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:53.480813   869 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:53.532125   684 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:53.670871 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 531757us
W20260709 13:09:53.692659 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 160962us
W20260709 13:09:53.692706 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 475582us
I20260709 13:09:53.693651 26575 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:53.679141 26653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.010s
W20260709 13:09:53.695148 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 204114us
W20260709 13:09:53.699635 26653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.010s
W20260709 13:09:53.700726 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.027s	sys 0.079s
W20260709 13:09:53.701076 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.027s	sys 0.079s
I20260709 13:09:53.661387   899 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:53.701645 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 605835us
I20260709 13:09:53.702756 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:53.644075   760 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:09:53.532464   699 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:53.696079   861 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.002s
I20260709 13:09:53.711184 26682 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:53.712071 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:53.710903   798 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.680997   495 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.709878 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:53.667290   960 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.741089   699 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:53.744750 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:53.745700 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.685357   853 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:53.786674   853 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.789227   960 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:53.695807   684 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.707134   494 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.703560   635 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.744017   907 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:53.776072   495 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.797883 26686 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:53.805624 26682 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:53.805586 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 94903.6us
I20260709 13:09:53.811857   861 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:53.812480   975 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:09:53.812609 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 67958us
I20260709 13:09:53.833832 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:53.812891   671 consensus_meta.cc:287] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
W20260709 13:09:53.817209   972 log.cc:927] Time spent T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:09:53.817667   977 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:53.819913 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.843346 26683 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:53.773314   735 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:53.776770   857 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.711704   899 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.774036   798 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.851337   699 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.861405 26607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34cdb199be824317848395c2d8402714"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "77c617823f2e4a938ef247a8924e299b"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:53.866695 26607 raft_consensus.cc:606] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Received request to transfer leadership to TS 77c617823f2e4a938ef247a8924e299b
W20260709 13:09:53.862079 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 168551us
I20260709 13:09:53.850544 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.836506   809 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:53.837206   965 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.850772   789 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:53.872222   836 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.878823   836 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.880999   836 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:53.872478   977 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:53.822189   494 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.883369   977 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.884693   494 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:53.857074   861 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:53.877492 26686 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:53.854591   957 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:53.858908   850 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:53.886997 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.887328 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.896600 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:53.897228 26756 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:53.897548 26758 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:53.842597   671 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.852757   960 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:09:53.888039 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 194493us
I20260709 13:09:53.807080   869 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.824931   635 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.896967 26682 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:53.862327   857 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.906570 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.895612   957 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.904893 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:53.918074 26752 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:09:53.919592 26756 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:53.871592   699 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.875437   809 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.888496   789 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.886735   965 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:53.952553   495 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:53.954203   798 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:53.955196   684 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:53.957276   671 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:53.958211   982 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:09:53.959986   684 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.964969 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:53.966176 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:53.972945 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:53.973827 26757 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:53.975427 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.976279 26757 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:53.977216 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:53.977926 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:53.985569 26755 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:53.989446 26651 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:53.992136 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:53.992980 26685 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:53.901664   850 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:53.988577   991 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:53.984066   684 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.007730   684 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.008960   779 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:54.010316   985 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:09:54.012154 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 178416us
I20260709 13:09:54.012624 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2463) took 1532 ms. Trace:
I20260709 13:09:53.992888 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.013051 26760 rpcz_store.cc:276] 0709 13:09:52.480276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.480385 (+   109us) service_pool.cc:224] Handling call
0709 13:09:52.519512 (+ 39127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.353753 (+834241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.012366 (+658613us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002dc3d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:54.012548 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917173632}
I20260709 13:09:54.003830   991 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.005784   994 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.990911   977 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:54.021708 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 159779us
I20260709 13:09:53.998914   984 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:54.026935 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.027782 26683 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:54.035343 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.001799   899 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.000308   671 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:54.031860   994 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.059615   994 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.063000 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.069767   808 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.040172   494 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.072033   494 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.072397   494 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.073552   907 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:54.074891   907 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:54.076989   789 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.078166   809 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.039367   984 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.054790 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.016220   991 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:54.054582 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.088160 26612 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:54.075338   907 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:54.087594 26610 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:54.096982 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 221498us
W20260709 13:09:54.112564 26679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 3719) took 1694 ms (client timeout 1686 ms). Trace:
I20260709 13:09:54.096263 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.100675 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:54.124284 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.125268 26605 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
W20260709 13:09:54.113138 26679 rpcz_store.cc:269] 0709 13:09:52.393212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.438838 (+ 45626us) service_pool.cc:224] Handling call
0709 13:09:54.087449 (+1648611us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54003138d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:54.087579 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992742272}
I20260709 13:09:54.130390 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:54.091574   961 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.886s	user 0.013s	sys 0.000s
I20260709 13:09:54.140012 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:54.052131   635 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.129424   670 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.180578   670 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.091279   984 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.183262   699 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.184062  1014 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.184616  1014 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.185022   804 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.185741   798 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.186275   798 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.188336   735 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.188881   735 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.188337   798 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:54.194010   919 consensus_meta.cc:287] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.202s	user 0.004s	sys 0.006s
I20260709 13:09:54.194455 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.186601   670 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.110706   657 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:54.201288 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.203604 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:54.197403   782 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 13:09:54.204350 26607 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:09:54.208829 26605 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:54.194429   919 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
W20260709 13:09:54.206403   996 log.cc:927] Time spent T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:09:54.177507   857 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.216926 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.141065   809 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:54.234476 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:54.204721 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 58492.6us
I20260709 13:09:54.235203 26605 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:54.177335   907 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.194917   961 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:54.242398 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 268047us
I20260709 13:09:54.206737   850 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:54.235107 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 336134us
I20260709 13:09:54.216094   782 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
W20260709 13:09:54.247325 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 280210us
I20260709 13:09:54.251614 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:54.252382 27319 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.253916 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:54.255623 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:54.203842   657 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.268697   894 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:54.269380   789 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.270129   789 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.269450   894 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.272315   789 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.275542   914 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.276408 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.277702 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.278944 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.280294   894 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.285629 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.287024 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.276119   914 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.290228   914 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.233621   984 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.296478 26683 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:54.279610 26607 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:54.294181   907 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.299728 26612 raft_consensus.cc:606] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.300156 26612 raft_consensus.cc:614] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:54.265146 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.234943   809 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.306986 26754 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:54.310503 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 242028us
I20260709 13:09:54.311591 27285 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:54.315111 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50064.1us
I20260709 13:09:54.316505 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.304752   809 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:54.300477   990 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.332556 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.319536 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.333552 26758 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:54.335551 26604 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.338500 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.343508 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.312165   789 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:54.299572   962 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:09:54.305931   874 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:09:54.357388 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.307062   699 consensus_queue.cc:1059] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:09:54.295481   991 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.366091   991 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.367885   957 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.369935   756 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.370260 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.373950   984 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.376905   961 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:54.377431 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 140773us
I20260709 13:09:54.356359 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.379776 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.371361 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:54.347685   857 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:54.380651 27315 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:09:54.382299 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:54.381177 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.386487 26609 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.381824 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.382700 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:54.388504 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 121751us
I20260709 13:09:54.386829 27319 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:54.389317 27284 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:54.395944 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.396075 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.396981 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.397764 26759 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:54.398797 27317 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:54.327939   494 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.400374 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.401105 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:54.411648 26755 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:54.401414 26726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.194:36529 timed out after 1.686s (SENT) [suppressed 17 similar messages]
I20260709 13:09:54.401787 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.402228 26757 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:09:54.409020 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 74123.8us
I20260709 13:09:54.409819 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.414278 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.414623 26607 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:54.416251 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.417569 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:54.418428 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47145us
I20260709 13:09:54.414940 26681 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:54.424068 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.425376 26759 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:54.430655 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.430955 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.419304 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.435523 26609 raft_consensus.cc:2468] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:09:54.385253   857 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.388803   977 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.429744 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:54.475881 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 46233us
I20260709 13:09:54.480293 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.480896 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.482369 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.434755 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.380620  1002 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:54.412518  1014 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.343528   990 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.410609   699 consensus_queue.cc:1243] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:54.355405   789 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.433564   989 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.480917 26682 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:54.500751 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:54.427580   836 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:54.437265 32433 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:54.511094 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 121840us
I20260709 13:09:54.516710 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.522089 27318 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:54.415357  1010 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
W20260709 13:09:54.525508 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 90812.3us
I20260709 13:09:54.532351 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:54.495157   635 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:54.543987 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.495162   957 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:54.485666   899 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:54.475047   857 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:54.545984 26608 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:54.546413 26682 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:09:54.544461 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.551041 26682 pending_rounds.cc:85] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 12
I20260709 13:09:54.501693   798 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.551348 26682 pending_rounds.cc:107] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:09:54.554258 26682 raft_consensus.cc:2889] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.474448   780 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.523057   699 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:54.553193 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.521862   836 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:54.527796   917 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.546051   635 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:54.560523 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 159082us
I20260709 13:09:54.544147   988 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:54.486539  1002 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:54.486974   756 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:09:54.559656   780 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.558594  1019 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.547223   957 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.584676 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.570979   836 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:54.545859   782 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:54.559284   657 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.543603 32433 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.570878   989 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:54.573909   988 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.573213   635 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.590862  1025 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:54.559227   798 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.577975   735 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.589991   780 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.585534  1002 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:54.500881  1012 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:09:54.571326   699 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.593657   957 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.606490   988 raft_consensus.cc:3060] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.686168 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.602272   782 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:54.612775   989 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.678063 26755 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:09:54.663879 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:54.641886  1019 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:54.623036  1025 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:54.668113  1026 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:09:54.671262   635 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.672551  1010 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.668001   494 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.728184 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:54.689472  1034 log.cc:927] Time spent T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:09:54.642613  1036 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.641374   821 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:09:54.663306 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 281076us
I20260709 13:09:54.661877   808 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:54.691200   782 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.666082   798 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.674245  1035 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:54.744848   821 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:54.753252 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:54.724080   965 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.728822  1018 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:54.723649   809 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:54.773344  1016 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:09:54.774618 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.752774   808 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.769989   965 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:54.765895   789 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.793077 26611 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:54.813889 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.814592 26606 raft_consensus.cc:2410] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:09:54.756335  1035 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.784938  1041 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.821755 27318 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:09:54.815650   990 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.769549  1018 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.828603  1002 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.816470   965 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:54.770144   821 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.838135 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.841130 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.841697 26609 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:09:54.841836  1018 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.780488  1025 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.842425  1035 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.842785  1025 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:54.859404   789 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.860060 26678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 841) took 1076 ms. Trace:
I20260709 13:09:54.860015   789 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.861250 26761 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:54.861385 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.860563 26678 rpcz_store.cc:276] 0709 13:09:53.783277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.784516 (+  1239us) service_pool.cc:224] Handling call
0709 13:09:53.784846 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.839201 (+ 54355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.839230 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.850356 (+ 11126us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.193888 (+343532us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:54.193931 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.859689 (+665758us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400127ad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:54.859736 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.859780 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:54.859793 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.860002 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3931,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5931,"spinlock_wait_cycles":124277120,"thread_start_us":307348,"threads_started":1,"wal-append.queue_time_us":394761}
I20260709 13:09:54.862021 26753 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:54.862217   789 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.862704 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:54.862905 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.863407   635 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.863637 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:54.864321   821 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.864537   809 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.863575 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:54.876981   699 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:54.881793 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 429987us
I20260709 13:09:54.832693  1041 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.888975 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:54.893293 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.909523   808 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:54.917235  1027 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
W20260709 13:09:54.919150  1030 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:09:54.878612   989 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:54.928728   682 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.928923 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:54.929364   682 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.929917   798 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:54.930369 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:54.930661 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.931196 26650 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:54.931499   682 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.983960  1045 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.934094   811 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:54.936268 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.985049   811 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:54.936793  1015 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.353s	user 0.002s	sys 0.000s
W20260709 13:09:54.985982  1033 log.cc:927] Time spent T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:09:54.933315 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.937705 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:54.945792  1042 log.cc:927] Time spent T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:09:54.990252 26686 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:54.966230 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.991255 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.942013 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.991997 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.992554 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.928933  1040 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.993047 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.987471   788 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.993784 26684 raft_consensus.cc:2393] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:54.993355  1040 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.993899   788 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.931926   595 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:54.985673 26678 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:09:54.946939  1043 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:54.976684 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.997165   788 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.944497   965 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.997824  1040 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:54.998739 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:54.932505   984 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:54.960448 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.000069   984 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:54.993533 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:55.004370 26685 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:54.932302   903 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.974395 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.930409   798 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.934173 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:54.945766 26576 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.001499 26686 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
W20260709 13:09:55.002198 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 71065us
I20260709 13:09:55.022650 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.024156 26680 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:55.024067 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.024600 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:55.024838 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:54.984705  1045 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.002589 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:55.005860 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:54.934432 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.009641 26758 raft_consensus.cc:3055] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:55.011860 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.032053 26603 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:55.031425 26758 raft_consensus.cc:740] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:55.006683 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:55.021646 26678 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:55.025555 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.000332 26760 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:55.027650 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:55.028864 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.035456 26609 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.009023   984 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.949630   989 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:55.049616 26684 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:09:55.007218  1024 log.cc:927] Time spent T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:09:55.043339 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97686.4us
I20260709 13:09:55.052978 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:55.054692  1002 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.051960 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:55.056488   957 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.058677   957 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.048816   983 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.062700   914 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.065192   798 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:54.948107 32433 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.033663 26758 consensus_queue.cc:260] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:54.953624  1041 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.006558   869 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.041106 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:55.100379 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 63280.8us
I20260709 13:09:55.102227 26685 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:55.066597 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.007385  1040 raft_consensus.cc:2804] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:55.046792 26680 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:55.043263 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:54.960855   857 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.069594   989 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.042229   893 raft_consensus.cc:2764] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:55.079010 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:55.079802 26687 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
W20260709 13:09:55.128984 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 50068.4us
I20260709 13:09:55.129449 26758 raft_consensus.cc:3060] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:55.082296 26760 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:55.131043  1014 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:55.131191 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.131600  1014 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.132169 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.132454  1014 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.133584 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.133970 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:55.134857 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.083235 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:55.136178 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 53005.5us
I20260709 13:09:55.137184   960 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:55.137596   960 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:55.137956   960 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:55.144073 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.144728   816 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:55.084051 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.145500 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:55.097257   808 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.027119   836 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.027228   903 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.089854 32433 raft_consensus.cc:993] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower 77c617823f2e4a938ef247a8924e299b to start an election
I20260709 13:09:55.052474   699 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:09:55.091212 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.092175 26609 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:55.094681 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.069284   991 raft_consensus.cc:2764] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:09:55.041710   990 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.093607   984 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:54.946997  1008 consensus_queue.cc:1059] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.121s
W20260709 13:09:55.103487 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 60292.8us
I20260709 13:09:55.200781 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.104719 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:54.929373   780 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.112807   811 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.119804   804 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:55.120404   919 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:55.069334   782 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.124279   988 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.125197 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:55.109673   993 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:55.127300   989 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.146320 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.070308  1023 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:09:55.149712 26687 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:55.215080 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.150300 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.151917 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:55.153373 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.216217 26680 raft_consensus.cc:2368] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:09:55.217280 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.153841 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.157697 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.161769 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:55.219877 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58190.5us
I20260709 13:09:55.151180 26758 raft_consensus.cc:1275] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:09:55.220613 26758 pending_rounds.cc:85] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 11
I20260709 13:09:55.220738 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.164912 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:55.166607 26756 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:55.163216 26754 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:55.223453 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:55.167125 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 72514.8us
I20260709 13:09:55.223939 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.167730 26611 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:55.108474   596 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.175990 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.176548 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:55.201543 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.205385 26759 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 21: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:55.208622 26682 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:55.158181  1040 raft_consensus.cc:697] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:55.235249 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:55.224804 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59967.2us
I20260709 13:09:55.220830 26758 pending_rounds.cc:107] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:09:55.238782 26758 raft_consensus.cc:2889] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.224074 26681 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:55.226491 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 121879us
I20260709 13:09:55.199721 32433 raft_consensus.cc:1081] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Signalling peer 77c617823f2e4a938ef247a8924e299b to start an election
I20260709 13:09:55.262635 26752 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:09:55.263818 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 62327.8us
I20260709 13:09:55.268842 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.208078  1039 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.211928   804 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.277578 26755 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 21: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:55.277019 26757 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:55.275946 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:55.272423   805 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.232935   816 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.166641  1004 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.105s
I20260709 13:09:55.223112   993 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:55.233741   989 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.233527  1025 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:55.299997 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 58755.3us
I20260709 13:09:55.262782   850 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.233170   991 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:55.276288   808 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.275974   981 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:55.316643 26576 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.291831   804 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:55.275722   853 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:55.301651   993 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:55.272230   682 consensus_queue.cc:1048] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:09:55.341140 26756 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:55.342139 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.342545 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.342842 26756 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:55.348230 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.351011 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:55.352653 26758 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:55.311991  1039 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.314949   999 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:55.296875   990 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:09:55.361989 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.321224   821 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:55.370783 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:55.371562 26754 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:55.374861 26756 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:55.377345 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.382328 26607 raft_consensus.cc:1240] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:55.386976   780 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.387253 26612 raft_consensus.cc:1240] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:55.387763  1011 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:09:55.358525  1040 consensus_queue.cc:237] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.388340   980 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.389063   980 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.321501   991 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.372241   999 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.393754   991 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.394223   999 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:55.396400 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146717us
I20260709 13:09:55.357146   914 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:55.401707 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.407238 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:55.330978   735 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
W20260709 13:09:55.422417 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 145459us
I20260709 13:09:55.332190   981 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.364980  1039 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.374027   821 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.406119  1045 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:55.470311 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47072.1us
W20260709 13:09:55.477377 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 211181us
I20260709 13:09:55.412436   899 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:55.508889 26726 leader_election.cc:400] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:09:55.509852 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.415702   991 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:09:55.516319 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.522398 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.500716   903 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.424875   850 consensus_queue.cc:1059] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:09:55.561564 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.559083 26753 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:55.515161   984 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.521652   788 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:55.521827   782 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.522567   988 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.554602   811 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.554318   798 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.563947   965 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.561801  1045 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:55.578089  1014 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:55.579444   961 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:09:55.599731  1062 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:09:55.600339 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86327.5us
I20260709 13:09:55.601178 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.588044   914 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.602712 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:55.574990   650 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.606169 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:55.599915   981 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.596345   798 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.607362   914 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.608644   821 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:55.609169  1058 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:55.609688   798 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.594980   811 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.612974   811 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:55.620464 27284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.596124  1002 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.621750 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:55.603603 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 191182us
I20260709 13:09:55.595161   907 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.642454   907 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.644640   907 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.640736 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:55.646283 26685 raft_consensus.cc:2393] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:55.642024 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.647130 26687 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:55.600210   961 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.615434   495 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:55.617815   809 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:55.621999   991 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:55.617772   596 consensus_queue.cc:1059] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:09:55.650671  1054 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:09:55.600848   965 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.623977   960 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.655923   495 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:55.677071   809 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:55.670413  1060 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:09:55.683122  1081 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:55.686269  1075 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:55.690208 27285 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:55.666972   957 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:55.663954   991 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:55.714017 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.692001   495 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:55.689155  1068 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.711905  1035 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:55.712839   991 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:55.753535   960 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.755520  1044 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:55.756222  1044 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:55.756021   809 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.757519  1044 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.758924  1044 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:55.760617  1076 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:55.736316  1035 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:55.781188 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:55.782438 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:55.772258 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97572.2us
I20260709 13:09:55.803413 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.803800 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:55.751060   804 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.788170 26685 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:55.807171 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.794298 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:55.807862 26607 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:09:55.808128 27315 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:55.804765 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.775115 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.768716  1069 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:55.806689 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.783979 27313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34cdb199be824317848395c2d8402714"
dest_uuid: "77c617823f2e4a938ef247a8924e299b"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:09:55.811030  1012 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.811178 27313 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:55.811757 27313 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:55.812469  1073 log.cc:927] Time spent T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:55.813024 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.814517   816 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:55.815861  1081 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:55.818490 26752 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:55.774073  1039 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.820230   899 raft_consensus.cc:3055] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:55.820866   899 raft_consensus.cc:740] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:55.821412   961 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.821918   899 consensus_queue.cc:260] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.809988 26610 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:55.811424 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:55.825798 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.827907 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.828152 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.829041 26611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:55.830016 26611 raft_consensus.cc:606] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.830476 26611 raft_consensus.cc:614] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:55.832306 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.835054 26604 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:55.834515 27313 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.823436   899 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:55.801290  1035 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:55.727849  1068 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.843848 26678 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:55.844264 27313 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.788065   805 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.853056 26608 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:55.783627   495 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.846875  1004 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.837886  1069 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.858449   965 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.869064   760 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:55.875699   760 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.878470   804 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.879756   836 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:09:55.888343   991 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.890005   991 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.882169   789 raft_consensus.cc:3055] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:55.897593   789 raft_consensus.cc:740] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.898167   857 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:55.898428   789 consensus_queue.cc:260] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.899706   789 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:55.901750   980 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.903496   760 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.905007   760 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:55.905633  1035 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.909883  1035 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:55.912431  1080 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:55.912588  1068 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.912904  1080 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.913539  1069 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:55.913792  1080 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.915177  1080 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:55.922261  1079 raft_consensus.cc:3055] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:55.922613  1079 raft_consensus.cc:740] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.923144  1079 consensus_queue.cc:260] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:55.923921  1079 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:55.965855 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.976368 26611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:09:55.976665 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:55.985997 26610 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:55.977727 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:55.986444 26610 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:55.985807 26611 raft_consensus.cc:606] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:55.987972 26610 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:55.989879 26610 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:56.000692 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.004881 26681 raft_consensus.cc:1240] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:56.010166 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.020659 26760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36840
I20260709 13:09:56.021698 26760 raft_consensus.cc:606] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:09:56.024782 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:56.025998 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:56.026381 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.026170 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.028522 26606 raft_consensus.cc:2393] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:56.036123 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:56.047201 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.052877 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.056160 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.056842 27319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46926 (request call id 791) took 1368 ms. Trace:
I20260709 13:09:56.051169 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:56.051916 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.061126 27315 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:56.052634 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.057595 27319 rpcz_store.cc:276] 0709 13:09:54.695141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.695277 (+   136us) service_pool.cc:224] Handling call
0709 13:09:54.736260 (+ 40983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.840588 (+104328us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:55.751052 (+910464us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b18004e27a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a0455 00007f40f6c883c7 00007f40f329a9a7 00007f40f32aa0bf
0709 13:09:55.751275 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.845339 (+ 94064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.845391 (+    52us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:55.845454 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.056163 (+210709us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54005c1f54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:56.056261 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.056577 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":360268,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":823,"raft.queue_time_us":73,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3049,"spinlock_wait_cycles":309765888,"thread_start_us":493352,"threads_started":2,"wal-append.queue_time_us":115246}
I20260709 13:09:56.065636 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.067008 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.067703 26755 raft_consensus.cc:1240] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:56.068298 27315 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 17: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:56.068746 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:56.069128 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.069509 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.070211 26758 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:56.070624 26607 raft_consensus.cc:2393] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:09:56.079873 26610 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:09:56.083045 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:56.087275 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.091830 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.094141 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.095595 27319 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:56.101308   495 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.101748 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.102768 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.103593   596 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:56.104198 26755 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:56.104074   789 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:56.109445   853 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:56.104619 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.138500 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:56.143198 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:56.144006 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.145205 26678 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:56.146018   596 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.147570   789 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.149797 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:56.150718   789 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.149750 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.151531   853 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.152341 26610 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.153030 26605 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:09:56.154516   853 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.138918 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.158036 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.158268 27313 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:56.158638 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.158036 27315 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:56.159991 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.160832 26754 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 13.
I20260709 13:09:56.161886 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.163136 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.164011 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.164778 26757 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.166811 26752 raft_consensus.cc:1275] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:09:56.167930 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94499.9us
I20260709 13:09:56.169247 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:56.170845 32433 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:09:56.175287   993 consensus_meta.cc:287] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.000s
I20260709 13:09:56.175837   993 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.180014 26687 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:56.183341   596 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.183526 26757 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:56.194442 26678 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:56.200766 26610 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:56.202396 26754 raft_consensus.cc:2393] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 22: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:56.213918 26603 raft_consensus.cc:1240] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:56.218088 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:56.216651 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 133963us
I20260709 13:09:56.230017   983 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.230832   983 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.233407   983 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:56.236909 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 67948.5us
I20260709 13:09:56.237174   977 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.241534   980 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:56.242059   980 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.242484   980 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.243820  1068 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.244491  1068 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.246932  1068 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:56.226392 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.252492 27315 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:56.252574 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:56.253893  1068 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:56.254465  1068 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:56.233275   836 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:56.260442 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:56.262712 26611 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:09:56.251462 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
W20260709 13:09:56.263823 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.257890  1068 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:56.271937 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.270850 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.272208 26685 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:56.283919 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:56.291801 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.277024 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:56.294914 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:56.275902   836 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.312590 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3740) took 1072 ms. Trace:
I20260709 13:09:56.313063 26603 rpcz_store.cc:276] 0709 13:09:55.240001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.240153 (+   152us) service_pool.cc:224] Handling call
0709 13:09:55.240495 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.223075 (+982580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.312186 (+ 89111us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b540003ded4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:56.312500 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153167744}
W20260709 13:09:56.316442 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45329.5us
I20260709 13:09:56.320174 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:56.323446   809 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:56.325249   853 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:56.325699   853 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:56.326450 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.328083  1039 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:56.328573  1039 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:56.329756 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 46118.1us
I20260709 13:09:56.328998  1039 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:56.300199   983 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.363121   809 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.364081 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.364398  1036 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:56.364903  1036 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:56.365319  1036 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:56.365357   682 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.330281   993 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.378911 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.379725 26761 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:56.326880   853 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.375085 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:56.374563   983 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:09:56.424431 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 162633us
W20260709 13:09:56.428316   760 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.010s
I20260709 13:09:56.429425   983 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.434237   836 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:56.444846 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:09:56.448228 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61705.9us
I20260709 13:09:56.449620 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.450625   837 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:56.427095 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.468653 26761 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
W20260709 13:09:56.470360 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44312.4us
I20260709 13:09:56.469376 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.481163 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.461325   990 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.468855   894 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:56.475487   853 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:56.503392 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.478320   836 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:56.514242 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 263051us
W20260709 13:09:56.516482  1095 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:09:56.526372 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.533115 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.534386  1085 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:56.535029  1085 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:56.535778  1012 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.536460  1012 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.539569 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:56.557098 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 226054us
I20260709 13:09:56.558318 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.535507  1085 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:56.579368 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47096.8us
I20260709 13:09:56.580936 26687 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:56.582041   857 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:56.584009 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.585870  1036 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.601111 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:56.532671   836 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.614288 26682 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:09:56.614817  1090 log.cc:927] Time spent T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:56.616109   804 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:56.617498 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.618211 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.618939 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.583359  1068 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.611578 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:56.633121 26678 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:56.621287 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.622794 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:56.608791  1039 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.626237 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:56.621114  1084 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:56.638650 26686 raft_consensus.cc:2410] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:56.566761   682 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:09:56.644541 26687 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:09:56.644729 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86547.9us
I20260709 13:09:56.645551 26577 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:56.642287 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 150115us
I20260709 13:09:56.656637 26678 raft_consensus.cc:1240] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:56.665002 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 58305.6us
I20260709 13:09:56.658232   990 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:56.656908  1012 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.685235 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.671610  1084 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:56.690629  1098 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:56.690834 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.691215   735 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:09:56.677302   999 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.687196 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.695937 27313 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:09:56.667788   894 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:56.702394 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:56.702301 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 142144us
I20260709 13:09:56.694805   993 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:56.683125   804 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.695983   983 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:56.720070   983 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:56.721191   983 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.716468 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.736865   836 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:56.738631 26760 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 23.
W20260709 13:09:56.728879 32433 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.003s
I20260709 13:09:56.751556 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.752310 27313 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:56.725582   990 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.752707 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:56.728617   993 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:56.705338   495 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:09:56.753337  1079 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:56.774343 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:56.775885   837 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.776510   837 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:56.777078 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 71470.8us
I20260709 13:09:56.783352 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:56.778864   837 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.772904  1036 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.770980  1104 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:56.795127 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 93409.7us
I20260709 13:09:56.753713   999 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.794359  1068 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:56.794796  1039 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.819837 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:56.821278 26761 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:56.804491 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.774288   990 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.804505  1104 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.810886  1078 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:56.838372 26754 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:56.840564 26756 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:56.836159 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:09:56.844647 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 105662us
I20260709 13:09:56.837025 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:56.845118  1036 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:56.840451  1104 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:56.854403 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45970.2us
W20260709 13:09:56.858418 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 54012.5us
I20260709 13:09:56.863471 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:56.848078  1039 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.851048   907 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.831463  1084 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.871807  1102 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.872732  1102 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:56.874058  1102 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.874904  1039 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.876996  1068 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:56.877831  1068 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:56.878712  1068 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.879806   899 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.881667   857 consensus_queue.cc:1059] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:56.882798 26503 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 14 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:56.884421 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:56.885810  1103 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:56.888616   999 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:56.876415  1107 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:56.889424  1107 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:56.892944 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:56.896809  1112 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.893733  1106 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:56.901705  1039 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.917132  1107 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:56.864192  1036 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:56.924427  1077 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:56.926132  1036 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:56.826678   894 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.907557   857 raft_consensus.cc:3055] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:56.953308 26503 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.990569 26753 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:56.994833 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 147124us
W20260709 13:09:57.001283 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 105742us
I20260709 13:09:57.006480 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:56.987522   857 raft_consensus.cc:740] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:56.992511 26503 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 15 to 21, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 21 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:57.014839 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 66399.9us
I20260709 13:09:56.865818   993 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.021271 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:56.956455   907 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:56.957504  1104 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:57.014788   980 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.772s	user 0.005s	sys 0.010s
I20260709 13:09:57.025436 26678 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:57.016587   837 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:57.034004 27315 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:57.034657 26503 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 16, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 16 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:09:57.041623 26509 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 118) took 26397 ms (client timeout 15000 ms). Trace:
I20260709 13:09:57.042943 27316 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:57.048715 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:57.051762 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 369886us
I20260709 13:09:57.034329   837 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.055888 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.059620 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:57.065879 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.032120   980 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.068141   907 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.075827 26605 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:57.078366 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:09:57.092885 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44213.6us
I20260709 13:09:57.097819 26681 raft_consensus.cc:2368] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20.
I20260709 13:09:57.097982   980 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:57.098743  1110 log.cc:927] Time spent T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:09:57.099861 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:57.101759 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:57.089499 26503 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.076246   837 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.119037 26651 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.074776   804 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.079870 32433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49182 (request call id 12) took 2744 ms. Trace:
I20260709 13:09:57.088876   990 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.118582  1127 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:09:57.042265 26509 rpcz_store.cc:269] 0709 13:09:30.636018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.636261 (+   243us) service_pool.cc:224] Handling call
0709 13:09:57.027318 (+26391057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:53.790535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:53.878959 (+ 88424us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:53.879003 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:09:53.879020 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:53.880457 (+  1437us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:53.880517 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:53.880552 (+    35us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:09:53.881740 (+  1188us) tablet.cc:701] Row locks acquired
0709 13:09:53.881758 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:53.881924 (+   166us) write_op.cc:270] Start()
0709 13:09:53.882045 (+   121us) write_op.cc:276] Timestamp: P: 1783602593881871 usec, L: 0
0709 13:09:53.882065 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:53.884647 (+  2582us) log.cc:844] Serialized 6391 byte log entry
0709 13:09:54.895021 (+1010374us) op_driver.cc:464] REPLICATION: finished
0709 13:09:54.989142 (+ 94121us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f328be28 00007f40f6cc6581 00007f40f6cc5d58 00007f40f6cca9f1 00007f40f6cca9a9 00007f40f6cca939 00007f40f6cca901 00007f40f6cc9b2d 000000000038f354 000000000038f199
0709 13:09:55.396456 (+407314us) write_op.cc:301] APPLY: starting
0709 13:09:55.400927 (+  4471us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:55.914384 (+513457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:55.914412 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:56.156533 (+242121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:56.156992 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:09:56.157069 (+    77us) write_op.cc:312] APPLY: finished
0709 13:09:56.163919 (+  6850us) log.cc:844] Serialized 139 byte log entry
0709 13:09:56.267874 (+103955us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:56.297156 (+ 29282us) write_op.cc:454] Released schema lock
0709 13:09:56.299729 (+  2573us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:56.323463 (+ 23734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:56.323504 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1067393,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":458989,"apply.run_cpu_time_us":80237,"apply.run_wall_time_us":947214,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":328113,"prepare.run_cpu_time_us":32909,"prepare.run_wall_time_us":1198796,"raft.queue_time_us":104825,"raft.run_cpu_time_us":32799,"raft.run_wall_time_us":313275,"replication_time_us":1009883,"spinlock_wait_cycles":4279424,"thread_start_us":1033136,"threads_started":5,"wal-append.queue_time_us":917575,"wal-append.run_cpu_time_us":31524,"wal-append.run_wall_time_us":1225223}]]}
I20260709 13:09:57.138142 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.141054 26651 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.060640   857 consensus_queue.cc:260] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.142132 26503 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 10 to 11, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 11 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.157968 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:57.158087 26651 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:57.154853 26503 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 19, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.159792  1116 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:57.160476  1116 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.160977  1116 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.161114 26503 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 17, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 17 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.134801 32433 rpcz_store.cc:276] 0709 13:09:54.311058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.311206 (+   148us) service_pool.cc:224] Handling call
0709 13:09:54.970756 (+659550us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b2c000fb558. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b98a0a 00007f40f1b98693 00007f40f1b98631 00007f40f32cb3f1 00007f40f32049fe 00007f40f328b749 00007f40f328c76a 00007f40f328b91b 00007f40f329703c 00007f40f32966b3
0709 13:09:54.972698 (+  1942us) log.cc:844] Serialized 508 byte log entry
0709 13:09:55.754687 (+781989us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b180033ce20. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:09:57.045374 (+1290687us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51548,"raft.run_cpu_time_us":10504,"raft.run_wall_time_us":160873,"spinlock_wait_cycles":15556096,"thread_start_us":392146,"threads_started":1,"wal-append.queue_time_us":457226,"wal-append.run_cpu_time_us":3270,"wal-append.run_wall_time_us":1255047}
I20260709 13:09:57.164405 26503 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 18, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 18 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.156131 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.170622  1084 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.171236  1084 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.173544  1084 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.176345 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.177006 27318 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:57.182538  1128 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:57.184533 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:57.169081  1085 consensus_meta.cc:287] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.003s
I20260709 13:09:57.167512   907 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:57.174464   980 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.204206 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.205638 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.206403   804 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:57.206710 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.207093   804 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:57.207751  1129 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:57.207855   682 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:57.209393 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.210271  1104 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.146966  1127 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.215099 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.216313 26503 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.217425 26684 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:57.217908 26503 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 18, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 18 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.219794   980 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:57.220279   980 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.222635 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:57.223264 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.224481   804 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:57.209316 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:57.225311 26607 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.224905   804 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.229455   804 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.254213 26503 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.248757 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:57.255934 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:57.241972   857 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.224798  1116 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.201623  1085 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.266093 26503 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.267256 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.239234 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c04d1d6cb7c54df78a1746de67ce6198 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:57.259873   907 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:57.256237   596 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:09:57.273725 26503 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 18 to 20, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 20 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.247701   682 consensus_queue.cc:1048] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:09:57.300128 26503 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 17, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.310698 26609 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:09:57.268723  1036 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:57.313426 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46270.6us
I20260709 13:09:57.309973 27319 raft_consensus.cc:2955] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.322010  1010 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.322713  1010 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.300014  1129 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:57.317682 26503 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.311844  1085 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.274888   983 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:09:57.341966  1123 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:09:57.342262 26651 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.343016  1121 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:09:57.343830  1124 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:57.344650  1114 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.344414  1124 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.345196  1114 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.346040  1085 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:57.346254  1112 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.347112  1127 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:57.320032 26494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81092.7us
I20260709 13:09:57.350514  1116 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.332895  1036 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.351804 26503 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 16, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 16 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.360993 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.361315 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.361656 26759 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:57.355304  1085 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:57.377686 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.379953 32433 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:57.380627 32433 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:57.383325  1114 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.385823 26503 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:57.389092 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 164072us
I20260709 13:09:57.381163   980 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.390931 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:57.391472 26606 raft_consensus.cc:1240] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:57.393159 26687 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:57.392731 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 133207us
I20260709 13:09:57.395027   980 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.394980 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:57.391331 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.398089 26726 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.398919  1068 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:57.399580 26726 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.412249 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.413100   990 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:57.413151 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:09:57.416040 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.416846 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:57.416673 26759 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:09:57.419220 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.448953 27313 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:09:57.417670 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.357722  1079 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:09:57.388676  1116 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.455051 26760 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:57.456151 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.458379 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:57.453686 26503 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 13 to 14, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:09:57.459003 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.420305 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.461256 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:57.457492 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.375782  1127 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 13:09:57.460119 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 201288us
W20260709 13:09:57.470825  1137 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:57.478399 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.464334  1102 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:57.484788 26610 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:57.487100 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:57.487807 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:57.489212 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.489915 26683 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:57.458015  1130 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:09:57.497346  1010 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.497938  1010 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.467682  1116 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.498418  1010 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.500213  1116 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.501541   735 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:57.501909   853 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 13:09:57.502071   735 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:57.503993   837 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.505290 26575 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:57.506196 26679 raft_consensus.cc:2368] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19.
I20260709 13:09:57.507035 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.507037 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:57.508343 26678 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17.
I20260709 13:09:57.512063 26680 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.513201 26756 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:57.514038   853 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:57.484042  1144 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:57.523837 26755 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:57.525167   853 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:57.526253   853 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.527940 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.484490  1102 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.541194 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.542057 26753 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:09:57.550879 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.551826 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:57.553303 26760 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.548257 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.557626 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.557821 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:57.558252 26752 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:09:57.542971  1102 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.545670  1036 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.592473  1010 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.589596   899 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.594509   899 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.597340   899 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:57.598063   899 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:57.598641   899 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:57.603236 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69120.6us
I20260709 13:09:57.587270   894 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:57.607290   894 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.609603   894 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.610181   837 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.611292  1085 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.612375  1085 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:57.612412  1112 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:57.589926   977 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:57.652858 26680 raft_consensus.cc:2468] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:09:57.655493 26684 raft_consensus.cc:1240] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:57.665289 26607 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:57.669579 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:57.671260 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.676225 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.678072 26608 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:09:57.669010  1142 consensus_queue.cc:1059] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:09:57.673833  1114 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:09:57.652635  1036 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:09:57.685871 26611 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:57.690758   988 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:57.668370   804 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.694196   988 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.685164  1080 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.734580 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:57.735102 26611 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:09:57.738559 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 69060.9us
W20260709 13:09:57.742425 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.738632 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 77903us
I20260709 13:09:57.743394 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.753638 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.757751 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:57.759378  1158 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.759991  1158 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.755848   853 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:09:57.804244 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 46567.6us
I20260709 13:09:57.740536  1080 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:57.821346  1150 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:09:57.822136   857 consensus_queue.cc:1059] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:57.824487   596 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:57.826056  1158 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.826897  1161 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:57.758651   899 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:57.802573   853 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.843632   596 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.809401   760 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:57.850888   853 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:57.852576  1160 raft_consensus.cc:3055] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:57.853034  1160 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:57.853977  1160 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.854959 26756 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:57.855311  1160 raft_consensus.cc:3060] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.862955 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:57.863819 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 56069.6us
I20260709 13:09:57.864720 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:57.866101 26753 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:09:57.875700 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 122121us
I20260709 13:09:57.865783 27284 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:57.877115 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.879469 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.882865 26726 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.883699 26651 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:57.851106   596 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.865423  1158 raft_consensus.cc:3055] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:57.886040 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:57.877759   899 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:57.841167  1102 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.881982   894 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:57.884838  1116 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:57.885521   907 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:57.885470   495 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.900813   495 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:57.888687   983 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:57.888175  1158 raft_consensus.cc:740] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:57.905211 26760 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:57.898406 26726 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.893467   899 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.876935   760 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.896040  1161 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:57.895692   804 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.896122   894 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.923182  1166 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:57.923972  1080 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.924268  1166 consensus_queue.cc:1059] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:57.905272   999 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:57.905097  1121 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.905256  1068 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:57.924021   760 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.926096   894 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.913959   899 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.925701  1166 raft_consensus.cc:3055] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:57.936997 26726 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:57.938558 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.909307  1151 raft_consensus.cc:2764] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:09:57.938870 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:57.929574   907 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.985610   495 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:57.952728   804 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:57.926520   988 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:57.929870   999 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.954685  1121 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.979957  1102 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:57.952862  1158 consensus_queue.cc:260] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:57.975868 26754 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:57.983831  1129 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:58.009887 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:58.013130 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:58.015539 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 129561us
I20260709 13:09:58.016343 26685 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:57.940248  1166 raft_consensus.cc:740] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:58.021559 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 95487us
I20260709 13:09:58.019294 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:57.983300   899 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.026815 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:58.027685 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.016832   999 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.016036   977 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:58.031059 26577 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17.
I20260709 13:09:58.021468  1143 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:58.036653  1143 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.037088  1143 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.039733 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:58.041393  1158 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.033051 26682 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:58.045408 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.047940 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.049129 27319 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:58.017043   907 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.017539   804 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.052489  1165 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:58.053042  1165 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.053390  1165 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.054616  1127 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:58.055083   804 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:58.055961  1139 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.718s	user 0.003s	sys 0.001s
I20260709 13:09:58.056073 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:58.056665 26603 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.057219 26609 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:58.050580 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:58.059926 27313 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:58.060662   907 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.049678  1174 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:58.062019  1174 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:58.062493 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:58.062472  1143 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.062966  1174 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.052628   857 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:58.068181 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:58.069190   980 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:58.022655  1129 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:58.077637  1163 log.cc:927] Time spent T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:09:58.020368   853 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.083053 27313 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:09:58.087554 26726 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:58.089197 26603 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:58.117303 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.123291 26612 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:58.125391 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.119251 26650 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:09:58.130420 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 101764us
I20260709 13:09:58.131757 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.133560 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.139302 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.140650 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.141518 26607 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:58.081737  1124 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.151818 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.126212   804 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:58.158270 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.139410  1107 raft_consensus.cc:2804] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:58.160518  1174 consensus_queue.cc:1059] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:58.148977  1130 raft_consensus.cc:2804] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:58.170742 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.177815 26758 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:09:58.187404  1173 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:58.189391  1125 raft_consensus.cc:3055] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:58.189862  1125 raft_consensus.cc:740] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:58.051882  1166 consensus_queue.cc:260] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.193217  1129 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:58.162150  1160 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:58.193943  1160 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.194346  1160 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:58.198860 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.199050   735 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.200453   735 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.176435   804 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.202598   804 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:58.170428  1169 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:58.204257  1121 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.205471 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:58.206049 26603 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.206166  1130 raft_consensus.cc:697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:58.206660   596 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.206066  1165 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.177608  1107 raft_consensus.cc:697] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:58.209345  1107 consensus_queue.cc:237] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.210067  1165 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:58.210330 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:58.210834 26754 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:58.212781  1036 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:58.213166 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:58.215848  1102 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:58.217799 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:58.220669 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3756) took 1531 ms. Trace:
I20260709 13:09:58.231184 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.221210 26606 rpcz_store.cc:276] 0709 13:09:56.688983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.689225 (+   242us) service_pool.cc:224] Handling call
0709 13:09:56.708223 (+ 18998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.393469 (+685246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.220383 (+826914us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54001f6154. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:58.220594 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570891136}
W20260709 13:09:58.226891 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 92969us
W20260709 13:09:58.242444 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.243537 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.246090 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.247090 26756 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:09:58.251348 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:09:58.252256 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.241298 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:58.253255 26612 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:58.253613 26760 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:58.171303   980 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.250810  1102 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:58.261739 26756 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:58.262257 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.263011 27319 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 22: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:58.264674 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.268342 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.282776 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:09:58.285673 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 142463us
W20260709 13:09:58.286089 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52382.4us
I20260709 13:09:58.287413 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.291464 26682 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:58.291997 26752 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:58.300624 27318 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:58.293848 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.266989  1161 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:58.300843 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.272401   804 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.255025   894 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.315114 26603 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:58.292992   983 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.343961   983 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.346208   983 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.301692  1102 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:09:58.350437 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:58.352175   596 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.352553 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.353240 26756 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:09:58.354905   596 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:58.315186  1181 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.185s
I20260709 13:09:58.292778   907 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.272884   980 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.305358   899 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.328889 26757 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:58.333554  1183 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:58.333761   682 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.335131  1169 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:58.337934   853 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:58.368196 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74445.2us
I20260709 13:09:58.380468 26612 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 22.
I20260709 13:09:58.300480  1116 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:58.355463   596 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:09:58.396124 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 106153us
I20260709 13:09:58.402230 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.403028 26757 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:58.362754  1181 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:58.390770 26576 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.315686  1012 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:09:58.414299  1166 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:58.417079 26757 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:09:58.419776  1126 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.361799   894 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:58.388376  1068 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:58.406268 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.359634   999 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.396730  1169 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:58.404299   596 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:58.188134  1173 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.408022  1181 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:09:58.429494  1068 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.433462 26576 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:58.399039  1160 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.422299  1183 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:58.397609   907 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.442209 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:58.455549 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.455744 26685 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:58.455829   899 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:58.456642 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.462738 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:58.328326  1161 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.464888 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.468851  1143 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.346969  1125 consensus_queue.cc:260] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.207288  1130 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.476409  1012 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.438977  1120 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:09:58.483631 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.485255   980 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.436026  1144 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:58.491463 26753 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:09:58.435213 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:58.420670  1126 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.399856   804 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:58.496650 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65435us
I20260709 13:09:58.399206   682 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.507023 26681 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:09:58.507952 26687 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.508769 26611 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:58.510030 27316 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:58.510118 26679 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:09:58.510912 26682 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
W20260709 13:09:58.513038 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 219483us
W20260709 13:09:58.513628 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 80253.5us
W20260709 13:09:58.515228 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 227932us
I20260709 13:09:58.499076  1068 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:58.547248 27284 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:58.524770 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 89667us
I20260709 13:09:58.538211 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.540345 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.507638   899 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:58.553400 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.552011 27286 leader_election.cc:400] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19.
I20260709 13:09:58.552872 27284 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:58.521111  1124 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:58.557540 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.559723 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:58.524119  1144 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.560322 26607 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:09:58.562211 26608 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.530736  1129 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:58.566177 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.535048  1143 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:58.569046 26757 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.565567 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.574862 26754 raft_consensus.cc:3060] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.574802 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.566869 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.565245 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:58.533987  1012 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.581707  1124 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:58.581941 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.582623 26756 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:09:58.582963  1012 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.582685  1124 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.583817  1114 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.584343  1114 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.585765  1121 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:58.586349  1121 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.588301  1121 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.588887 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:58.589295 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.589509 27314 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:58.590480  1069 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:09:58.590961 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:58.591331  1069 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:58.561390  1104 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:58.594986 26754 raft_consensus.cc:2468] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:09:58.564872  1144 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:58.565428  1125 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:58.565975  1107 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:58.556450  1084 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:09:58.605554 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.607338 26685 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:09:58.608232 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.623287 26686 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:09:58.583557  1012 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:58.595911  1166 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.586341  1114 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.595721  1174 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:58.630729  1166 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.633296  1166 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:58.576478  1129 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.602887   899 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.636325   899 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.626593 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.638005 26685 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:58.638499  1160 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.591684  1069 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:58.629647 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.640363  1143 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:58.641005  1188 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:58.641098 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.641709  1188 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:58.642671  1188 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.599639   760 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:58.579655  1183 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.668440 26687 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:58.670804 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:58.673017 26686 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:58.674283 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117538us
W20260709 13:09:58.680388  1194 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:58.684834 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.666603  1036 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:58.716131  1036 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.673092  1151 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:58.573499  1181 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.623708  1123 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:09:58.732553  1181 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.733099  1173 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:58.669195  1012 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:58.734648   804 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.734440  1012 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.666152  1107 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.729707 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:09:58.738582 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62011.4us
I20260709 13:09:58.761224 26753 raft_consensus.cc:1240] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:58.764410 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.772060   804 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.788332   804 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.789995  1084 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.790812  1121 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:58.789929 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.795471 26682 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:58.799269 26607 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:58.800673 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.803571   907 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:58.805883 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.805951 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.805879   853 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:58.810592   853 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:58.812384 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.843645  1069 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.811633   853 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:58.847570 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.744714  1166 consensus_queue.cc:1175] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "687d192f79a044ce838f0bf292f0c09f" responder_term: 20 status { last_received { term: 18 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 19. Current term is 20. Ops: [19.11-19.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:58.853794  1069 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:58.870029  1129 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:58.887573 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.847729   853 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.909858 26757 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:09:58.913414 26756 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:58.924626 26612 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:58.924947 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.925755 26603 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:09:58.925994 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.927436 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.928529  1147 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:58.929131  1147 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:58.929783 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:58.939128 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:58.948709 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.950932 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:58.951570 26761 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:58.790609  1084 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:58.951586 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.954566 26683 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:09:58.958437 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:09:58.958999 26682 raft_consensus.cc:3060] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:58.959517 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:09:58.960472 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.954864 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:09:58.949483   999 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.933719  1104 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:09:58.968585 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:58.951892   682 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:58.982354 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:58.984328 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:58.971714   495 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:58.992857 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.002717 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:58.979534   804 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:09:58.986907   735 consensus_meta.cc:287] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.013s
I20260709 13:09:58.980077  1205 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:59.043058 26761 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:09:59.044821 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.059458 26682 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:09:59.043174   495 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:59.075811 26756 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:59.081314 26604 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:09:59.080993 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.083052 26576 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:59.098420 26606 raft_consensus.cc:2393] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 22: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:09:59.098201 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.103258 27314 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:59.106124 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:59.099375 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 128675us
I20260709 13:09:59.145953 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.081568  1125 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:59.097630   760 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.146800 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:09:59.144860 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:59.156584 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.100318  1036 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:59.159011 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 156405us
I20260709 13:09:59.159880 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.161129 26687 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:59.134079  1078 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:59.162629 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:59.172686 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:59.099619  1182 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:09:59.169783 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.152199   857 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:09:59.156348 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 183116us
W20260709 13:09:59.170554  1068 consensus_meta.cc:287] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.606s	user 0.004s	sys 0.012s
I20260709 13:09:59.215567 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.149633  1166 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:59.221690  1166 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.224496  1166 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:09:59.231117  1210 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:59.232131  1084 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.145922   495 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:59.232944  1207 log.cc:927] Time spent T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:09:59.160305  1125 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.235811  1161 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.236413  1161 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:59.236768  1161 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:59.237120  1161 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:59.237535  1125 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:59.240721   899 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.016s
W20260709 13:09:59.242745  1144 consensus_meta.cc:287] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.015s
I20260709 13:09:59.163631   760 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:59.202325  1200 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:09:59.206660  1036 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:59.247179   760 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.247771   857 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:59.248145 26608 consensus_meta.cc:287] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.007s
I20260709 13:09:59.248503 26608 raft_consensus.cc:2468] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:09:59.184257  1104 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.248747   857 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.206796  1078 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
W20260709 13:09:59.251443  1169 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.013s
I20260709 13:09:59.252511  1078 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.081313  1205 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.253304  1169 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.212891   990 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:59.212759  1185 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:59.235416  1068 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.252887 26651 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.203467  1208 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:59.164513  1156 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:09:59.213600 26679 consensus_meta.cc:287] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.658s	user 0.019s	sys 0.003s
I20260709 13:09:59.272811 26679 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:09:59.266525 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.260437  1169 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.274046 27313 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:09:59.269212 26606 raft_consensus.cc:1275] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:59.275702 26651 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.284221 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.285069 27319 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 24.
I20260709 13:09:59.286586 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:09:59.283190 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:59.263036  1185 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.295809 26752 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 22: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:59.243285  1144 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:09:59.296414 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.303701  1068 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.290961  1156 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.306829  1156 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.290828  1190 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:59.285892  1188 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:59.316958 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.316440 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:59.268528   990 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.293752  1069 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:59.300599  1129 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:59.301543  1185 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:59.354800 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.360957 27286 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:09:59.367151 26679 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:09:59.368433 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.356242 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.359122 26683 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
W20260709 13:09:59.374606 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.389659 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.393443 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.329974  1190 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:09:59.399164  1181 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:59.357425  1169 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.357710  1205 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.357517  1069 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.409408 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.410466 26609 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:09:59.410315 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.411041 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.411592 26686 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:59.412034  1147 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.412285 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.412631 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:59.414687 26680 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:59.450551 26608 raft_consensus.cc:2393] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 20: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:59.421830 26679 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:09:59.433972 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.363780  1129 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.357740   853 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:59.465178 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.385130  1208 raft_consensus.cc:2804] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:59.365245  1112 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:09:59.448583   596 consensus_meta.cc:287] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.987s	user 0.014s	sys 0.007s
I20260709 13:09:59.423949  1181 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:09:59.479004 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 271885us
I20260709 13:09:59.447229  1069 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:59.480860 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.481551 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.489117 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:59.457801  1212 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:09:59.474213  1129 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:59.502012 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 288422us
W20260709 13:09:59.476169  1213 log.cc:927] Time spent T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:09:59.497260 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.510449 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:09:59.501214 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 338633us
W20260709 13:09:59.512236 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.513535 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:09:59.473969   853 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.515090 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:59.517364 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.518009 26754 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
W20260709 13:09:59.526443 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 45689.4us
I20260709 13:09:59.536320 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.536506 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.537106 27316 raft_consensus.cc:2393] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:59.491366  1208 raft_consensus.cc:697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:09:59.540398 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 128807us
I20260709 13:09:59.541363 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:59.520254   853 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:59.528957  1166 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.485072   596 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.500012  1084 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:09:59.560015 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:59.561641 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.561846  1223 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.562428  1223 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.562994 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.530020  1114 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:09:59.556663   990 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.555684  1181 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.536128  1222 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:59.618009 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:59.618439  1223 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.618832 26608 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 22: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:59.619021  1208 consensus_queue.cc:237] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:09:59.620393  1219 log.cc:927] Time spent T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:09:59.559201  1185 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.622678 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:59.624272  1185 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:59.564879 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:59.618355 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.626056 26761 raft_consensus.cc:2368] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 22. Current term is 23.
W20260709 13:09:59.622700 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53262us
W20260709 13:09:59.628455 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63657.9us
I20260709 13:09:59.628530 26757 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:59.629220 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.569550 27286 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:09:59.630806 26611 raft_consensus.cc:1240] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:59.631289 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 103981us
W20260709 13:09:59.631404 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61939.1us
I20260709 13:09:59.564911  1085 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.634685  1216 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.636240 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.634461 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.642724 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.647516 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:09:59.648192 26612 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:59.648433 26726 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:09:59.630963  1190 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:59.629700  1147 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:59.635552   682 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.570129  1125 consensus_queue.cc:1059] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:09:59.637717  1222 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:59.659271 26754 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:09:59.679948 26754 pending_rounds.cc:85] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 10
I20260709 13:09:59.666460 26612 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:09:59.629375  1068 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:09:59.667248 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2559) took 1126 ms. Trace:
I20260709 13:09:59.691136 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.692332 27319 raft_consensus.cc:2410] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:59.647217  1144 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.659946 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.693945 27316 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 24: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:09:59.693104  1237 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:59.696981  1237 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.696897  1222 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.653100  1084 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:09:59.680384 26754 pending_rounds.cc:107] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:09:59.658397  1166 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.702090 26754 raft_consensus.cc:2889] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:59.702185 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49575.5us
I20260709 13:09:59.639954  1085 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.656898  1147 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:09:59.653545  1234 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:59.635798  1114 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.681288 26753 rpcz_store.cc:276] 0709 13:09:58.541012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.802403 (+261391us) service_pool.cc:224] Handling call
0709 13:09:58.802725 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.900078 (+ 97353us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:59.256640 (+356562us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.666796 (+410156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.666869 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:59.666938 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.667024 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.667177 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34535,"prepare.queue_time_us":162649,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":88694,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":708571,"threads_started":3,"wal-append.queue_time_us":399123}
I20260709 13:09:59.732630  1205 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.733244  1205 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.712931  1144 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:59.735430  1205 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.716420  1084 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.738422  1084 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:59.770810  1230 log.cc:927] Time spent T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:59.771812   596 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.777294 26687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 865) took 1062 ms. Trace:
I20260709 13:09:59.777732 26687 rpcz_store.cc:276] 0709 13:09:58.715032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.723437 (+  8405us) service_pool.cc:224] Handling call
0709 13:09:58.830957 (+107520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.163624 (+332667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.777031 (+613407us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540025d354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:59.777209 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758926592}
I20260709 13:09:59.781270  1085 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.785928  1233 consensus_queue.cc:1048] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:09:59.787986  1226 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:09:59.789986  1181 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:59.791353  1126 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.793393  1237 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.794857  1114 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:59.796913  1225 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:09:59.797983  1147 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.799268  1147 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:59.803844  1036 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:59.804559  1036 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.807227  1036 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:59.810300 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:59.779429  1161 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.820078 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:09:59.819257   990 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.836133 26759 raft_consensus.cc:1240] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:59.850682 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:09:59.851575 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 217188us
I20260709 13:09:59.833666  1238 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:09:59.852098 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.836138   857 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:09:59.853794 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:09:59.851778 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 219043us
I20260709 13:09:59.856153 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.834478   990 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.860077 26606 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:09:59.865885 26754 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:59.867384 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:09:59.867769  1245 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:59.868103 26606 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:09:59.870071  1191 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:59.871878  1252 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.873778  1224 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:59.874367  1224 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.861488  1239 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:59.876442   804 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:59.879024 26753 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:09:59.837647  1069 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.880164 26752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47588 (request call id 834) took 1475 ms. Trace:
I20260709 13:09:59.879019   804 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:09:59.879936 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:59.883739 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:09:59.882992 26752 rpcz_store.cc:276] 0709 13:09:58.402193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.402340 (+   147us) service_pool.cc:224] Handling call
0709 13:09:59.877846 (+1475506us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54002e95d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:59.877978 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998344960}
I20260709 13:09:59.884925  1228 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.886364 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:09:59.886978  1036 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:59.892938 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.889035 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.893558 26756 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:09:59.895203 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.896761 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.899132 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.900070 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.858678   857 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.903792  1252 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:59.905447 26651 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.905879 26754 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 24: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:09:59.923377   760 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:59.924223  1036 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.924899  1036 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.925648  1107 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.892269  1228 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.893688  1208 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.928660  1208 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:09:59.928409  1228 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:59.929101  1208 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.934180   853 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.935509 26605 raft_consensus.cc:2368] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 24. Current term is 25.
I20260709 13:09:59.936360   853 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.937008  1233 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:59.927408  1036 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.928380   804 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.941078 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:59.941454   804 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:59.941653 27316 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:59.942822  1252 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:59.921512   682 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:59.948536  1069 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.948721 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35576 (request call id 883) took 1186 ms. Trace:
W20260709 13:09:59.921748  1221 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.347s	user 0.001s	sys 0.003s
I20260709 13:09:59.949160 26604 rpcz_store.cc:276] 0709 13:09:58.762283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.764099 (+  1816us) service_pool.cc:224] Handling call
0709 13:09:59.948542 (+1184443us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540017aa54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:09:59.948645 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726647552}
I20260709 13:09:59.952575  1224 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:09:59.953094 27316 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 25.
I20260709 13:09:59.955883  1129 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:09:59.957010 26685 raft_consensus.cc:1240] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:59.958019  1129 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:09:59.959458 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:09:59.960124 26754 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:09:59.960438   990 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:09:59.964534  1245 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:59.992712 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 71334.9us
I20260709 13:09:59.996971 27319 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:10:00.000277 27319 pending_rounds.cc:85] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Aborting all ops after (but not including) 15
I20260709 13:10:00.000506 27319 pending_rounds.cc:107] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:10:00.000734 27319 raft_consensus.cc:2889] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.998842 27314 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:59.993026  1177 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:00.006913  1169 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:00.009696  1169 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:00.011032 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104601us
I20260709 13:10:00.011781 26577 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:09:59.970469 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:09:59.972528 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:09:59.981489  1129 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:00.013163 26755 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:00.013494 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.013556  1129 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:00.016697  1211 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.539s	user 0.003s	sys 0.000s
I20260709 13:10:00.018359  1248 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:00.018764 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.019521  1248 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.019412 26682 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 24.
I20260709 13:10:00.021514 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.022050 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:00.022815   735 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:00.023281   735 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:00.022063 26685 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.024197  1129 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:09:59.982776  1218 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.507s	user 0.000s	sys 0.002s
I20260709 13:10:00.024125   735 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:09:59.983633 26611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 885) took 1194 ms. Trace:
I20260709 13:10:00.025980 26611 rpcz_store.cc:276] 0709 13:09:58.789258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.796568 (+  7310us) service_pool.cc:224] Handling call
0709 13:09:58.796901 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.635353 (+838452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.983355 (+348002us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540010ead4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:59.983566 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911561088}
I20260709 13:10:00.027259 26760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35546 (request call id 2562) took 1467 ms. Trace:
I20260709 13:10:00.027621 26760 rpcz_store.cc:276] 0709 13:09:58.559816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.809519 (+249703us) service_pool.cc:224] Handling call
0709 13:09:58.809876 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:58.914270 (+104394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.914301 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:58.950464 (+ 36163us) log.cc:844] Serialized 52 byte log entry
0709 13:09:59.153234 (+202770us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:59.167909 (+ 14675us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.206611 (+ 38702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.206684 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.982044 (+775360us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:10:00.026972 (+ 44928us) raft_consensus.cc:1685] finished
0709 13:10:00.027071 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.027188 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65567,"prepare.queue_time_us":14471,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":47431,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":23516,"spinlock_wait_cycles":305682176,"thread_start_us":175111,"threads_started":1,"wal-append.queue_time_us":402680}
I20260709 13:10:00.030334 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.024138   857 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.031594 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.032096 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.032660 26607 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:09:59.965965  1161 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.011883   760 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:00.033140  1177 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.033519 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:00.033682   760 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:00.034077 27316 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.034576   760 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.036126   760 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.038417 26685 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:10:00.039111 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.040042 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.040578 26607 raft_consensus.cc:1813] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Handling vote request from an unknown peer e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.040380  1177 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:59.972697 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.041200 26607 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:00.042173 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.043861  1177 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.045190 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:00.047026 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.048287 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.048498  1215 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:00.049902  1215 consensus_queue.cc:1059] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:00.052165  1104 raft_consensus.cc:3055] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:00.052548  1104 raft_consensus.cc:740] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:00.053378  1104 consensus_queue.cc:260] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:00.054165 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 150549us
I20260709 13:10:00.054577  1104 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.054925 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.055944  1240 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.056396  1177 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.059019 26681 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:10:00.059391 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.062013 26681 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:10:00.063917  1254 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:10:00.064016 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.064739 26605 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:10:00.064929 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.065658 26679 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:00.066545 26724 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.070825 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.076278 26605 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:00.077653   857 raft_consensus.cc:2804] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:00.078311   857 raft_consensus.cc:697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:10:00.079030 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 72587.1us
I20260709 13:10:00.079231   857 consensus_queue.cc:237] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.084079 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.084748 26760 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
I20260709 13:10:00.051548  1208 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.090483 27318 raft_consensus.cc:1813] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Handling vote request from an unknown peer e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.087534  1112 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:00.091013 27318 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:00.091058  1112 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.093307  1112 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.094269 26682 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:10:00.076385 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:00.133417 26682 pending_rounds.cc:85] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 10
I20260709 13:10:00.133754 26682 pending_rounds.cc:107] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:10:00.133981 26682 raft_consensus.cc:2889] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:00.134069 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 57765.7us
I20260709 13:10:00.134863  1112 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:00.104396 26606 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:10:00.135432 26606 pending_rounds.cc:85] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 12
I20260709 13:10:00.135653 26606 pending_rounds.cc:107] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:10:00.136044 26606 raft_consensus.cc:2889] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.104897 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:00.105348 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.077847 26724 leader_election.cc:400] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 24. Current term is 25.
I20260709 13:10:00.137913 26724 leader_election.cc:403] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.138500   857 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:10:00.142071  1215 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:00.143200 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 65490.5us
I20260709 13:10:00.146489   857 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 24. Current term is 25.
I20260709 13:10:00.115192 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:00.117027   804 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.148943   804 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.150549 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.150977   804 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.151351 26679 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:00.152309 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.152675   804 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:00.153308   804 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.155326   804 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.117579 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.118964  1190 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:00.156049  1190 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.157449 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:00.097996 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.129120  1208 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:00.158484  1222 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:10:00.106052 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49388.3us
I20260709 13:10:00.158831 26577 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:00.158921  1222 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:00.159746  1222 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:00.159884  1240 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:00.160485  1240 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:00.161314  1240 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.162202 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.162910 26687 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:00.164474 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.164954  1215 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:00.165405  1215 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:00.166136 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.167249 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.147150   760 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.146566 26724 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.147166  1112 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:00.157318  1147 consensus_queue.cc:1059] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:00.116932 27316 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:10:00.183946  1190 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.188019  1239 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:00.177407 26680 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:00.176916  1069 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.187609  1121 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.189564 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:00.176687 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.190547 26682 raft_consensus.cc:3060] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.168761 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.191306  1239 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:00.205446  1239 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:00.191542  1112 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.206336  1239 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.207470  1112 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.167543  1222 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.208628 26611 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
I20260709 13:10:00.178746 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.196195 26683 raft_consensus.cc:1240] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:00.210088  1069 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:00.210460  1069 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:00.210875  1069 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:00.211344  1222 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.214360 26682 raft_consensus.cc:2468] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
W20260709 13:10:00.196385 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49896.8us
I20260709 13:10:00.196592  1130 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:00.185267 26503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 119) took 11292 ms (client timeout 15000 ms). Trace:
I20260709 13:10:00.198580  1248 raft_consensus.cc:3055] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:00.199420 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.231695  1130 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:00.199821 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.200114 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.232254  1130 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.231909  1248 raft_consensus.cc:740] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:00.233107 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.233914  1236 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:00.235510 26761 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:00.235818  1236 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.236227  1236 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.233832  1248 consensus_queue.cc:260] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.237063  1245 consensus_queue.cc:1059] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:00.237411  1248 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:00.237920  1245 raft_consensus.cc:3055] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:00.238281  1245 raft_consensus.cc:740] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:00.239110  1245 consensus_queue.cc:260] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.240988  1245 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:00.231727 26503 rpcz_store.cc:269] 0709 13:09:48.906894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.764241 (+3857347us) service_pool.cc:224] Handling call
0709 13:10:00.185186 (+7420945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:57.691788 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:57.854899 (+163111us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:57.854960 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:09:57.854979 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:57.933336 (+ 78357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:57.933427 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:57.933461 (+    34us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:09:57.934983 (+  1522us) tablet.cc:701] Row locks acquired
0709 13:09:57.935040 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:09:57.935234 (+   194us) write_op.cc:270] Start()
0709 13:09:57.953053 (+ 17819us) write_op.cc:276] Timestamp: P: 1783602597935163 usec, L: 0
0709 13:09:57.954849 (+  1796us) op_driver.cc:348] REPLICATION: starting
0709 13:09:57.980428 (+ 25579us) log.cc:844] Serialized 7616 byte log entry
0709 13:09:58.621655 (+641227us) op_driver.cc:464] REPLICATION: finished
0709 13:09:58.904921 (+283266us) write_op.cc:301] APPLY: starting
0709 13:09:58.905041 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:59.403400 (+498359us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:59.403538 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:59.880872 (+477334us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:59.881187 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:09:59.881230 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:59.881600 (+   370us) log.cc:844] Serialized 172 byte log entry
0709 13:10:00.046795 (+165195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.046961 (+   166us) write_op.cc:454] Released schema lock
0709 13:10:00.047015 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:00.054822 (+  7807us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.054856 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117780,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":278529,"apply.run_cpu_time_us":93353,"apply.run_wall_time_us":1146982,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83509,"num_ops":19,"prepare.queue_time_us":114193,"prepare.run_cpu_time_us":28581,"prepare.run_wall_time_us":455125,"raft.queue_time_us":291528,"raft.run_cpu_time_us":14544,"raft.run_wall_time_us":360810,"replication_time_us":617534,"thread_start_us":894332,"threads_started":5,"wal-append.queue_time_us":306096,"wal-append.run_cpu_time_us":18378,"wal-append.run_wall_time_us":1373641}]]}
I20260709 13:10:00.199898  1215 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.200266 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.248980 26687 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:10:00.200994 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.201184  1190 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.201471 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:00.192085   760 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.195796   857 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:00.217809 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.221522 26651 leader_election.cc:400] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 22. Current term is 23.
I20260709 13:10:00.222134 26752 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:10:00.252229 26651 leader_election.cc:403] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.167869  1114 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:00.253820 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:00.231146 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:00.257589 26757 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.249437 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.255019  1114 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.260664  1114 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.261059  1208 raft_consensus.cc:2764] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:00.261821  1208 consensus_queue.cc:1059] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:00.262832  1208 raft_consensus.cc:3055] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:00.262622  1069 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.263203  1208 raft_consensus.cc:740] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:00.255932   857 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.264788  1069 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.265889   857 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:00.266104 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:00.255752  1190 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.267374 26685 raft_consensus.cc:1813] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Handling vote request from an unknown peer e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.267890 26685 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 14: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:00.256093 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.268545  1190 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.269166  1190 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:00.229624 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:00.255770  1239 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.259485 26760 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:00.283651 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.274307 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.284219 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.274983 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:00.278688 26757 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:10:00.280576 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.287711 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:00.288177 26761 raft_consensus.cc:2393] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 24: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:00.291127 26604 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:00.291956  1208 consensus_queue.cc:260] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.293274  1208 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.292414 26685 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:00.294699 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.269620  1190 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.299495 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:00.300513 26607 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:10:00.304044 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.305804 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:00.312947  1130 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.315207  1130 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:00.316293 26604 raft_consensus.cc:1275] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:00.317296 26756 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:00.318267 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.324859  1215 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.326599  1169 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.257103  1112 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 22. Current term is 23.
I20260709 13:10:00.328197 26651 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.333814 26726 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.344235 26755 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 25.
I20260709 13:10:00.332547 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:00.337620 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:00.352427 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 53228.4us
I20260709 13:10:00.355798 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.298028   857 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.298357  1190 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:00.359252 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:10:00.359887 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56573us
I20260709 13:10:00.348927  1169 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.348208  1245 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.355696  1185 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.375000 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:00.353919  1228 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:00.350472  1182 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:00.381922 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:10:00.380149 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 94577.5us
I20260709 13:10:00.364317  1177 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:10:00.378845 27316 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:00.354998   899 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:10:00.369102  1217 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.397327 26650 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.402689 26755 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:00.403966 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.404719 26682 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:00.366222  1191 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:10:00.405830 26679 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:00.406564 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.370093  1121 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:00.409149 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.410630 26612 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:00.410738 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.409423 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.417837 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.385434  1144 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:00.392052  1120 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:00.434340   853 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:00.417829 26604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:00.435698 26604 raft_consensus.cc:606] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.436146 26604 raft_consensus.cc:614] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:00.410022  1079 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:00.445989 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.448370  1223 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.400800  1112 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:10:00.456224 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63436.9us
I20260709 13:10:00.420113 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:00.407178  1169 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:00.410094  1192 consensus_queue.cc:1048] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:10:00.418470 26603 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:10:00.429989 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.405833  1217 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:00.474860  1217 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:00.430758   999 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.483075   760 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:00.501305  1185 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.502362  1114 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.504866  1232 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:10:00.508514 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 86734.4us
I20260709 13:10:00.524806 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:10:00.509114 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44020.4us
W20260709 13:10:00.514523 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47770.2us
I20260709 13:10:00.525535 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:00.515687 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 59222.4us
W20260709 13:10:00.519032 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44958.3us
I20260709 13:10:00.525826 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:00.519474 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 97774.1us
I20260709 13:10:00.528710 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.520669  1190 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.530220 26685 raft_consensus.cc:2368] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 24. Current term is 25.
I20260709 13:10:00.535269  1190 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.535461 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:00.536062 26754 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:00.542790 26754 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 25.
I20260709 13:10:00.547848  1079 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:00.544262 26651 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.558509 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:00.563416 26607 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
W20260709 13:10:00.565182 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 95873.2us
W20260709 13:10:00.575393 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 49639.8us
W20260709 13:10:00.576071 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 47773.4us
I20260709 13:10:00.523993  1232 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:00.586572  1232 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.587931  1232 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.578461 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:00.549968   999 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:00.562836   804 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:00.601976 26606 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:10:00.608232 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45572.6us
I20260709 13:10:00.578085  1252 raft_consensus.cc:2804] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:00.621102 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:00.629433 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 100798us
I20260709 13:10:00.597584  1068 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.558844  1236 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.598338   999 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.572438  1188 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:10:00.636895 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:00.649022 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.652187  1208 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:00.632788   735 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:10:00.647308  1280 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:00.670305 26758 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 23: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:00.647831   999 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.677889   495 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:00.669127 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 59410.3us
I20260709 13:10:00.674132 26606 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:00.638327  1252 raft_consensus.cc:697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:00.685384  1252 consensus_queue.cc:237] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.692457 26577 leader_election.cc:400] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 24. Current term is 25.
I20260709 13:10:00.692844 26577 leader_election.cc:403] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.708130 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:10:00.777905 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 75726us
I20260709 13:10:00.779395 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:10:00.799870 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 87202.3us
W20260709 13:10:00.801676 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 93628.8us
I20260709 13:10:00.802520 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:00.808470 27316 raft_consensus.cc:1240] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:00.810360 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:00.816982  1228 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:00.820261  1228 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:00.791858   495 raft_consensus.cc:3060] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:00.831765  1114 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:00.806106   804 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:00.812920  1188 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.850317  1188 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.861346  1188 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.870434 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:00.875609 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:00.811477  1185 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:00.876344 26604 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:00.919937 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:00.871366  1084 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:00.931497 26758 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:10:00.873097   804 consensus_queue.cc:1059] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:10:00.935986  1238 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:01.063059 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:01.073019  1269 log.cc:927] Time spent T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:10:00.929546  1084 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.065914  1238 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.065864  1190 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.158237  1238 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:01.203495 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 127578us
I20260709 13:10:01.162345  1190 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:01.210605  1232 consensus_meta.cc:287] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.004s
W20260709 13:10:01.218104  1291 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:10:01.221750  1228 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:01.223373  1183 raft_consensus.cc:3055] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:01.223836  1183 raft_consensus.cc:740] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:10:01.224344  1293 log.cc:927] Time spent T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:01.224627  1183 consensus_queue.cc:260] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:01.227252  1298 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:01.225850  1183 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.227514  1084 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:01.267457 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 113868us
I20260709 13:10:01.270694 26685 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:10:01.288226  1199 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:01.314034 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:01.315151 26755 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:10:01.315546 26755 pending_rounds.cc:85] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 11
I20260709 13:10:01.315804 26755 pending_rounds.cc:107] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:10:01.316047 26755 raft_consensus.cc:2889] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.309958 26577 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:01.285188  1121 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:10:01.336336  1190 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:01.327366  1199 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.350324  1199 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:01.356354  1309 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:01.359193  1308 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:10:01.369448 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.380991  1224 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:01.644202 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 171883us
W20260709 13:10:01.435002  1188 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
W20260709 13:10:01.676738 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 366836us
I20260709 13:10:01.684463 26603 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:01.725636 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48015.3us
I20260709 13:10:01.578533  1252 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:01.610880  1217 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.643905  1304 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.647941  1190 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.643741  1185 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:01.647445  1223 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:01.727607  1121 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:01.732069  1232 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.740697  1288 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:01.728772  1188 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.611927  1224 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.743861  1304 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:01.772779  1238 consensus_meta.cc:287] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:10:01.741817  1217 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.745289  1190 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.748425  1185 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.750415  1223 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.739169  1252 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.791240  1228 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.792970  1238 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.800933  1224 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:01.805428 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 76822.7us
I20260709 13:10:01.816931 26761 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:10:01.817471  1181 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.790589   495 consensus_meta.cc:287] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.949s	user 0.006s	sys 0.006s
I20260709 13:10:01.764961  1232 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:01.806030  1183 consensus_meta.cc:287] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
W20260709 13:10:01.837199 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 108297us
I20260709 13:10:01.847707 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:01.777575  1121 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:01.846683 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 146611us
I20260709 13:10:01.772512  1288 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.862594 26685 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:10:01.846434   495 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 24. Current term is 25.
I20260709 13:10:01.835850  1310 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:01.874704 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:01.858639  1224 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:01.868885  1208 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.836287  1228 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.850189  1181 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:01.935815  1316 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.936563  1316 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:01.962255 26611 raft_consensus.cc:2468] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 25.
I20260709 13:10:01.971805  1156 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:01.973790  1324 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.074317  1316 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.122324  1324 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.122336  1156 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:01.975083  1313 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:10:01.980674  1304 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:01.981236  1217 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:01.983886  1232 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:01.988557   857 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:01.989699  1185 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:01.996652  1107 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:01.920298  1224 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.147657  1156 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:01.895542  1310 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.150269  1310 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:01.925011  1208 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.121323  1188 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.082186 26606 raft_consensus.cc:3060] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:02.086580  1290 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.943s	user 0.004s	sys 0.006s
I20260709 13:10:02.093169  1181 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.096746  1245 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.099705  1130 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:02.102556  1297 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.943s	user 0.005s	sys 0.013s
W20260709 13:10:02.026259   999 consensus_meta.cc:287] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 1.335s	user 0.012s	sys 0.002s
I20260709 13:10:02.168982 26608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 902) took 1642 ms. Trace:
I20260709 13:10:02.145625  1232 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.197405 26756 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:02.170653  1181 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.198276   804 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.192031   999 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.152377  1190 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.160436  1185 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.205994 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.192271 26608 rpcz_store.cc:276] 0709 13:10:00.526977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.527416 (+   439us) service_pool.cc:224] Handling call
0709 13:10:00.527851 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.569352 (+ 41501us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:00.629827 (+ 60475us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.922691 (+292864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.934521 (+ 11830us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.934702 (+   181us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:00.934750 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.934840 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.085943 (+1151103us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:10:02.163810 (+ 77867us) raft_consensus.cc:1685] finished
0709 13:10:02.168754 (+  4944us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.168919 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113908,"prepare.queue_time_us":95636,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":84189,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":21740,"spinlock_wait_cycles":10337664,"thread_start_us":271624,"threads_started":2,"wal-append.queue_time_us":295750}
I20260709 13:10:02.166606  1238 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.200074  1322 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:10:02.229863 26761 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:02.232568 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.171152  1223 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.193356  1252 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.151492   857 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.243212  1190 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.237813  1324 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.264575  1251 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:02.226809   804 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.285881 26607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49440 (request call id 2578) took 1479 ms. Trace:
I20260709 13:10:02.233050  1120 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.286326 26607 rpcz_store.cc:276] 0709 13:10:00.806873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.807096 (+   223us) service_pool.cc:224] Handling call
0709 13:10:00.807428 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.851352 (+ 43924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.851397 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.852314 (+   917us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.933326 (+ 81012us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:01.081446 (+148120us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.158488 (+ 77042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.158610 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.101773 (+943163us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f00c9c85 00007f40f00ca6a2 00007f40f2e3c1db 00007f40f2e37aaf 00007f40f2e2b86e 00007f40f2e2abb6 00007f40f2e2a7d8 00007f40f2e34221 00007f40f2e341d9 00007f40f2e34169
0709 13:10:02.282227 (+180454us) raft_consensus.cc:1685] finished
0709 13:10:02.285647 (+  3420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.285804 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101751,"prepare.queue_time_us":209585,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":192284,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":20115,"spinlock_wait_cycles":3459456,"thread_start_us":157300,"threads_started":2,"wal-append.queue_time_us":212577}
I20260709 13:10:02.248615 26576 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:02.249171 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.273389   999 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.289006  1144 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:02.289064   999 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.289518  1144 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.289939  1144 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:02.289716   999 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.208081  1181 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.277067 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.283600 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:02.293133 26611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2582) took 1483 ms (client timeout 1710 ms). Trace:
I20260709 13:10:02.293200  1181 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:02.293617 26611 rpcz_store.cc:269] 0709 13:10:00.809676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.810092 (+   416us) service_pool.cc:224] Handling call
0709 13:10:02.292976 (+1482884us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400163354. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:10:02.293082 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493821056}
I20260709 13:10:02.287338  1120 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.287945   804 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.252089 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.160236  1107 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:02.292946 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44425.1us
I20260709 13:10:02.296048  1120 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.209692  1121 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.213693  1156 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.227562  1331 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.300346 26761 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:10:02.229290  1326 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.192484  1130 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.192620  1245 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.345208 27316 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:10:02.346267 26605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
W20260709 13:10:02.350804 26755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.015s	sys 0.014s
I20260709 13:10:02.357810 26605 raft_consensus.cc:606] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:02.352277 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:02.358407 26605 raft_consensus.cc:614] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:02.349973 26652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.282339  1238 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.211303  1232 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.352001 26604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49434 (request call id 3826) took 1045 ms. Trace:
I20260709 13:10:02.353464 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.335122  1114 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.377472  1114 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.378542  1130 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.333474   804 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.379601   804 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.380391  1224 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.381603   804 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.382103   804 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.357496   999 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.350711   735 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.382565   804 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.362136  1304 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.384196  1304 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.384660  1208 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.333730  1252 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.385535  1252 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.386686  1304 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.389070  1232 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.378921  1107 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.390434  1238 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.392611  1238 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.371116 26760 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
W20260709 13:10:02.357973 26755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.015s	sys 0.015s
I20260709 13:10:02.372946 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:02.344059  1222 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.370869 26604 rpcz_store.cc:276] 0709 13:10:01.306932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.307070 (+   138us) service_pool.cc:224] Handling call
0709 13:10:01.307428 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.307959 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:01.308259 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.725263 (+417004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.732946 (+  7683us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.733108 (+   162us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:01.733155 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.733249 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.351807 (+618558us) raft_consensus.cc:1685] finished
0709 13:10:02.351829 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.351949 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70089,"prepare.queue_time_us":740,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":99182,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11968,"spinlock_wait_cycles":53050752,"thread_start_us":346494,"threads_started":1,"wal-append.queue_time_us":465868}
I20260709 13:10:02.374209  1330 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.237991  1185 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.348905  1303 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.357631  1156 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.357472  1326 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.348546   899 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:02.429814 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 92392.8us
I20260709 13:10:02.376770  1245 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.351222  1121 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.404116 26755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2595) took 1084 ms. Trace:
W20260709 13:10:02.415452  1297 log.cc:927] Time spent T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:02.344478  1188 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.374940   857 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.299002  1190 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.413028 26606 raft_consensus.cc:2468] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:02.350416  1228 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.379544  1114 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:02.460093 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 250741us
I20260709 13:10:02.434819 26755 rpcz_store.cc:276] 0709 13:10:01.320038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.320169 (+   131us) service_pool.cc:224] Handling call
0709 13:10:01.320443 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.321191 (+   748us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:01.724735 (+403544us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.403754 (+679019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.403807 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:02.403859 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.403928 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.404059 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14766,"prepare.queue_time_us":43203,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":11935,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2805,"thread_start_us":1037866,"threads_started":2}
I20260709 13:10:02.411564  1217 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.383242   735 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.393654 26756 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:02.353111  1331 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.467061 26576 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:02.414784  1222 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.460484  1327 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.471307  1316 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.490051 26687 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:02.459769  1328 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:10:02.513406 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.491384 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.492462 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.494247 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.494328  1238 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.450542   899 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.459182  1121 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.414991  1330 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.459497  1188 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.510013 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.468590  1334 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.469904  1245 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.507031  1316 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.512238 26684 raft_consensus.cc:1275] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:02.512431 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.425346  1303 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.476197   857 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:02.496891 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.532698 26682 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:10:02.555058 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.521337 26683 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:10:02.533401 26679 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:10:02.490859  1329 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.476688  1304 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:10:02.466439  1217 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.501636  1252 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.535087   804 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.542276  1324 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.521502 26678 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:02.558586 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.553179  1224 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.563370 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:02.566299 26686 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:02.563763 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.541697  1315 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:02.578441  1315 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.578855  1315 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:02.563851   857 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.584442   857 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.586006 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.586216  1326 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.586735 26605 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:02.587289  1112 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:02.568753 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.587805  1331 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.588321 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:02.589036 26686 raft_consensus.cc:2393] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:02.589756 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.590305 26686 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:02.590862  1217 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.563501 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.592060 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.592573  1188 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.593174  1315 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.594209  1330 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.493448  1327 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.595189  1236 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:02.596454  1327 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.597182 26609 raft_consensus.cc:2368] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21.
I20260709 13:10:02.598757  1185 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.599036 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.599915  1190 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.600231 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.542023  1238 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.603935  1238 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.564226 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:02.604715  1324 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.605564 26679 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 23: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:02.574764 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.608297 27319 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:02.609912  1224 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:02.576056 27284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.029s	sys 0.038s
W20260709 13:10:02.611963 27284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.029s	sys 0.038s
W20260709 13:10:02.612278 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 751344us
I20260709 13:10:02.612309  1322 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:02.576236 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.614821 26610 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:02.614581 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:02.576869  1337 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:02.587889  1112 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.550737 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.617584 26755 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:10:02.616061 26612 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:02.618384 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.551829  1342 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.617012 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:02.619419 26760 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:02.618938 26755 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:02.622864 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:02.623206 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 79402.3us
I20260709 13:10:02.624630 26678 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:02.623415 26755 raft_consensus.cc:2468] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 16.
I20260709 13:10:02.627298 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.628898 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.649572 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:02.655369 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 174774us
I20260709 13:10:02.656123 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:02.655946 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:02.662853 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 117527us
I20260709 13:10:02.556363  1208 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:10:02.661743 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:02.668795 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.561067  1245 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.663829  1345 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:02.666988 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:02.630867  1326 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:02.728171 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61254.9us
I20260709 13:10:02.729176 26724 leader_election.cc:400] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21.
I20260709 13:10:02.729527 26724 leader_election.cc:403] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.722276 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.688974 26755 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 23: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:10:02.724159 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49142.7us
I20260709 13:10:02.666013  1185 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:02.737062 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:02.663305   804 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:02.560781  1334 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.746745 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.748250 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.748421 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.736624 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.749588 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:02.743386 26724 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.232.193:41483 timed out after 1.753s (SENT) [suppressed 4 similar messages]
I20260709 13:10:02.753875 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.760386 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.764743 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.754490 26755 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:10:02.894840 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.896413 26686 raft_consensus.cc:2393] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:10:02.892377 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 139539us
I20260709 13:10:02.903136   804 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.906328   804 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:02.739168 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2597) took 1051 ms. Trace:
I20260709 13:10:02.614743  1329 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.913368 26757 rpcz_store.cc:276] 0709 13:10:01.687390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.687542 (+   152us) service_pool.cc:224] Handling call
0709 13:10:01.687838 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.688262 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:01.688291 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.688720 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.024994 (+336274us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b18003719e0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f0185e07 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1 00007f40f324ba0f
0709 13:10:02.360229 (+335235us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:02.360272 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.360344 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.675376 (+315032us) raft_consensus.cc:1685] finished
0709 13:10:02.675398 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.739103 (+ 63705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":248,"raft.queue_time_us":88,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8600,"spinlock_wait_cycles":80490752,"thread_start_us":335024,"threads_started":1,"wal-append.queue_time_us":782002}
I20260709 13:10:02.736131  1107 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:02.921474 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.744980  1344 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:10:02.666278  1144 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:02.912761 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:02.745467  1156 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.740103   990 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:02.924796 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.995476 26759 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:02.997898 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.000351 26685 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:02.893584  1238 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:03.000535 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:03.002305  1349 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:10:03.006372  1316 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.009662  1245 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.012280  1329 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.014273  1216 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.014919  1216 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:02.917814  1185 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:03.016847  1185 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.017485  1216 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:02.994309 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 380523us
I20260709 13:10:02.631695  1342 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.037869 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.736697  1326 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.070405 26603 raft_consensus.cc:2368] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:02.892372  1327 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.248s
I20260709 13:10:03.068470 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:02.921203  1107 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.082342  1107 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:03.077159  1347 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:02.743642  1345 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.085481  1355 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.077395  1112 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.086104  1355 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.087872 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.090977  1342 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.093015  1334 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.094136  1345 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.094810  1360 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.095355  1360 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.097311  1355 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.094218 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:03.078660  1348 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:10:03.020728   990 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.079564  1144 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.080734   899 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:02.908141  1236 consensus_queue.cc:1048] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.132s
I20260709 13:10:03.106041 26604 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
W20260709 13:10:03.108155 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 484227us
I20260709 13:10:03.120906 26678 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:03.125226 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.128448 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.130415 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.134505 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.136734 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.099494  1355 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.120718   990 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.157254 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:03.181151 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 437746us
I20260709 13:10:03.168820  1355 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.189842 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.173772  1304 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.190629 27318 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:03.190387 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.191991 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.179092  1361 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.195889 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:03.199652 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.192731   804 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:03.190092  1236 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.193183  1245 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.198156  1304 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.235754 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:03.235860 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 333155us
I20260709 13:10:03.238456 27316 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:03.249722 26753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2599) took 1054 ms. Trace:
I20260709 13:10:03.250346 26753 rpcz_store.cc:276] 0709 13:10:02.195657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.195871 (+   214us) service_pool.cc:224] Handling call
0709 13:10:02.196138 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.335407 (+139269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.335447 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.335505 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:02.335539 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.249454 (+913915us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540014fad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:03.249507 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.249648 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319841024}
W20260709 13:10:03.259001 26606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3822) took 2379 ms (client timeout 1753 ms). Trace:
W20260709 13:10:03.259608 26606 rpcz_store.cc:269] 0709 13:10:00.869389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.870199 (+   810us) service_pool.cc:224] Handling call
0709 13:10:03.248842 (+2378643us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540010ed54. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:10:03.249014 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2784961792}
I20260709 13:10:03.262228 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.230850  1245 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.265228  1344 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21.
I20260709 13:10:03.265533  1245 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.267148  1304 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.217820  1361 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.228201  1236 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.270309  1361 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.270902  1236 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.241295  1360 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.272102  1355 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.273514  1303 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.278750  1334 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.279240  1334 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.281257  1334 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.284543   735 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.284788  1144 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:03.286417  1288 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.287570  1107 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.289837  1107 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.291791  1208 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:03.294085 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.294869 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:03.297279 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.303607 26606 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:03.308171 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.303432 26610 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:10:03.310331 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.314033  1144 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.314587  1144 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.299782  1112 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.315573  1112 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.309464  1208 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:03.317911  1208 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.323900 27285 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:03.333693 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.312704  1236 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.336963 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.319160  1208 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.341346 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.318377  1112 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.335678  1355 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.347138 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.338390  1236 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.357488  1144 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.344149  1355 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.366576  1355 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.370368 26603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49434 (request call id 3832) took 1093 ms. Trace:
I20260709 13:10:03.370814 26603 rpcz_store.cc:276] 0709 13:10:02.276567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.276741 (+   174us) service_pool.cc:224] Handling call
0709 13:10:03.370165 (+1093424us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:10:03.370311 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789466496}
I20260709 13:10:03.351190  1236 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:03.372650 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.374624 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.374902 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.375527 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.375849 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.376003 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.376340 26752 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:10:03.378547  1325 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.379141  1325 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.379696   804 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.380167   804 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.380595 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:03.381278  1325 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.381569 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.381747 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.382380 27315 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:10:03.384057 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.384431  1324 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.384716 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.385085  1324 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.385540 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.385692  1324 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.387012 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.387956 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.388396 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.388825 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.389003 27317 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:03.390844 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.391093 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.389603  1324 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.392318 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.393615  1224 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:10:03.394220  1361 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.394680  1361 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.395054  1361 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:03.398902  1222 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.400379 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.401090  1315 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.401535 27286 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.402271  1199 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.402642  1199 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:03.402989  1199 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.412132  1319 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.413910  1355 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.414795  1326 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.415068 27318 raft_consensus.cc:2368] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:03.426764  1361 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:03.430292  1358 log.cc:927] Time spent T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.243s	user 0.000s	sys 0.003s
I20260709 13:10:03.431362  1121 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.433399  1236 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.437114 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.459851 26603 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
W20260709 13:10:03.436165 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 101930us
I20260709 13:10:03.439801 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:03.442750 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 163196us
I20260709 13:10:03.461305 26604 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:10:03.461795 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.463150 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.411208   990 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.478574   990 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.440408  1217 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.471212 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.480827 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.481034 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.481453 26604 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 12.
I20260709 13:10:03.474807 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.475091  1301 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:03.475637  1199 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.476158  1327 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:03.482980 27319 raft_consensus.cc:2393] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:03.485121 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.488226 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.489075 27314 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:03.488873 26650 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.497649 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.497568 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.498332 26756 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:03.499158 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.499504 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:03.493248 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.502022 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.504902 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.506429 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:03.506973 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.507346 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.508564 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.506987 26680 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.515892 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.485544  1121 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.542256  1121 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:03.542716  1121 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.543844  1112 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:03.544261  1112 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:03.486835   495 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.518561 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.545122 26604 raft_consensus.cc:2376] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23. Re-sending same reply.
I20260709 13:10:03.546430  1330 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:03.549788 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.551918 26753 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:03.552785 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53370us
I20260709 13:10:03.521395 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:03.522145 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.553968 26679 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.554361 26678 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:03.524359 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.526154 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:03.527249 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.528314   804 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.530329  1199 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.531996 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.485203  1217 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.533545 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.534508 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.535156 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.536526 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.567024 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.567302 26608 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.537029 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.538596  1370 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.570775 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.517493  1326 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.566004 26681 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:03.581904 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.544615  1112 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.555378 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.565258 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.568519 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.573140 26610 raft_consensus.cc:1275] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:10:03.584842 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.573601 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.573776 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.585367 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.585736 26604 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.574265 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.575443 26687 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:10:03.587436 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.575498 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.590057 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.590715 26612 raft_consensus.cc:2393] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 23: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:03.577117 26680 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:10:03.520887  1236 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.597990 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:10:03.604449 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 85606.4us
I20260709 13:10:03.606629 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.610819 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.612519 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.609076 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.616144 26604 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:10:03.617523 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.619280 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.622200 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.623840 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.624595 26760 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:03.626179 26679 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:03.557809   735 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:03.629293 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 75384.4us
W20260709 13:10:03.629721 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 67919.5us
I20260709 13:10:03.638295 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.638897 26753 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.639299 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.633665 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.637676 27285 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:03.574725  1339 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.641808 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.642467 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.642500 27285 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.643057 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.580992  1222 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:03.643478 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.580830  1326 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.648229 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.614090  1224 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:03.622910  1173 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:03.638916 26608 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:10:03.597294   857 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.653328 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.613636  1181 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.658495 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.663113  1326 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.668948 26611 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:03.627439  1355 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.675537 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:10:03.675814 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 66836.3us
I20260709 13:10:03.661700  1224 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.677680 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.684624 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.684963 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.656489  1352 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:03.660841 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.682219  1236 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:03.690999 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.596635  1370 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.662545  1327 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:03.692937 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:03.697249 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.677680 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:03.698346 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45105.9us
I20260709 13:10:03.695739  1304 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.713940  1304 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.657462  1339 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.644287   735 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.704114 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.704641 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.704861 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.725118 26604 raft_consensus.cc:3060] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.690905 26612 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:10:03.710578 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.725806 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:03.671113  1173 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.717206 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.717612 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.718825 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.727639 26724 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.728099 26683 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:10:03.729746 26683 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:03.726284 26760 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.720125 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:03.664434  1222 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.722172 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.682313  1183 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:03.703603  1224 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.692505  1181 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.700356  1364 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.740116 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.742038 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.724502   990 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:03.749248 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.708874  1352 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.682723   857 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.746776 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:03.761219 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.732131  1336 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:03.733937  1173 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:03.781982 26724 leader_election.cc:400] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:03.782296 26724 leader_election.cc:403] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.773130 26604 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:03.774549 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.781005 26755 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:03.746003  1346 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:03.783224 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:03.793475 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:03.755237  1361 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.791177   760 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:03.798592  1377 log.cc:927] Time spent T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:10:03.802742 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.802906  1236 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:03.803288  1199 consensus_queue.cc:1059] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:03.804653   857 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.785008  1245 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.780162  1352 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.780308  1360 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.808538   990 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.808876  1181 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.764011  1320 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.814805   760 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.816815  1238 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.818003 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.818944  1370 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:03.820255  1382 log.cc:927] Time spent T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:03.825121 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.829417  1217 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:03.830830  1383 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:03.844570 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.905104 26611 raft_consensus.cc:2410] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:10:03.884817 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:03.835881 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 140711us
I20260709 13:10:03.899029 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.910229 26752 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 25.
I20260709 13:10:03.911643 26760 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
W20260709 13:10:03.906612 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 106522us
W20260709 13:10:03.813374  1372 log.cc:927] Time spent T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:03.915124 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
W20260709 13:10:03.837049  1381 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:10:03.920796 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 118124us
I20260709 13:10:03.928426 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.929733 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.928555 26756 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:10:03.931242 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:03.932111 26685 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:03.921473  1236 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:03.835608  1326 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.940634  1326 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:03.865958  1376 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:03.941426  1376 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.906322  1360 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:03.943795  1304 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.943902  1360 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.837445  1183 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:03.947885  1183 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:03.925246 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.948740  1183 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.949913  1183 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.909773   990 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.908872   760 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.957162   990 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:03.959952  1376 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.960285 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:03.960464  1121 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.962591  1121 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.937575 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.909374  1238 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:03.966225  1238 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:03.865643   899 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:03.966471  1335 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:03.943912 26678 raft_consensus.cc:3060] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:03.951839 26606 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:10:03.849546   804 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:03.975996 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:03.976831 27314 raft_consensus.cc:2368] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:03.918678  1361 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:03.904822  1320 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.917939 26753 raft_consensus.cc:2468] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:03.955940 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.956745 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:03.959998 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.004534 26603 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:03.926043 26724 leader_election.cc:400] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:04.005281 26724 leader_election.cc:403] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.955967 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:03.986617  1352 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.989571 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:03.966948   899 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:03.953166  1236 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:03.995044 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.017797  1236 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:03.997159 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.019044  1360 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.019392  1199 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.007097  1320 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.022012 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.002154 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.006949 26752 raft_consensus.cc:2368] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
W20260709 13:10:04.007210 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51327.6us
I20260709 13:10:04.027578 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.028417  1208 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:04.007934 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 82097us
I20260709 13:10:04.029381 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:10:04.012652  1388 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:04.012823   760 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.013710  1222 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.031736 26604 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:04.028698 27284 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:04.015339   735 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.015868  1391 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:04.024071  1339 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.003890  1223 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:04.026901 26679 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 16.
I20260709 13:10:04.028491  1130 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:04.001819 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.028960  1208 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:04.038695  1361 raft_consensus.cc:2804] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:04.043573  1228 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:04.044564   760 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.045233 26680 raft_consensus.cc:1240] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:04.045751 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.046460 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:04.039808 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 70234.6us
I20260709 13:10:04.063907 26650 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:04.057399 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55671.5us
I20260709 13:10:04.057183 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.010377 26678 raft_consensus.cc:2468] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
W20260709 13:10:04.058117 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52266.4us
I20260709 13:10:04.059374 26724 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.063792 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:03.943483  1224 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.072372 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.076000 26651 leader_election.cc:400] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:04.076333 26651 leader_election.cc:403] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:10:04.060751  1208 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.078276 26724 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.061854  1355 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:04.077095  1238 raft_consensus.cc:2804] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:04.058259   899 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.056994  1130 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.080042 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.084762 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.086207 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:10:04.086454 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 49715.2us
I20260709 13:10:04.096238 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.097677 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.098558 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.112440 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.073840  1361 raft_consensus.cc:697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:04.077267  1228 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.119374 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.087966  1355 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.104918  1373 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:04.125692 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.108106  1304 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:04.139508 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.139701  1224 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:04.138391  1112 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.007s
I20260709 13:10:04.140337  1301 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.140532  1112 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.078099  1190 consensus_queue.cc:1048] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:10:04.107497   804 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.152683 26726 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.151822  1342 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.161427   990 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:04.161860 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 75734.4us
I20260709 13:10:04.162771 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.164222  1304 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.161448  1342 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.165235  1161 raft_consensus.cc:2804] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:04.165858  1161 raft_consensus.cc:697] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.167094  1342 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:04.132649 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47970.1us
I20260709 13:10:04.079185  1173 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:04.165606  1394 log.cc:927] Time spent T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:04.169561  1173 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.170485 26758 raft_consensus.cc:1240] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:04.133718  1355 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:04.116251  1238 raft_consensus.cc:697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.114753  1130 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.134460  1121 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.141027   760 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.141490  1370 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.144105  1361 consensus_queue.cc:237] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.120733  1391 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.127179  1228 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.195336  1391 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.195849  1391 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.166790  1161 consensus_queue.cc:237] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.159375  1320 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.201395  1217 raft_consensus.cc:3055] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:04.202009  1217 raft_consensus.cc:740] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:04.202590  1112 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.202903  1217 consensus_queue.cc:260] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.171998 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.174726 26682 raft_consensus.cc:1240] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:04.209928 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:04.210879 27317 raft_consensus.cc:2393] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:04.217836 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.220774 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.176165 26650 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.186061  1360 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.130760 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.225375 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.226442 26603 raft_consensus.cc:1240] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:04.228776 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.231603 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.173849   990 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.180281  1190 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.138432  1236 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.240907  1217 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.233597  1391 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.246179  1391 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.240995  1330 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:04.265295  1238 consensus_queue.cc:237] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.269544  1190 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.271775  1190 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.278555 26758 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:04.238348 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 62296.5us
W20260709 13:10:04.234925 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 104249us
I20260709 13:10:04.280287 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:04.189993   804 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.281827 26577 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:04.234477  1331 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.240041   735 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.242057  1370 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:04.285375 26577 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.287966 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.285956 26753 raft_consensus.cc:1240] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:04.299329  1370 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.312674  1370 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.316393 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:04.284005  1374 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:04.347796  1374 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.348237  1374 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:04.286562  1121 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:04.352032  1121 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.352900  1121 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.287942  1331 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.357796  1331 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.359308  1333 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:04.362933  1333 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.364166  1333 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.365559  1334 consensus_queue.cc:1059] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:04.366541  1334 raft_consensus.cc:3055] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:04.366873  1334 raft_consensus.cc:740] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.368266 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.367652  1334 consensus_queue.cc:260] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.371306  1334 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:04.371582 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.372923 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.320278 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.321426  1373 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.385354 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:10:04.323804 26506 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 211) took 100342 ms (client timeout 15000 ms). Trace:
I20260709 13:10:04.332369  1352 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.332653  1236 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.332772  1303 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.338882  1355 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.341403 26507 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 10 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.344081 27314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4"
dest_uuid: "77c617823f2e4a938ef247a8924e299b"
mode: GRACEFUL
new_leader_uuid: "687d192f79a044ce838f0bf292f0c09f"
 from {username='slave'} at 127.0.0.1:34736
I20260709 13:10:04.409592 27314 raft_consensus.cc:606] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Received request to transfer leadership to TS 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:04.344288  1319 consensus_queue.cc:1059] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:04.287202 26650 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.381057 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:04.383934 26606 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:04.384100 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.387158 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:10:04.385286 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 244580us
I20260709 13:10:04.414774 26576 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.396070 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.403152 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.404736 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:04.417877 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.422523 26576 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:04.423230 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 136094us
I20260709 13:10:04.423981 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:04.405544 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.386231 26506 rpcz_store.cc:269] 0709 13:08:23.980869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.052825 (+ 71956us) service_pool.cc:224] Handling call
0709 13:08:26.567845 (+2515020us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:04.323553 (+97755708us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241048,"reported_tablets":53,"spinlock_wait_cycles":242134272}
I20260709 13:10:04.424456 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.424302 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.426260 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.437232 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:04.452979 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.454182 26679 raft_consensus.cc:1240] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:04.454350 26576 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.457247 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.457746 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.458362 26682 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:04.407644  1181 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:04.461638 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:04.466883 26755 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:04.462682 27317 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:04.462953 26576 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.462056 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.481475 26682 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:04.412328  1339 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.473187 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.488049 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.421423   495 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:04.428308  1376 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.442709  1222 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.447039  1355 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 26 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.430117  1190 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.466291  1169 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.466440  1303 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.521751 26507 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 9 to 14, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.408201  1373 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.548350  1320 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.495038  1288 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:04.440383  1130 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.518476   735 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.472558  1360 consensus_queue.cc:1059] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
W20260709 13:10:04.537154 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 74980.7us
I20260709 13:10:04.521754  1316 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.527038  1336 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.544848 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:04.596648  1360 raft_consensus.cc:3055] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:10:04.551716 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 78605us
I20260709 13:10:04.597667 26650 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.598869 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
W20260709 13:10:04.558559 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 95659.4us
I20260709 13:10:04.554381  1183 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.571943  1376 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:04.502383 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.578941 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:04.582273  1208 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.583695  1217 raft_consensus.cc:3055] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:04.548816  1339 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.597041 26610 raft_consensus.cc:606] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.599849 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.597221  1360 raft_consensus.cc:740] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:04.595722 26724 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:04.608536 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 106235us
I20260709 13:10:04.612968 26610 raft_consensus.cc:614] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:04.614926 26650 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.616128 26650 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.617662 27286 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:04.604080  1169 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.614250   804 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:04.634676   804 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:04.635106   804 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.612594  1217 raft_consensus.cc:740] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:04.636942  1217 consensus_queue.cc:260] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.638134  1217 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.643102  1336 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.606283  1304 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.628320 26650 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.650022   804 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.654640   804 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:04.656116  1208 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.599840  1288 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:04.657373  1288 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.605909   899 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.664156   899 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.661579  1339 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.666352   899 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.669674 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.672448 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.672451 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.673570   495 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:04.676044 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47760.8us
I20260709 13:10:04.677331 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.679766 26576 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.681300 26576 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.666786  1374 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.684149 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.685436 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.686911   804 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:04.682469   495 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.687846 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.688439 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.688661 26678 raft_consensus.cc:1240] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:04.668062  1327 raft_consensus.cc:2804] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:04.668260  1183 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.675276  1252 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.634163  1130 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:04.672058  1190 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.694173 26650 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.682825  1304 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.698298 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.683092  1311 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.699038 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.695868 26576 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.707183 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.694778  1223 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.695465  1233 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.702960  1330 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:04.705636  1161 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:10:04.690878  1112 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.688076  1336 consensus_queue.cc:1059] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:04.720197 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.720741  1336 raft_consensus.cc:3055] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:04.721199  1336 raft_consensus.cc:740] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.721534  1316 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:04.721943  1316 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.721990  1336 consensus_queue.cc:260] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.722851  1316 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.723344  1336 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.711963  1183 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.712950 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:04.704217  1333 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.713798   735 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.710013  1303 consensus_queue.cc:1059] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:04.710306  1342 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:04.714735 26576 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.710552   857 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.724054  1223 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.726574 27317 raft_consensus.cc:1240] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:04.706017 26507 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:04.631914  1360 consensus_queue.cc:260] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.739892 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.739755 26507 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 11 to 13, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 13 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:04.740926  1303 raft_consensus.cc:3055] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:04.741317  1303 raft_consensus.cc:740] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.742076  1303 consensus_queue.cc:260] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.703605  1327 raft_consensus.cc:697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:04.743993 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.744481  1327 consensus_queue.cc:237] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.746191   857 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:04.751870   857 consensus_queue.cc:1059] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:04.753309  1223 raft_consensus.cc:3055] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:04.753687  1223 raft_consensus.cc:740] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.754520  1223 consensus_queue.cc:260] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.743410  1303 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.733026 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.734673 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.735263 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.736865 26610 raft_consensus.cc:606] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.737815 26603 raft_consensus.cc:1240] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:04.760710 26755 raft_consensus.cc:3060] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.710700 26650 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.760938 26610 raft_consensus.cc:614] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:04.760571 26609 raft_consensus.cc:1813] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Handling vote request from an unknown peer e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.762555 26609 raft_consensus.cc:2393] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:04.765307 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:04.765892 27317 raft_consensus.cc:1813] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Handling vote request from an unknown peer e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.766420 27317 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:04.767045  1223 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:04.779798 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.780572 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69953.2us
I20260709 13:10:04.782559  1360 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:04.787912 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 73263.7us
I20260709 13:10:04.788748  1330 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.789558  1301 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.754544  1373 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:04.790206  1301 consensus_queue.cc:1059] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:04.797607   760 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:04.797665  1316 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:04.798177   760 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:04.799214   760 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.800640   760 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.782606 26650 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.807237 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.809306 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.816417 26755 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:04.818790 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:10:04.818852 26726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.822319 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.822952 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:04.825878 26609 raft_consensus.cc:1240] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:04.827164 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44638.9us
I20260709 13:10:04.824887 26651 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:04.828765 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.830404  1183 raft_consensus.cc:2804] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:04.830890  1129 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:04.830928  1183 raft_consensus.cc:697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:04.832417 26650 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.833084 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.838908 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.841001 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:04.845721 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.846539 26753 raft_consensus.cc:3060] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:10:04.848165 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.851794 26682 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:04.856592 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.857863  1161 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.859759  1183 consensus_queue.cc:237] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:04.838243  1169 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:04.863215 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:04.863636 26687 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:04.838210  1373 consensus_queue.cc:1059] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:10:04.865029  1373 raft_consensus.cc:3055] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:04.865375  1373 raft_consensus.cc:740] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:04.866001 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:04.866204  1373 consensus_queue.cc:260] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:04.836584  1236 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.868432 26756 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:04.869313  1233 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:04.869576  1374 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:04.887526 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 47412us
I20260709 13:10:04.888334 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.888603  1408 consensus_queue.cc:1059] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:04.889511 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:04.889886  1408 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:04.890373  1408 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:10:04.891785 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.904892 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:04.905634 26611 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 15.
I20260709 13:10:04.905791 26753 raft_consensus.cc:2468] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:04.907797 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.907856 26680 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:04.912618 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.914614 26755 raft_consensus.cc:1240] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:04.916759 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:04.917169 26756 raft_consensus.cc:1240] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:04.921597 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 80423.1us
I20260709 13:10:04.922919 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:04.923867  1236 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.928825 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.829274  1288 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:04.930656  1169 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:04.931986  1361 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.932550  1208 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.934693  1346 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:04.937165 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:04.956743  1331 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:04.956894 27317 raft_consensus.cc:1275] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:04.957259  1330 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:04.998641 26611 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:04.971810 26678 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:04.867563  1373 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:04.985839 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 48765.2us
I20260709 13:10:04.987814  1288 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:05.005110  1411 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:10:05.027602 26753 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:04.977664  1169 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.026521 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:05.026732 26576 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:05.032071 26611 raft_consensus.cc:1275] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:05.034061  1181 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:05.035130 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:05.036304 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:05.037174  1238 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:05.037501   990 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:05.041328  1407 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:05.042850  1312 consensus_queue.cc:1059] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:05.043505  1301 consensus_queue.cc:1059] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:05.044107   760 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:05.044548  1169 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:05.045360  1301 raft_consensus.cc:3055] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:05.044040  1222 consensus_queue.cc:1059] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:05.044566   760 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:05.048290   760 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.049616   760 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.984887  1352 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:10:05.045769  1301 raft_consensus.cc:740] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:05.053248  1288 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.056336  1304 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:05.062639  1169 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.005774  1360 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.996160  1331 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:05.091764  1331 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:05.065523  1408 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.093817  1408 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.047271  1374 raft_consensus.cc:3055] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:05.095831  1374 raft_consensus.cc:740] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:05.078768 26678 raft_consensus.cc:1275] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:05.085172  1319 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:05.102727  1319 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.103083  1319 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:05.080806 26611 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:10:05.083915 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 193302us
I20260709 13:10:05.086380 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.091167  1327 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:05.113675  1303 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:05.116822 26609 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 26.
I20260709 13:10:05.117074 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:05.117928 26685 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:05.122148 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44687.7us
I20260709 13:10:05.125789 26679 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:10:05.126245 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.128113 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:05.128963 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:05.129309 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.131692 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:05.132834 27316 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:05.107645   857 consensus_queue.cc:1175] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9e8388401a74e84a2cc880930412709" responder_term: 20 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:05.121146  1327 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.085294  1304 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:05.187404 26650 leader_election.cc:400] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:05.187409  1327 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.115666  1303 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.230253 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:05.194213 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 153296us
I20260709 13:10:05.206460 26685 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
W20260709 13:10:05.210831 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 85350.7us
I20260709 13:10:05.108356   735 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.082533  1346 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:10:05.228034 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.230033 26608 raft_consensus.cc:2468] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:05.234956 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.377147 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:05.124329  1181 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.171s
I20260709 13:10:05.375463  1217 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.230791  1130 consensus_queue.cc:1048] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.153s
I20260709 13:10:05.410003  1304 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.408891  1217 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:05.416726  1409 log.cc:927] Time spent T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:10:05.383512  1183 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.434156  1183 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.437670 26752 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:05.345239   735 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.347446  1360 consensus_queue.cc:1048] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 13:10:05.426221 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 203007us
I20260709 13:10:05.379837  1223 consensus_queue.cc:1048] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:10:05.438159  1352 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:05.482874 26685 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:05.135085  1319 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.496649 26650 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:05.406610   495 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:05.097754  1301 consensus_queue.cc:260] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.407744  1161 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
W20260709 13:10:05.547824 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.547653 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75977.6us
I20260709 13:10:05.568547 27284 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:05.570672 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.547026   495 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:05.578922   495 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:05.581313  1236 consensus_meta.cc:287] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.000s
I20260709 13:10:05.582304 26685 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:05.579327  1319 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:05.534809  1352 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:05.575419  1373 consensus_meta.cc:287] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
W20260709 13:10:05.588796 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 59876.4us
I20260709 13:10:05.581769  1236 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.600359 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:05.582371  1327 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:10:05.625574  1417 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:05.587997  1169 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.629837  1190 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:05.631901  1374 consensus_queue.cc:260] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.632509 27317 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:05.633014  1374 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:05.634651  1288 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.635139  1288 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.637184  1288 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:05.638439   760 consensus_meta.cc:287] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.000s
I20260709 13:10:05.638813  1352 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.639461  1352 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.639966  1352 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.641852  1352 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.585347  1252 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:05.621793  1183 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.659523  1327 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:05.667583 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:05.668377 26609 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:05.682210 26609 raft_consensus.cc:2468] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 16.
I20260709 13:10:05.683943 27284 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:05.674579  1236 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:05.677006  1217 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.691843  1352 raft_consensus.cc:2804] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:05.699255  1327 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.699867   735 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.706044  1339 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:05.707197  1352 raft_consensus.cc:697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:05.714586 26753 raft_consensus.cc:1240] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:05.744812  1420 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.746513  1183 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:10:05.747274  1331 consensus_meta.cc:287] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:10:05.722378  1236 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.748420 26756 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:05.748519  1420 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.750095  1236 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:05.750888  1420 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:05.754387 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:05.755983 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.747141  1183 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.755028 27313 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
W20260709 13:10:05.825687 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 71204.3us
W20260709 13:10:05.826936 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 82141.8us
I20260709 13:10:05.821329  1430 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:05.825327  1376 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.829476  1430 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.829835  1376 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:05.895869 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63939.9us
I20260709 13:10:05.833431  1301 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:05.898682 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.916587 26754 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:05.900596 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:05.917536 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.901247 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:05.918143 26753 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:05.918462 26608 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:05.902936 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:05.905201 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.915580 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:05.899729 26605 raft_consensus.cc:1275] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:05.833779  1376 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:05.927412 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 75090.1us
I20260709 13:10:05.834470  1430 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.753439  1339 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.851878  1435 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.932833  1352 consensus_queue.cc:237] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:05.937592 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:05.821964  1331 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:05.833633  1436 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.113s
W20260709 13:10:05.926101  1411 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:10:05.942138  1439 log.cc:927] Time spent T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:05.943240 26680 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:05.950086  1339 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:05.950867 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.953732  1303 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:05.848556  1316 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:10:05.955514  1322 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:05.956825 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:05.957504 27317 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:10:05.939796  1437 log.cc:927] Time spent T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:10:05.944335  1331 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:05.926442  1223 consensus_queue.cc:1059] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:05.961830 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:05.965799  1236 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:05.972658 26753 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:05.973171 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.973244 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.974874 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:05.977087 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:05.981323 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:05.983878 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.973065 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:05.984516 26755 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:10:05.985097 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:05.986687 26650 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:05.985764 26687 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:06.000159  1454 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:06.002131  1454 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.003345  1454 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:06.014393 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.018424 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.019224 26756 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 17.
I20260709 13:10:06.023411 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.024418 27317 raft_consensus.cc:2393] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 13: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
W20260709 13:10:06.025357 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 55912.8us
I20260709 13:10:05.968389  1435 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.025763 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.035162 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.017894  1346 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.037585 26578 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.037166 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:06.022112  1183 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:06.043485 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 56900.4us
I20260709 13:10:06.044629  1452 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:06.057595 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.067237 27313 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:06.033193  1319 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:10:06.065995  1430 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:06.070261  1430 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.070750  1430 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.039036  1360 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.077172  1360 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.077729  1360 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.039883  1374 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.080170  1374 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.100826  1461 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.106124  1374 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:06.117228 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81330.6us
I20260709 13:10:06.117121 26575 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:06.041437  1346 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.130857  1406 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.135748  1430 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.148721  1346 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.135103  1454 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.140009  1463 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.160791 26724 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.164897 26650 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.166877 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.152832  1414 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.167766 27313 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:10:06.169914 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:06.164443  1185 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.173166  1431 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:06.176834  1431 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.169153  1457 consensus_queue.cc:1059] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:10:06.177357  1431 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.167678  1181 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:06.177857  1443 raft_consensus.cc:2749] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:06.178275  1181 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.178674  1181 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.176767  1185 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.210536 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.208829 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.208293 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.199434 26680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 3894) took 1330 ms. Trace:
W20260709 13:10:06.221498 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 56683.5us
I20260709 13:10:06.222218 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:06.225204 26684 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:06.225257 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.220243 26680 rpcz_store.cc:276] 0709 13:10:04.869095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.977841 (+108746us) service_pool.cc:224] Handling call
0709 13:10:04.978158 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.950089 (+971931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.198958 (+248869us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001eaad4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:06.199346 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218974976}
I20260709 13:10:06.226752 26761 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:10:06.171311  1406 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.230152 26758 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:10:06.230530 26758 pending_rounds.cc:85] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 12
I20260709 13:10:06.230741 26758 pending_rounds.cc:107] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:10:06.230962 26758 raft_consensus.cc:2889] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.167913  1463 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.232437 26650 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:06.239379  1454 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.229941  1183 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:06.240751  1454 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.213340  1121 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:10:06.256824 26606 raft_consensus.cc:1240] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:06.171783  1414 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.256915  1406 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:10:06.239283  1467 consensus_queue.cc:1059] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:06.276386  1467 consensus_queue.cc:1243] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer 77c617823f2e4a938ef247a8924e299b log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:06.277374  1467 raft_consensus.cc:3055] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:06.277695  1467 raft_consensus.cc:740] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:06.278252  1185 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.278692  1463 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.278497  1467 consensus_queue.cc:260] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.280426 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.281075 26758 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:10:06.281937  1430 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.285601  1181 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.289671  1431 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.289935  1360 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.259171  1454 raft_consensus.cc:493] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.293116  1454 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.299196 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.297281  1208 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:06.300284  1208 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.302400  1208 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.302944  1208 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:06.303076  1360 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.303815  1467 raft_consensus.cc:3060] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:06.306529  1415 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.308027  1431 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.310765 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.311333 26758 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:06.264472  1474 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.313120  1185 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:06.313248 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.313817 26761 raft_consensus.cc:3060] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.313268  1474 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.315614 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.312069  1238 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:06.316562  1238 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.317878  1474 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.318542  1238 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.307121  1415 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.303325  1208 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.263830  1457 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.313671  1185 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.337931  1185 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.325090 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.325748 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.327340  1415 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.344031  1457 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.346329  1408 raft_consensus.cc:3055] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:06.346776  1408 raft_consensus.cc:740] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:06.346933  1457 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.334746  1208 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.326855  1463 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:06.285641  1414 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.263969  1469 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.329305 27317 raft_consensus.cc:1240] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.297766  1473 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.355370 26761 raft_consensus.cc:2468] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:06.261864 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.556412 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.557701 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.558074 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
W20260709 13:10:06.558185 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 296345us
I20260709 13:10:06.559111 26681 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.559276 26761 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:06.562481 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.564059 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.565238 26687 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:06.566401 26576 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.566804 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:06.185648 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.439705 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.569096 26610 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 14.
I20260709 13:10:06.441567 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.571025 26611 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:06.456426 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.458719 26609 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:06.467926 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.479696 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4cacedac354143ab8977803382d0af" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.580533 26684 raft_consensus.cc:1275] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:06.581138 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.582423 27285 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.484061 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:06.485610 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.584369 26685 raft_consensus.cc:2410] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:06.584311 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.585440 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:06.375391  1435 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.586508 27318 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:06.501348 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.586802  1435 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.501699 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.587553  1435 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.589664   760 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.589790   735 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.590364   760 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.590550   735 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.591305  1435 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.593394   899 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.593712  1435 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.378741  1304 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.594413   899 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.594694  1435 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.596047  1183 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.596796  1183 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.597996  1435 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.598850  1121 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.378826  1208 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.602470  1208 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.602643  1169 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:06.603320 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.604236 26757 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.605894  1185 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:06.607265  1185 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.608150  1330 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:06.609099  1224 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:06.609601  1224 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:06.610018  1333 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.552886 26752 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:06.368005  1360 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.610870  1224 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.368683  1181 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.382087   804 raft_consensus.cc:3055] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:06.645738  1360 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.646556   804 raft_consensus.cc:740] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:06.427443 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:06.647985  1316 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.648623  1316 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.648849   804 consensus_queue.cc:260] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.649211  1360 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.650264   804 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.650882  1224 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.650985  1316 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.347592  1408 consensus_queue.cc:260] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.646615  1185 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.532968 26506 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 18 to 19, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:06.552460 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.371721  1454 raft_consensus.cc:515] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.356614  1463 raft_consensus.cc:493] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:06.690491  1463 raft_consensus.cc:3060] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.690920  1185 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.378618  1469 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.698041  1469 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.373278  1473 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.700757  1473 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.554489 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.522305 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.580595 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.610950  1333 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.704416  1333 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.607551  1312 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.587289 26603 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:06.644186  1311 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:06.659519  1319 raft_consensus.cc:2804] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:06.659701   899 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.660449  1183 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.609141  1330 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.661175  1376 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.664481 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.665248  1303 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:06.665822 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:06.666291 27313 raft_consensus.cc:1240] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Rejecting Update request from peer b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:06.603453  1169 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.718923  1169 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.719297  1454 leader_election.cc:290] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.719913 26687 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 19: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:06.721148 26753 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:06.716562  1319 raft_consensus.cc:697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:06.725436   735 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.725001  1319 consensus_queue.cc:237] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.726773 26506 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 2 to 9, term changed from 11 to 14, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193), VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194), VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195), VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:06.594542  1190 consensus_queue.cc:1059] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:10:06.671514 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.599512  1121 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.682374 26757 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:10:06.667529   760 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.688727 26752 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:10:06.704828 26681 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:10:06.704876 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.704950  1333 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.733865  1121 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.734017 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.734303  1333 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.735112 26754 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.736776  1333 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.708487  1312 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.738970  1312 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.716523 27318 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.740259 26506 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 4 to 11, term changed from 10 to 14, VOTER e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) evicted. New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.716893  1330 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.745003 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.745349 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.746855 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.747476 27319 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:10:06.748802 26575 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:06.749729  1312 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:06.750123  1312 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.750541  1312 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.750802  1190 raft_consensus.cc:3055] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.751192  1190 raft_consensus.cc:740] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:06.752177  1190 consensus_queue.cc:260] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:06.752125 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 114412us
I20260709 13:10:06.756816   857 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.757320   857 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.758029  1408 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:06.760038 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.760768 26756 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.763836 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:06.763875 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:06.764925 26753 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 23.
W20260709 13:10:06.765038 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 196442us
I20260709 13:10:06.765645  1414 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:06.766136  1414 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.754046  1473 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.766628  1414 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.767195  1473 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.768127  1330 consensus_queue.cc:1048] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:06.771450  1190 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.768916 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:06.772464   857 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:06.772842 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 128031us
I20260709 13:10:06.773698  1452 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:06.774194  1452 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:06.774642  1452 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.766356 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.773686 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:06.743227 26506 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 18, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.783532 27318 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:06.778859 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.796185 26754 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:06.801573  1360 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:06.807097  1360 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.808629  1473 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.815315 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.816047 26681 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:10:06.816962 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.817358  1454 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.817557 26681 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 21.
I20260709 13:10:06.817890  1454 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:06.818383  1181 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.818496  1454 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.818992  1181 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.819854   899 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.820686   899 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.821414  1181 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.823283 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:06.824072 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 67784.8us
I20260709 13:10:06.828450 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.807503  1360 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:06.837291 26756 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
W20260709 13:10:06.828297 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62090.3us
I20260709 13:10:06.827852  1304 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:06.830392 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:06.805353 26506 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 12, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 12 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:06.828912 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.831657 27285 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.844110  1465 raft_consensus.cc:2804] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:06.844770  1465 raft_consensus.cc:697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:06.846029 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.829463 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:06.827649 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.823395   899 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.819303  1452 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:06.831629 26507 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 213) took 62187 ms (client timeout 15000 ms). Trace:
I20260709 13:10:06.817806  1463 raft_consensus.cc:515] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.867894  1452 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:06.868237  1181 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.869159  1181 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.871264  1181 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:06.871963 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44472.7us
I20260709 13:10:06.873092  1181 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:06.873143 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:06.873519  1181 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.873941  1181 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:06.878600 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.879361 26612 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23.
I20260709 13:10:06.880985 26756 raft_consensus.cc:2468] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:06.882244 27285 leader_election.cc:304] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:06.883311 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.885818 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.886586 26606 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 26.
I20260709 13:10:06.880887 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:06.887554 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57316.6us
I20260709 13:10:06.868230  1463 leader_election.cc:290] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:06.833649  1461 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.891991 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.898502 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.899471 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.899775 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.901499 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.902179 26605 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:06.897408 26606 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
W20260709 13:10:06.905704 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.906225  1408 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:06.912523  1408 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:06.919468 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:06.861078  1333 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.862413 26506 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.832687  1462 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.095s
I20260709 13:10:06.928074 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.921491 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:06.921007   899 raft_consensus.cc:2804] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:06.935868 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.893682   760 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:06.933146 26506 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 15 to 17, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 17 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:06.915472  1408 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:06.945812 26607 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:10:06.957633 26724 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:06.958177 26724 leader_election.cc:403] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:10:06.964859 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:06.962255 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:06.965802 26506 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 18, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 18 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:06.976161 27317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:06.845989  1465 consensus_queue.cc:237] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:06.982800 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.948645   899 raft_consensus.cc:697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:06.954602   760 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:06.984813 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
W20260709 13:10:06.989218 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 97751.2us
W20260709 13:10:06.989780 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 57843.1us
I20260709 13:10:06.988250 26506 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 20 to 22, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 22 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.995277  1169 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:07.007736  1342 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:07.008689  1474 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:07.009522 26577 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
W20260709 13:10:07.010421 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 154570us
I20260709 13:10:07.011222 26651 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.013576 26651 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:07.015203 26506 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 11 to 13, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 13 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:07.016711  1431 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:07.017292  1431 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:07.017632  1443 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:07.018301  1431 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.021206 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.021963 26606 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:10:07.023185 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.024003 26753 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 23: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:07.016726 26506 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.025067 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.024995 26506 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 18 to 20, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 20 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:07.025758 26761 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:10:07.026419 26506 catalog_manager.cc:5697] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.023195 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.031318 26757 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:10:07.018852  1443 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.937676  1461 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.039877 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.032814 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:07.046872 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.042683 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:07.047711 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:06.964841  1333 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.059369   899 consensus_queue.cc:237] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.061090 26612 raft_consensus.cc:3060] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:07.061357  1333 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.063614 26611 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:07.063395   760 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.052531  1224 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:07.066247  1454 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:07.056147 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 62392.8us
I20260709 13:10:07.067600 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.056092 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.056300   857 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:07.074396  1462 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:06.991333  1414 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.078490  1414 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.079248 26680 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:07.047120 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.080849 26608 raft_consensus.cc:2393] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:07.084233  1461 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.085593 27313 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
W20260709 13:10:07.086598 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44021.6us
I20260709 13:10:07.089018 26685 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:07.068419 26607 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:07.091729 26577 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:07.099275 26612 raft_consensus.cc:2468] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 21.
I20260709 13:10:07.101626 26724 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23.
W20260709 13:10:06.865495 26507 rpcz_store.cc:269] 0709 13:09:04.819476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.850535 (+ 31059us) service_pool.cc:224] Handling call
0709 13:09:05.935120 (+1084585us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:09:05.974305 (+ 39185us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5400002210. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016c640 00007f40f9043b76 00007f40f914dc3e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:06.831410 (+60857105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:05.039472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:05.040082 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:05.040121 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:10:05.040141 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:05.040788 (+   647us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:05.040882 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:05.040917 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:10:05.041364 (+   447us) tablet.cc:701] Row locks acquired
0709 13:10:05.041385 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:05.041542 (+   157us) write_op.cc:270] Start()
0709 13:10:05.041655 (+   113us) write_op.cc:276] Timestamp: P: 1783602605041493 usec, L: 0
0709 13:10:05.041678 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:05.086293 (+ 44615us) log.cc:844] Serialized 1714 byte log entry
0709 13:10:05.671208 (+584915us) op_driver.cc:464] REPLICATION: finished
0709 13:10:05.934033 (+262825us) write_op.cc:301] APPLY: starting
0709 13:10:05.934124 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:06.054403 (+120279us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:06.066018 (+ 11615us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:06.078553 (+ 12535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:06.078798 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:10:06.078853 (+    55us) write_op.cc:312] APPLY: finished
0709 13:10:06.079122 (+   269us) log.cc:844] Serialized 49 byte log entry
0709 13:10:06.092323 (+ 13201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:06.095500 (+  3177us) write_op.cc:454] Released schema lock
0709 13:10:06.099830 (+  4330us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:06.100243 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:06.100276 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":309713,"reported_tablets":53,"spinlock_wait_cycles":2112429824,"child_traces":[["op",{"apply.queue_time_us":262576,"apply.run_cpu_time_us":7915,"apply.run_wall_time_us":166190,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":199570,"prepare.run_cpu_time_us":34182,"prepare.run_wall_time_us":277669,"raft.queue_time_us":44286,"raft.run_cpu_time_us":124144,"raft.run_wall_time_us":215708,"replication_time_us":629338,"thread_start_us":487409,"threads_started":4,"wal-append.queue_time_us":428979}]]}
I20260709 13:10:07.101794 26576 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.102839 26724 leader_election.cc:403] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.104164 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:07.105422 26724 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.109778 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:07.040748  1443 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:07.113788 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:07.106192 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.121245 26683 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:10:07.126004 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.098452  1376 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:07.112936  1435 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:07.108393  1224 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23.
I20260709 13:10:07.121727  1436 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:07.122103  1473 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:07.131628  1429 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:07.155290  1473 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.155889  1473 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:07.134387  1454 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.152302  1436 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.156725  1436 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:07.159204 26680 raft_consensus.cc:1240] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:10:07.160944  1376 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.161479  1376 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:07.168531 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.139061  1181 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.144439  1322 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.112743  1185 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:07.115828   735 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.149449  1435 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.151813 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:07.169874 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.169306 26680 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:07.115526  1443 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:07.184888 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.173089  1322 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.199821 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.175704  1185 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.182839  1435 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:10:07.251580 26725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.248324 26724 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.261843 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.262478 26757 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:07.262854 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.263753 26753 raft_consensus.cc:2393] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 21: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:07.264938 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:07.269856 26576 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:07.217459  1322 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.280328 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.281865   990 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:07.287606   990 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.289970   990 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.290536 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:10:07.291291 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 175308us
I20260709 13:10:07.251957  1185 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:07.194144  1312 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.286309 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.287042 26686 raft_consensus.cc:1240] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:10:07.298009 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:07.312009 26687 raft_consensus.cc:2368] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:07.310400 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.276538  1224 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.296811   735 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:07.296029  1454 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.317207 26609 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:07.303109  1319 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:07.322887 26755 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:07.331142 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.331929 26681 raft_consensus.cc:2368] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23.
I20260709 13:10:07.318095   735 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.325995  1319 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.322817  1462 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.308061  1360 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.329806  1224 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.352432 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 186241us
I20260709 13:10:07.345343  1319 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.344563   735 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:07.360847 27318 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 24: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:07.353895  1224 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.387966 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.398187 26756 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:07.419000 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.419881 26678 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:07.421096 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:07.421860 26682 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.422966 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.424139 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.424715 26685 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:10:07.425513 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.426877 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.419796 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.427815  1360 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.429898 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.350428  1462 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:07.453249 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 290089us
W20260709 13:10:07.455155 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 100355us
I20260709 13:10:07.360615  1473 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.377983  1217 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:10:07.470279 26682 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:07.390725  1181 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.480430 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.486425  1312 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.492766  1462 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.522365  1223 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.523028  1223 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.525390  1408 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:07.525935  1408 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.527704  1236 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:07.528578 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a03ebddf0c40ebb4879344f54f5d24" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.529326 26756 raft_consensus.cc:2393] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:07.529852  1443 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.530520 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.531210 26758 raft_consensus.cc:2368] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.531816 26686 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:07.525411  1161 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:07.533859  1161 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.528160 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.539354 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.540781 26753 raft_consensus.cc:2393] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 23: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
W20260709 13:10:07.542479 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 79514.7us
I20260709 13:10:07.544998 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.545079 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.545814 26761 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:07.549875 26758 raft_consensus.cc:2393] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:07.528434  1236 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.552202 26726 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:07.525216  1223 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:07.556145 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 307915us
I20260709 13:10:07.597172 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.594489 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.553902  1408 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.611879 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.612685 26607 raft_consensus.cc:3060] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.553002  1217 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:10:07.562645  1443 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.623193 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.634824 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:07.642618 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:07.643411 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607ad667e17480ca4cc0366f3f7ce3b" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:07.644202 26680 raft_consensus.cc:2393] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 21: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:07.645318 26680 raft_consensus.cc:1275] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:07.643587 27318 raft_consensus.cc:2368] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 23. Current term is 24.
I20260709 13:10:07.645955  1224 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.646880 26683 raft_consensus.cc:1275] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:07.648116 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:10:07.652567 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 136491us
I20260709 13:10:07.640889 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.652645 26650 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:07.656736 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.660269 26753 raft_consensus.cc:2368] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.661917 26575 leader_election.cc:400] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 23. Current term is 24.
I20260709 13:10:07.662237 26575 leader_election.cc:403] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.599074  1436 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.667280  1467 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.668465 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.669202 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:07.669756 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.676242 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.684166 26682 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:07.662513 27285 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.684538 26684 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 13.
I20260709 13:10:07.688117 26651 leader_election.cc:304] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.615764  1121 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:07.651156  1330 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:07.700345   899 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.700814   899 raft_consensus.cc:493] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.701148   899 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.702706  1185 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.703804 26605 raft_consensus.cc:2368] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:07.691282  1414 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:07.682200  1161 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.712239 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.708621  1327 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:07.720325 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44047.1us
I20260709 13:10:07.685227  1435 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.759049   804 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.759249 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 71198.8us
I20260709 13:10:07.759639   804 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.760275 26651 leader_election.cc:400] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.760564 26651 leader_election.cc:403] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.709021  1333 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:07.765337 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 70676.8us
W20260709 13:10:07.766796 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61375.3us
I20260709 13:10:07.711241  1414 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:07.773134 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 110723us
I20260709 13:10:07.771329 26651 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.758980  1473 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.780179   804 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.770566  1190 raft_consensus.cc:2749] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:07.785336  1376 consensus_meta.cc:287] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.003s
I20260709 13:10:07.785789  1376 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.788256  1236 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.788201   735 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.789026  1436 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.790652   735 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.788232  1374 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:07.787232  1322 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.792272 26611 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:07.792671 26608 raft_consensus.cc:2368] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.788174   899 raft_consensus.cc:515] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.794468  1322 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.795975   899 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.804355 26759 raft_consensus.cc:1240] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 13:10:07.805004  1185 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:07.777127  1414 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:07.723289  1330 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.813867  1330 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.775489  1443 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.815681  1435 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 27 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:07.827045 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 55810.4us
I20260709 13:10:07.835949 26607 raft_consensus.cc:2468] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:07.837435 26651 leader_election.cc:400] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:07.837828 26651 leader_election.cc:403] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.847143 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:07.853886 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.854008 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.854735 26753 raft_consensus.cc:2368] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:10:07.830529  1443 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.856190 26651 leader_election.cc:400] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:10:07.856454 26651 leader_election.cc:403] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.862124 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:07.862986 26682 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
W20260709 13:10:07.855721 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 79784.7us
I20260709 13:10:07.865495 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:07.838394  1376 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:07.852150  1470 raft_consensus.cc:3060] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.869992 26681 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:07.872305  1467 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:07.890228  1443 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:10:07.909425 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 140207us
W20260709 13:10:07.917897 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 151206us
W20260709 13:10:07.920166 26724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.927556  1462 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:10:07.936026 27314 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:07.937747  1512 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:07.937942 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:07.931474  1334 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:10:07.933080 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68242.4us
I20260709 13:10:07.939630 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:07.945990 26754 raft_consensus.cc:3060] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:07.940347 26758 raft_consensus.cc:1275] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:07.940442 26759 raft_consensus.cc:1275] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:07.947006 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:07.947268 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 81891.2us
I20260709 13:10:07.947887 26756 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 20: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:07.943862  1161 consensus_queue.cc:1059] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:07.956987 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.959391 26724 leader_election.cc:400] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:07.959717 26724 leader_election.cc:403] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.940680  1224 leader_election.cc:290] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:07.960335 26724 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:07.961030  1161 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:07.961177  1408 raft_consensus.cc:2804] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:07.961452  1161 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:07.961722  1408 raft_consensus.cc:697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:07.962380  1161 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.962610  1408 consensus_queue.cc:237] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:07.963841  1130 consensus_queue.cc:1175] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "687d192f79a044ce838f0bf292f0c09f" responder_term: 21 status { last_received { term: 21 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 21 index: 12 } }
I20260709 13:10:07.964471 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:07.960505  1224 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:10:07.965242   857 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:07.963598  1161 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:07.968034 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:07.969591  1319 consensus_meta.cc:287] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260709 13:10:07.969986  1319 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:07.941521  1334 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:07.972730  1334 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.974016  1334 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:07.977176 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.977743 26604 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.980075 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.984066 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.984234  1224 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 21. Current term is 22.
I20260709 13:10:07.990360 26754 raft_consensus.cc:2468] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 24.
I20260709 13:10:07.992095 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:07.992455 26606 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:07.996002 26611 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:07.996546 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.002175 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.002926 26603 raft_consensus.cc:2368] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:10:08.005715 26650 leader_election.cc:400] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:08.006021 26650 leader_election.cc:403] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.999658 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:07.995815 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 319819us
I20260709 13:10:07.992131  1473 raft_consensus.cc:2764] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:10:08.013376 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.022476 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.023298 26687 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:08.031224 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.033771 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.034332 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.034900 26682 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:08.035905  1303 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:08.036441  1303 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.038856  1303 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:08.040337  1517 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:10:08.026696   857 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.046058   857 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:07.978106  1414 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.048228   857 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:08.048708 26686 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:08.052878  1414 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.055192 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:08.057548 26687 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:08.016361  1130 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:08.015307  1463 consensus_queue.cc:1048] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:10:07.992249  1511 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:08.058091 26604 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:10:08.057657 26682 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:08.072029 26756 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:10:08.015506 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:08.056298 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56763.7us
I20260709 13:10:08.070104 27284 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:08.068364 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:08.074787 26754 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:08.072228 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 72274.2us
I20260709 13:10:08.079389 26756 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:08.054399  1319 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:08.074071 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:08.082428 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:08.078258 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65989.3us
I20260709 13:10:08.073634 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.083099 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.081965 26650 leader_election.cc:400] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:10:08.085453 26759 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:08.086638 26761 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 19: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:08.089757 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:08.090534 26606 raft_consensus.cc:2368] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:10:08.087725 26753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:08.089603  1462 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.077855  1190 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:08.132092 26686 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 19.
I20260709 13:10:08.135986 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:08.085857  1511 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.136672 26752 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
W20260709 13:10:08.138577 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 123181us
I20260709 13:10:08.150771  1465 consensus_queue.cc:1048] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:08.152381  1414 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:08.152592  1465 consensus_queue.cc:1048] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:08.153281  1465 consensus_queue.cc:1243] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer b9e8388401a74e84a2cc880930412709 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:08.153168  1414 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.159030 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.165401 27286 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:08.090891  1360 raft_consensus.cc:2804] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:08.170459 26760 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:08.129426   857 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:08.177824 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:08.178695 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 105173us
I20260709 13:10:08.178967 26686 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:08.172840  1319 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.181308 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:08.174674  1463 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:08.185210  1463 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.189280 26754 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 20.
I20260709 13:10:08.192880 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:08.185598  1463 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:08.177546  1360 raft_consensus.cc:697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:08.197504 27319 raft_consensus.cc:2368] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:08.197705 26679 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Rejecting Update request from peer 77c617823f2e4a938ef247a8924e299b for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:08.199976 26685 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:10:08.200870 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.176390  1496 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:10:08.201450 26682 raft_consensus.cc:3060] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.202171 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:08.205708 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:08.208231 26577 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:08.209182 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:08.210520 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.211153 26679 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:08.210812  1360 consensus_queue.cc:237] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.211683  1322 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:08.212168  1322 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:08.213030  1322 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.214766  1312 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:08.178244  1316 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:10:08.216974  1312 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:08.192230  1303 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:08.217559 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:08.217999  1312 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.177175  1208 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 13:10:08.220125 26650 leader_election.cc:400] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:10:08.220448 26650 leader_election.cc:403] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.197973 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:08.221454  1223 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:10:08.222265  1330 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483) with higher term. Message: Invalid argument: T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 18. Current term is 19.
I20260709 13:10:08.218029  1303 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:08.223734  1303 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:08.224128  1467 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 17. Current term is 18.
I20260709 13:10:08.228222  1470 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:08.230584 26577 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:08.182922  1333 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 23. Current term is 24.
I20260709 13:10:08.234246 26684 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:08.237749 26682 raft_consensus.cc:2468] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 14.
I20260709 13:10:08.241331  1462 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:08.242539  1462 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:08.242910  1462 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:08.246817 26650 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:08.252332 26726 leader_election.cc:400] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 18. Current term is 19.
I20260709 13:10:08.256573 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:08.261137 26726 leader_election.cc:400] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for earlier term 22. Current term is 23.
I20260709 13:10:08.262333 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.244027  1414 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:08.260200   735 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:10:08.243746  1498 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:08.245039  1463 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.278486  1511 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:08.280126  1473 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:08.282702 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:08.266791 26726 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.285456 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.287572 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:08.291325  1463 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:08.346774 27319 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:10:08.348174 26575 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:10:08.255523  1467 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:08.296393  1496 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:08.351169  1496 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:08.351730  1496 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:08.298485 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.299053  1498 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:08.284546  1462 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:08.300285 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 59558.6us
I20260709 13:10:08.357332  1462 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.357115  1498 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.361047 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:10:08.324474 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 57763.3us
I20260709 13:10:08.325600  1130 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:08.364570 26726 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.365406  1473 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.299583 26577 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:08.368252  1334 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:08.368399 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68908.4us
I20260709 13:10:08.368835  1334 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:08.369868  1334 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.372517 26650 leader_election.cc:400] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for earlier term 19. Current term is 20.
I20260709 13:10:08.373814 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.376422 26682 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:08.377470 26650 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:08.380290  1467 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:08.381790 26726 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.374856  1496 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.383178 26611 raft_consensus.cc:3060] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:08.386726 26684 pending_rounds.cc:85] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Aborting all ops after (but not including) 11
I20260709 13:10:08.387138 26684 pending_rounds.cc:107] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:08.387468 26684 raft_consensus.cc:2889] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:08.388053  1121 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:08.388561  1121 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.391506  1121 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.391499 26611 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:08.392814 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:08.393471 26754 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:08.393567 26682 raft_consensus.cc:2468] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 19.
I20260709 13:10:08.394353 26726 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.394814 27284 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:08.401518 26686 raft_consensus.cc:2468] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 20.
I20260709 13:10:08.402801 27286 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:08.406934   857 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:08.409379 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.410218 26687 raft_consensus.cc:2393] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 19: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:08.411495 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.411772 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:08.412652  1121 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:08.413013  1121 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:08.413362  1473 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:08.413425  1121 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:08.417706 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:08.415366 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.419003 26683 raft_consensus.cc:2368] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:10:08.421564 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.422339 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.423511 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.459045 26687 raft_consensus.cc:2393] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 18: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:08.423564  1319 consensus_queue.cc:1059] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:08.420758  1208 raft_consensus.cc:2804] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:08.424381 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d2ac1df6a84a8eb9a6a4510b47b6e0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.426668  1465 consensus_queue.cc:1048] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:08.419124  1463 raft_consensus.cc:2804] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:08.432562 26726 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.452471 26611 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:08.434909 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.478780 26683 raft_consensus.cc:2393] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 20: Already voted for candidate 77c617823f2e4a938ef247a8924e299b in this term.
I20260709 13:10:08.457465 26577 leader_election.cc:400] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:10:08.458041 26682 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:08.479283 26577 leader_election.cc:403] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:10:08.480947 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48470.4us
I20260709 13:10:08.481725 26726 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.423038  1496 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:08.495978 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.501842 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.503751 26686 raft_consensus.cc:1275] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:08.506367 26726 leader_election.cc:304] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.505400  1499 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:08.484395  1223 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:08.484068  1508 raft_consensus.cc:3055] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:10:08.484225  1408 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:08.492957  1312 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529) with higher term. Message: Invalid argument: T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19.
I20260709 13:10:08.487865  1463 raft_consensus.cc:697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:08.510950  1161 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:08.539865 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 104000us
I20260709 13:10:08.505209  1185 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:08.526436  1508 raft_consensus.cc:740] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:10:08.556326 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 50035.4us
I20260709 13:10:08.537587  1499 raft_consensus.cc:2749] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.535478  1303 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.573307  1303 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.582141 26726 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.582595 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.586622 26679 raft_consensus.cc:2393] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:08.618920 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:08.622210 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 68502.5us
I20260709 13:10:08.622964 27285 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:08.640130  1543 raft_consensus.cc:2804] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:08.648730  1508 consensus_queue.cc:260] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.580688  1360 consensus_queue.cc:1048] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:10:08.624905  1541 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:08.654356  1526 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:10:08.655037  1530 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:08.620744  1408 consensus_queue.cc:1048] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:08.660313  1543 raft_consensus.cc:697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:08.685756  1208 raft_consensus.cc:697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:08.699087  1333 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:08.701817 26679 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:08.659880  1463 consensus_queue.cc:237] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:08.792237  1529 log.cc:927] Time spent T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:08.763381  1414 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.723543  1333 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.832597  1333 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.816768  1414 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.822956  1208 consensus_queue.cc:237] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.805137  1473 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.835639  1414 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.840116  1473 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:08.844231  1473 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:08.851342 26759 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
W20260709 13:10:08.849998 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 185963us
I20260709 13:10:08.854516  1121 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:08.869477 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:08.870375 26611 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:10:08.871196 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:08.876302 26684 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:08.892802  1121 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:08.865902  1543 consensus_queue.cc:237] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:08.925401 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 58394us
W20260709 13:10:08.935946 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.943794 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:08.940964  1498 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:10:08.978485 26758 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:10:08.982681  1551 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:10:08.985808 26576 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:08.987471 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:08.988261 26681 raft_consensus.cc:2393] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 18: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:08.990248  1322 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:08.990751  1322 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:08.994557 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:08.996376 26754 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:09.001585 26683 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:09.002081 26687 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:09.002103 26761 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:09.003015 26611 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:08.995249 26758 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:09.008440 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:09.018990 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.020018 26752 raft_consensus.cc:2410] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:10:09.015597  1376 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:10:09.024946  1334 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:10:09.050252  1496 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:09.050616  1552 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:08.991604  1322 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.078019 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:09.079384 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49869.5us
I20260709 13:10:09.081043 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:09.090153   760 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:09.091346   760 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:09.091820   760 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:09.076529  1517 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:09.082743  1414 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:09.101722 26680 raft_consensus.cc:1275] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:09.108932  1454 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:09.109616  1454 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.088521  1497 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:10:09.117269  1508 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:09.118027 26724 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:09.089793  1252 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:09.107028  1414 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.128243  1252 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.104658  1514 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.131213  1514 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.088335  1553 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:10:09.144112 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.144398 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.145756 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.147243 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.147068 26609 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:09.155541 26758 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:09.153810 26651 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:09.165450  1190 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:09.176615 26576 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:09.174923   760 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.204653 26752 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:10:09.184227  1414 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.191080  1515 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.224532 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:09.226627  1333 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:09.243052 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 84779.1us
I20260709 13:10:09.248996   760 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.249874 26650 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:09.239791  1223 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:09.232713  1416 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:09.264525 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
W20260709 13:10:09.342247 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76813.2us
I20260709 13:10:09.257520  1514 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.340710  1190 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:09.356680  1560 log.cc:927] Time spent T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:09.244618  1515 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.261252  1185 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.441860  1252 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.451321 26752 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
W20260709 13:10:09.455581  1569 log.cc:927] Time spent T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:10:09.455875  1190 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.477694  1542 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:09.486330  1542 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:09.491289  1571 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:10:09.492383  1190 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.496670 26678 raft_consensus.cc:2393] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 22: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:09.501271  1431 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:09.501811  1431 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:09.505081  1454 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.507431  1185 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } attrs { replace: true } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:09.509181 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.497476  1515 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.511147  1185 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:09.511955  1431 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:09.513254 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:09.572504 27318 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:10:09.514297 26761 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:09.514595 26752 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:09.574947 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:10:09.530694 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 52340us
I20260709 13:10:09.576371 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:09.536922  1130 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:09.579859  1376 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:09.582222  1376 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:09.541586 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:09.583473  1376 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.541574 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.545364  1190 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.560634  1542 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:09.564600 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:09.597328 26506 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 120) took 8491 ms. Trace:
I20260709 13:10:09.604954 26724 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:09.596748  1416 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:09.606787  1542 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:09.607649  1416 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.613298 26724 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:09.622110 26612 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:09.631479 26609 raft_consensus.cc:1275] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:09.635692  1208 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:09.579931  1130 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:09.663856 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 320876us
I20260709 13:10:09.605584 26506 rpcz_store.cc:276] 0709 13:10:01.088222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.497409 (+3409187us) service_pool.cc:224] Handling call
0709 13:10:09.579624 (+5082215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:07.778815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:07.790914 (+ 12099us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:07.790964 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:07.790978 (+    14us) tablet.cc:662] Decoding operations
0709 13:10:07.792298 (+  1320us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:07.792382 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:07.792413 (+    31us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:10:07.793652 (+  1239us) tablet.cc:701] Row locks acquired
0709 13:10:07.793710 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:10:07.793887 (+   177us) write_op.cc:270] Start()
0709 13:10:07.794031 (+   144us) write_op.cc:276] Timestamp: P: 1783602607793818 usec, L: 0
0709 13:10:07.794067 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:10:07.880230 (+ 86163us) log.cc:844] Serialized 5300 byte log entry
0709 13:10:08.231025 (+350795us) op_driver.cc:464] REPLICATION: finished
0709 13:10:08.415951 (+184926us) write_op.cc:301] APPLY: starting
0709 13:10:08.416054 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:08.701331 (+285277us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:08.701461 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:08.959414 (+257953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:08.972614 (+ 13200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:10:08.977868 (+  5254us) write_op.cc:312] APPLY: finished
0709 13:10:09.002747 (+ 24879us) log.cc:844] Serialized 121 byte log entry
0709 13:10:09.002939 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.003086 (+   147us) write_op.cc:454] Released schema lock
0709 13:10:09.003150 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:09.003625 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.003658 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66654,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":173771,"apply.run_cpu_time_us":22083,"apply.run_wall_time_us":587648,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":377451,"prepare.run_cpu_time_us":9780,"prepare.run_wall_time_us":213671,"raft.queue_time_us":144834,"raft.run_cpu_time_us":19520,"raft.run_wall_time_us":215030,"replication_time_us":436770,"thread_start_us":547317,"threads_started":4,"wal-append.queue_time_us":17668}]]}
I20260709 13:10:09.622473  1431 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.667858  1431 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:09.668304  1431 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:09.667037 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 402518us
I20260709 13:10:09.598989  1360 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 13:10:09.626817  1542 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.615934  1549 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:10:09.681663 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.683467 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.684199 26757 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:09.686583 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.691394 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.692512 26755 raft_consensus.cc:2410] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:10:09.694360 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:09.691834  1208 consensus_queue.cc:1048] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:10:09.705674  1509 consensus_queue.cc:1048] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:10:09.743580 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.732120  1190 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:09.744964 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:09.734620  1334 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.761065 26680 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:09.763945 26680 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:10:09.769670  1334 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:09.783087 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:09.806980 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.807755 26607 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:09.809108 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:09.809926  1516 raft_consensus.cc:493] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:09.810184  1542 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:09.812067 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:09.821393 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:09.846248 26756 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:09.856141 26678 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:09.810730  1542 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:09.864573 26682 raft_consensus.cc:1275] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:09.863862 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 176427us
I20260709 13:10:09.867844 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:09.869524 26678 raft_consensus.cc:1275] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:09.871541  1130 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:09.882396 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:09.900806 26761 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.866098  1542 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:09.810660  1516 raft_consensus.cc:515] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:09.929972  1516 leader_election.cc:290] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:09.939949 26761 raft_consensus.cc:2468] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:09.913302  1577 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.948377 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 132516us
I20260709 13:10:09.952905 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:09.950599  1593 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:10:09.934178  1462 consensus_queue.cc:1048] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:10:09.969455  1431 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:09.971832  1431 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:09.973270 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:09.944212  1319 consensus_queue.cc:1048] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:10:09.963181  1576 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:10:09.955955  1577 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:09.988518 27318 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:10:09.989692 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
W20260709 13:10:09.993498 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 84766.1us
I20260709 13:10:09.995783 26651 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:09.972452  1334 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:10.000025 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:09.999596  1514 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:10.012847 26651 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:10.000058  1580 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:10:09.997042  1553 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:10.015542 26651 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:10.021566  1190 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:10.021407  1542 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.022511 26651 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:10.014816  1454 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:10.016531  1567 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:10.023806  1516 raft_consensus.cc:2804] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:10.041380  1577 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:10.048136  1588 log.cc:927] Time spent T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:10.048815  1190 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.049361  1190 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:10.051774  1586 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.104s	user 0.004s	sys 0.000s
I20260709 13:10:10.053319 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:10.056527 26687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:10.057360 26687 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 23.
I20260709 13:10:10.058727 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:10.062232  1408 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.063001  1589 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.147s	user 0.000s	sys 0.003s
I20260709 13:10:10.065910 26685 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 15: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:10.028918  1553 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:10.051471  1190 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:10.036760  1542 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:10.062994  1408 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:10.080623  1553 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:10.079265  1516 raft_consensus.cc:697] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:10.112896 26604 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:10.114531 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:10.114941 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:10.118145 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42105a7b264fbeb08ebb417ed538f0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:10.120918 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:10.105369  1416 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:10.120263  1498 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:10.107933  1431 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:10.119817  1587 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:10.122992  1542 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:10.136356  1498 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.143456  1542 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:10.144690  1542 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.142352  1498 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:10.152124 27318 consensus_queue.cc:237] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:10.142328  1587 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.163503 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:10.164369 27319 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 15.
I20260709 13:10:10.181696 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:10.181597 26650 leader_election.cc:304] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:10.187048 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:10.189438 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:10.192627 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:10.176868  1563 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.138661  1516 consensus_queue.cc:237] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.198442  1515 raft_consensus.cc:2749] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:10.213550  1322 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.209239  1190 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:10.224444  1563 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:10.351956  1563 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:10.239449  1408 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:10.239157  1190 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.380468  1190 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.299430  1322 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:10.432193 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 195104us
I20260709 13:10:10.438356 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:10.434203  1589 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:10.449450 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 221769us
I20260709 13:10:10.439834  1462 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.536589 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 96219.3us
W20260709 13:10:10.543279 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 86871.7us
I20260709 13:10:10.548237  1462 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:10.566008 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 99367us
I20260709 13:10:10.569687 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:10.556288  1602 log.cc:927] Time spent T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:10:10.589711  1223 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.591005  1605 log.cc:927] Time spent T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:10:10.729975 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 270152us
I20260709 13:10:10.717638  1252 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:10.673643  1223 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:10.744096  1610 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:10:10.749612  1616 log.cc:927] Time spent T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:10.752372 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:10.766228 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 with delete_type TABLET_DATA_TOMBSTONED (TS e09ea9b455894a0189912a7b9b6b2f84 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51502
W20260709 13:10:10.770803  1604 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:10:10.753113  1567 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:10.760484  1462 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:10.780139  1322 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:10.752372 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:10.761531 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:10.797353 26680 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 23: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:10.756807  1223 leader_election.cc:290] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:10.805895 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:10.807943 26680 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 23: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
W20260709 13:10:10.811686 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 240091us
W20260709 13:10:10.754909  1498 consensus_meta.cc:287] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
W20260709 13:10:10.884024 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 65011.6us
I20260709 13:10:10.884299 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:10.885041 26752 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 27.
I20260709 13:10:10.764194  1431 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:10.774609  1567 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.753520  1252 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:10.899923 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:10.896035  1604 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:10.908084 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:10.908566 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 344065us
I20260709 13:10:10.913555 26687 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:10.821008  1498 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:10.914706 27287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.892125  1431 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:10.928951 26606 raft_consensus.cc:2393] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 24: Already voted for candidate 687d192f79a044ce838f0bf292f0c09f in this term.
I20260709 13:10:10.931458 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:10.932909 26682 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:10.916831  1552 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:10.944252 26612 raft_consensus.cc:2410] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 for term 28 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:10:10.951722  1498 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:10.954213  1431 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:10.960765 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:10.942052  1552 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.965797  1552 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:10:11.054302  1190 consensus_meta.cc:287] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: Time spent flushing consensus metadata: real 0.611s	user 0.001s	sys 0.007s
W20260709 13:10:11.054768 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 61381.9us
I20260709 13:10:11.088035  1190 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.089041  1587 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:11.056509  1631 tablet_replica.cc:333] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
W20260709 13:10:11.060336 27286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.062640  1638 log.cc:927] Time spent T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:11.069624  1330 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.096014 27313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.097282 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.095858  1330 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.099385 26680 raft_consensus.cc:1240] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:11.101008 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:11.101562 26678 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:11.107259 26758 raft_consensus.cc:1240] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:11.108049  1567 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.109423  1252 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.110996 26678 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 24.
I20260709 13:10:11.114784 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.115017 26724 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:11.081086  1591 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.122820 26755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:11.123760 26754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.122880 26760 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:11.129297 26753 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:11.130049 26754 raft_consensus.cc:2393] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f in current term 27: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:11.130182 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.131986  1591 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.134184  1591 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:11.134466 27319 consensus_queue.cc:237] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.137956  1609 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:11.140202  1498 consensus_queue.cc:1059] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.148845 26726 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.149796 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.165251  1130 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:11.169297  1121 raft_consensus.cc:3055] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:11.169694  1121 raft_consensus.cc:740] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:11.170536  1121 consensus_queue.cc:260] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.174391 26577 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.174728 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.175901  1496 consensus_queue.cc:1059] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:11.176457 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.176688  1606 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:11.177246  1606 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:11.178047  1606 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.178772  1634 raft_consensus.cc:3055] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:11.179174  1634 raft_consensus.cc:740] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:11.179971  1632 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:11.197532  1121 raft_consensus.cc:3060] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:11.166400  1498 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:10:11.197389  1497 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.163079  1552 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.217298  1496 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.248281 27318 raft_consensus.cc:2368] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 27. Current term is 28.
I20260709 13:10:11.249012 26761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 938) took 1053 ms. Trace:
I20260709 13:10:11.249516 26761 rpcz_store.cc:276] 0709 13:10:10.196071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.200894 (+  4823us) service_pool.cc:224] Handling call
0709 13:10:10.201330 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.211992 (+ 10662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.212048 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.212645 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.242558 (+1029913us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b1800362e60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f2e384bc 00007f40f018648b 00007f40f8fe0ab9 00007f40f01a269b 00007f40f01a093f 00007f40f01a2c02 00007f40f2e2a20b 00007f40f2e2fd23 00007f40f2e300d1
0709 13:10:11.242753 (+   195us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:11.242806 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.242897 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.242953 (+    56us) raft_consensus.cc:1685] finished
0709 13:10:11.242972 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.248921 (+  5949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26852,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":75522,"spinlock_wait_cycles":54251392,"thread_start_us":79383,"threads_started":1,"wal-append.queue_time_us":207661}
I20260709 13:10:11.233033  1130 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:11.247117  1615 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:11.235096  1497 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:11.265336 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76178.5us
I20260709 13:10:11.241194  1322 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.233233  1620 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:10:11.282637 26577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.240855  1496 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.286691 26752 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:11.288259 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.225553  1634 consensus_queue.cc:260] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.292649 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.263067  1130 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.298067  1496 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.299343  1130 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:11.303911 26757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35546 (request call id 2770) took 1183 ms. Trace:
I20260709 13:10:11.304370 26757 rpcz_store.cc:276] 0709 13:10:10.120584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.120710 (+   126us) service_pool.cc:224] Handling call
0709 13:10:11.303626 (+1182916us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54000da7d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:10:11.303813 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888157952}
I20260709 13:10:11.287694  1322 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.314615  1497 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.314899  1322 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.288456  1632 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.318733 26759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35540 (request call id 2763) took 1116 ms. Trace:
I20260709 13:10:11.318828  1632 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.319262 26759 rpcz_store.cc:276] 0709 13:10:10.202228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.218290 (+ 16062us) service_pool.cc:224] Handling call
0709 13:10:10.228229 (+  9939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.228467 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.228483 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.060848 (+832365us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18003bae80. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01712a6 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a
0709 13:10:11.062482 (+  1634us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b2c0008c4d8. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:10:11.062922 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.223075 (+160153us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:11.223761 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.223853 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.318468 (+ 94615us) raft_consensus.cc:1685] finished
0709 13:10:11.318490 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.318638 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":641,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":65284,"spinlock_wait_cycles":13141760,"thread_start_us":151584,"threads_started":1,"wal-append.queue_time_us":181668}
I20260709 13:10:11.321674  1632 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.322530  1552 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 28 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.327303 26760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:11.327970 26760 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:11.334793 26760 raft_consensus.cc:2468] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 28.
I20260709 13:10:11.356742 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
W20260709 13:10:11.364337  1627 log.cc:927] Time spent T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 13:10:11.367166 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:11.368361  1643 log.cc:927] Time spent T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:10:11.370105 26611 raft_consensus.cc:1275] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:11.370352  1631 raft_consensus.cc:2243] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.371140  1631 raft_consensus.cc:2272] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.373700 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:11.381323  1631 ts_tablet_manager.cc:1916] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:10:11.395246  1636 log.cc:927] Time spent T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 13:10:11.411496  1577 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.412207  1577 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.414480  1577 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.420313 26686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 966) took 1240 ms. Trace:
I20260709 13:10:11.420806 26686 rpcz_store.cc:276] 0709 13:10:10.179517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.179686 (+   169us) service_pool.cc:224] Handling call
0709 13:10:10.179995 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.353045 (+173050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.353075 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.353669 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.451535 (+ 97866us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:10.451568 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.419822 (+968254us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001e87d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3290e01 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:11.419892 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.419955 (+    63us) raft_consensus.cc:1685] finished
0709 13:10:11.419975 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.420229 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3880,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":396907904,"thread_start_us":97496,"threads_started":1,"wal-append.queue_time_us":386778}
I20260709 13:10:11.427703 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.437331 26606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49440 (request call id 2721) took 1251 ms. Trace:
I20260709 13:10:11.437831 26606 rpcz_store.cc:276] 0709 13:10:10.181275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.181405 (+   130us) service_pool.cc:224] Handling call
0709 13:10:11.431834 (+1250429us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54002846d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32942fa 00007f40f8255b17 00007f40f17d06d4 00007f40f17d0662 00007f40f17d0591 00007f40f17d050c 00007f40f17cf7c2 00007f40f15cb48c 00007f40f15ca8c6 00007f40f15ca26f
0709 13:10:11.432755 (+   921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712167808}
I20260709 13:10:11.449545 27285 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:11.449419  1549 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:11.449713 26650 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:11.451349  1567 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:11.475644 26758 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:11.452039  1330 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.452863  1609 raft_consensus.cc:2804] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:10:11.464210 26687 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:11.465034 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.465688 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.465787 26684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.467855 26683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.468508 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.472738 26508 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 12, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 12 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:11.460889 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.466796 26759 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 8 to 13, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:11.491438 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.506788   760 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:11.507333   760 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.514151 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.514987 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.514333 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.516786 26612 raft_consensus.cc:1275] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:10:11.517230 26612 pending_rounds.cc:85] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Aborting all ops after (but not including) 10
I20260709 13:10:11.517429 26612 pending_rounds.cc:107] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:10:11.517657 26612 raft_consensus.cc:2889] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.520826 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.517609 26575 leader_election.cc:400] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 27 pre-election: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 27. Current term is 28.
I20260709 13:10:11.521860 26575 leader_election.cc:403] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:11.522301 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:11.454232  1625 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 8 to 13, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:11.543807 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.537276 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.536247 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:11.541275 27285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.542266   760 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:11.548914 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.550937 26607 raft_consensus.cc:1240] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 LEADER]: Rejecting Update request from peer e09ea9b455894a0189912a7b9b6b2f84 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:11.513650  1609 raft_consensus.cc:697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
I20260709 13:10:11.556957 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.552199  1640 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:11.561585 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 53855.5us
W20260709 13:10:11.561908 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 44924.9us
I20260709 13:10:11.562193  1322 raft_consensus.cc:3060] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:10:11.562911  1631 ts_tablet_manager.cc:1929] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:10:11.563457  1631 log.cc:1199] T c04d1d6cb7c54df78a1746de67ce6198 P e09ea9b455894a0189912a7b9b6b2f84: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/wals/c04d1d6cb7c54df78a1746de67ce6198
I20260709 13:10:11.552750 26724 leader_election.cc:304] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:11.567586  1640 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:11.569329  1657 log.cc:927] Time spent T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:11.578938 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.586438 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.563913 26575 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.583696  1645 consensus_queue.cc:1059] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:10:11.564021  1496 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.599097 26508 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 12, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 12 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:10:11.607388 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 43558.1us
I20260709 13:10:11.610996  1416 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.616876  1631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51502 (request call id 0) took 1275 ms. Trace:
I20260709 13:10:11.617341  1631 rpcz_store.cc:276] 0709 13:10:10.430655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.536014 (+105359us) service_pool.cc:224] Handling call
0709 13:10:11.056099 (+520085us) ts_tablet_manager.cc:1151] Deleting tablet c04d1d6cb7c54df78a1746de67ce6198
0709 13:10:11.056210 (+   111us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:11.394569 (+338359us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:11.562765 (+168196us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:11.616768 (+ 54003us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277130,"tablet-delete.queue_time_us":289015,"thread_start_us":183148,"threads_started":1}
I20260709 13:10:11.619110  1645 consensus_queue.cc:1243] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Peer 687d192f79a044ce838f0bf292f0c09f log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:10:11.619451 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet c04d1d6cb7c54df78a1746de67ce6198 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:11.619733  1645 raft_consensus.cc:3055] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:11.620164  1645 raft_consensus.cc:740] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:11.620994  1645 consensus_queue.cc:260] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.622206  1645 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:11.622886  1625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41654 (request call id 0) took 1472 ms. Trace:
I20260709 13:10:11.623383  1625 rpcz_store.cc:276] 0709 13:10:10.150352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.150501 (+   149us) service_pool.cc:224] Handling call
0709 13:10:10.154895 (+  4394us) log.cc:844] Serialized 508 byte log entry
0709 13:10:11.086185 (+931290us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b2c00040b88. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b98a0a 00007f40f1b98693 00007f40f1b98631 00007f40f32ccb52 00007f40f32cccf5 00007f40f3209691 00007f40f31e9eaa 00007f40f31f0d53 00007f40f31f0cd9 00007f40f31f0c69
0709 13:10:11.100393 (+ 14208us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b18003e2740. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f32ccd01 00007f40f3209691 00007f40f31e9eaa 00007f40f31f0d53 00007f40f31f0cd9 00007f40f31f0c69 00007f40f31f0c31 00007f40f31efdfd 000000000038f354 000000000038f199
0709 13:10:11.622762 (+522369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87149,"raft.queue_time_us":216786,"raft.run_cpu_time_us":7170,"raft.run_wall_time_us":1312232,"spinlock_wait_cycles":1508181248,"thread_start_us":194858,"threads_started":2,"wal-append.queue_time_us":214837}
I20260709 13:10:11.596824  1620 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:11.635846 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.633782  1496 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:11.655062 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 182078us
W20260709 13:10:11.660641 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 191941us
I20260709 13:10:11.660844 26726 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.661999 26650 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.665135  1567 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:11.666035  1563 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.666538  1563 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.663501 26650 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.669679  1516 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.671006  1496 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.667374  1647 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:11.672308  1516 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.675756  1408 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.676257  1408 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.678226  1408 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:11.679759 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.685130  1634 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.685453 26607 raft_consensus.cc:1275] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:11.697707 26650 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.599984  1545 consensus_queue.cc:1048] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:11.706602 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.711956 26508 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 9, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 9 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:11.718722 26508 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.721566 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.723884  1578 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:11.748313 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.724886  1577 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:11.712296  1408 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:11.708716  1567 consensus_queue.cc:1048] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:11.741142  1224 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.739028  1121 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.762835 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.740195  1563 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:11.769723 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 181746us
I20260709 13:10:11.770648 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.767649 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.652818  1609 consensus_queue.cc:237] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.774009 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.776907  1190 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.773289  1121 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.767402  1224 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.746078  1595 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:11.782377  1595 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:11.783090  1224 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.785235  1595 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.779624  1121 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:11.786039 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:11.788435  1615 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:11.763525  1408 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:11.791955  1408 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:11.786079  1334 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.798278 26606 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:11.805778  1322 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653) with higher term. Message: Invalid argument: T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687d192f79a044ce838f0bf292f0c09f for earlier term 27. Current term is 28.
I20260709 13:10:11.804723  1552 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:11.807199  1549 consensus_queue.cc:1048] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:11.807330 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.823590 26756 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:11.827061  1612 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:11.827260 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 53319.6us
I20260709 13:10:11.828326 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.829185  1612 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:11.832551 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.835537 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.841149 26761 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:10:11.841553 26761 pending_rounds.cc:85] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Aborting all ops after (but not including) 13
I20260709 13:10:11.841800 26761 pending_rounds.cc:107] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:10:11.842034 26761 raft_consensus.cc:2889] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.845469 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.855340 26685 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:10:11.857595 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.858351 26678 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 18.
I20260709 13:10:11.865763 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:11.865267 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:11.875965 26726 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.877907  1607 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:11.876684 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.895555 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.900363 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:11.901036 26604 raft_consensus.cc:2468] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:11.928442 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.930366  1252 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:11.926386 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:11.934968 26612 raft_consensus.cc:606] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.942782  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41654 (request call id 1) took 1383 ms. Trace:
I20260709 13:10:11.959365 26650 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.933113 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:11.958262 26606 raft_consensus.cc:2955] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:11.961730 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 198695us
I20260709 13:10:11.967173 26604 raft_consensus.cc:2955] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 8 to 13, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:11.964339  1330 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:11.982028 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:11.984855 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:11.987854  1497 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.989161  1594 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:11.943396  1552 rpcz_store.cc:276] 0709 13:10:10.559402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.559536 (+   134us) service_pool.cc:224] Handling call
0709 13:10:10.800547 (+241011us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5400647420. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f320d520 00007f40f3296b42 00007f40f3295800 00007f40f328e9fa 00007f40f82564c9 00007f40f17d2c54 00007f40f17d2be2 00007f40f17d2b11 00007f40f17d2a8c 00007f40f17d1d42
0709 13:10:11.133670 (+333123us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b580060a7d0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f31ec0aa 00007f40f326e447 00007f40f328b70a 00007f40f328c76a 00007f40f328b91b 00007f40f329703c 00007f40f32966b3 00007f40f328e9fa 00007f40f82564c9 00007f40f17d2c54
0709 13:10:11.162625 (+ 28955us) log.cc:844] Serialized 508 byte log entry
0709 13:10:11.384738 (+222113us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b1800317b60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:10:11.387543 (+  2805us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800317b60. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f906bde1 00007f40f90785b1 00007f40f01a33f3 00007f40f01a57c1 00007f40f01a5779 00007f40f01a5709 00007f40f01a56d1 00007f40f01a49cd 000000000038f354 000000000038f199 00007f40f018683a
0709 13:10:11.942705 (+555162us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":204,"mutex_wait_us":1671,"raft.queue_time_us":8732,"raft.run_cpu_time_us":1538,"raft.run_wall_time_us":44556,"spinlock_wait_cycles":651369728,"thread_start_us":19515,"threads_started":1,"wal-append.queue_time_us":87138}
I20260709 13:10:12.003743 26494 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2da4a43c4ca64471b27b22ea1a167d13 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:10:12.005705 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:12.008690 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:12.010509 26724 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:12.010990  1620 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:12.011835  1640 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:12.013931 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:12.014904  1578 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.026401 26606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:12.027047 26606 raft_consensus.cc:606] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:12.027377 26606 raft_consensus.cc:614] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:12.045224  1672 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:10:12.055362 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:12.064787  1330 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:12.067703 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 89757.4us
I20260709 13:10:12.073310  1334 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:12.080786 26606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e89d788bee4a128b18985e582217d9"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:12.081465 26606 raft_consensus.cc:606] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:12.091878 26606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:12.092541 26606 raft_consensus.cc:606] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:12.141346 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:12.141975 26609 raft_consensus.cc:606] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:12.142303 26609 raft_consensus.cc:614] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:12.147915 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:12.149717 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:12.176321 26609 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:10:12.179481  1667 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:12.183791  1376 raft_consensus.cc:993] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:12.185957  1322 raft_consensus.cc:1081] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:12.204595 26681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78e89d788bee4a128b18985e582217d9"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:12.205209 26681 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.205601 26681 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:12.235967 26681 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:12.237988 26681 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:12.239217 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:12.247957 26761 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:12.248165 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:12.248952 26604 raft_consensus.cc:3055] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:12.249325 26604 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:12.250200 26604 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:12.251276 26604 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:12.254956 26761 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:12.256784 26506 catalog_manager.cc:5697] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 21 to 28. New cstate: current_term: 28 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.257390 26651 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:12.258507  1594 raft_consensus.cc:993] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:10:12.258575  1578 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:12.259199  1303 raft_consensus.cc:1081] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Signalling peer e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:10:12.259227  1578 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:12.258507 26506 catalog_manager.cc:5697] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 16 to 19, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 19 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.261032  1578 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:12.262311 26758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:35540
I20260709 13:10:12.261672 26506 catalog_manager.cc:5697] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 20 to 21, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 21 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.263907 26758 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.263459 26506 catalog_manager.cc:5697] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.264318 26758 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.265122 26506 catalog_manager.cc:5697] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.277459 26506 catalog_manager.cc:5697] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.279106 26506 catalog_manager.cc:5697] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 21, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 21 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.280790 26506 catalog_manager.cc:5697] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 18 to 20, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 20 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.283293 26506 catalog_manager.cc:5697] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 19, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 19 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.286943 26506 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:12.292758 26604 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:12.293661 26506 catalog_manager.cc:5697] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 18 to 20, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 20 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:12.299052 26506 catalog_manager.cc:5697] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 12 to 14, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 14 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:12.301424 26508 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 219) took 77606 ms (client timeout 15000 ms). Trace:
I20260709 13:10:12.299573 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:51502
I20260709 13:10:12.303084 26506 catalog_manager.cc:5697] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:12.302908 26508 rpcz_store.cc:269] 0709 13:08:54.695331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.695503 (+   172us) service_pool.cc:224] Handling call
0709 13:10:12.301354 (+77605851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.929092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.929699 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.929750 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:10:11.929779 (+    29us) tablet.cc:662] Decoding operations
0709 13:10:11.930423 (+   644us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.930502 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.930529 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:10:11.931243 (+   714us) tablet.cc:701] Row locks acquired
0709 13:10:11.931280 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:10:11.931436 (+   156us) write_op.cc:270] Start()
0709 13:10:11.931558 (+   122us) write_op.cc:276] Timestamp: P: 1783602611931384 usec, L: 0
0709 13:10:11.931577 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.932258 (+   681us) log.cc:844] Serialized 1718 byte log entry
0709 13:10:12.074844 (+142586us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.140512 (+ 65668us) write_op.cc:301] APPLY: starting
0709 13:10:12.143327 (+  2815us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.146042 (+  2715us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.146136 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:12.167533 (+ 21397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:12.173919 (+  6386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:10:12.174888 (+   969us) write_op.cc:312] APPLY: finished
0709 13:10:12.211809 (+ 36921us) log.cc:844] Serialized 49 byte log entry
0709 13:10:12.212023 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.212145 (+   122us) write_op.cc:454] Released schema lock
0709 13:10:12.212192 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:12.214929 (+  2737us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.214978 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5191,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":59692,"apply.run_cpu_time_us":7648,"apply.run_wall_time_us":76374,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":206186,"prepare.run_cpu_time_us":4195,"prepare.run_wall_time_us":38359,"raft.queue_time_us":28331,"raft.run_cpu_time_us":3514,"raft.run_wall_time_us":24752,"replication_time_us":143114,"thread_start_us":246774,"threads_started":4,"wal-append.queue_time_us":34161}]]}
I20260709 13:10:12.318085 26758 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:12.332207 26758 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:12.333521 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:12.334156 26604 raft_consensus.cc:3055] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:12.334442 26604 raft_consensus.cc:740] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:12.335196 26604 consensus_queue.cc:260] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:12.336308 26604 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.336930 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:12.337488 27318 raft_consensus.cc:3060] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.351001 26604 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:12.352267 26724 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:12.357445  1640 raft_consensus.cc:2804] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:12.358027  1640 raft_consensus.cc:697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:12.358915  1640 consensus_queue.cc:237] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:12.371404 27318 raft_consensus.cc:2468] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:12.407855 26759 raft_consensus.cc:1275] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 28 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:10:12.420233  1667 consensus_queue.cc:1048] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:12.502609 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet c04d1d6cb7c54df78a1746de67ce6198 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:12.522172 26510 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 10 to 13, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 13 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.537473 26510 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 8 to 9, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 9 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.596225  1303 raft_consensus.cc:993] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:12.596757  1634 raft_consensus.cc:1081] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:12.599256 26685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:12.599828 26685 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.600200 26685 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.628438 26685 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:12.635815 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:12.636461 26612 raft_consensus.cc:3055] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:12.636746 26612 raft_consensus.cc:740] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:12.637441 26612 consensus_queue.cc:260] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:12.638479 26612 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.642359  1579 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
W20260709 13:10:12.641022 26510 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 212) took 86095 ms (client timeout 15000 ms). Trace:
I20260709 13:10:12.645916  1579 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:12.644214 26685 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:12.652856 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:12.653539 26759 raft_consensus.cc:3060] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.670341 26612 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:12.673378 26759 raft_consensus.cc:2468] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:12.675293 26651 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:12.687150  1578 raft_consensus.cc:2804] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:12.703500  1579 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:12.705713 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:12.705969 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:12.714751  1578 raft_consensus.cc:697] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:12.715740 26650 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:12.716091  1578 consensus_queue.cc:237] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:12.652570 26510 rpcz_store.cc:269] 0709 13:08:46.545761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.546016 (+   255us) service_pool.cc:224] Handling call
0709 13:08:46.638071 (+ 92055us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:12.640923 (+86002852us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:12.557534 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:12.558032 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:12.558069 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:12.558086 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:12.562228 (+  4142us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:12.562301 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:12.562342 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:12.562784 (+   442us) tablet.cc:701] Row locks acquired
0709 13:10:12.562809 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:10:12.563005 (+   196us) write_op.cc:270] Start()
0709 13:10:12.563161 (+   156us) write_op.cc:276] Timestamp: P: 1783602612562945 usec, L: 0
0709 13:10:12.563197 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:10:12.564017 (+   820us) log.cc:844] Serialized 935 byte log entry
0709 13:10:12.565773 (+  1756us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.566309 (+   536us) write_op.cc:301] APPLY: starting
0709 13:10:12.566411 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.568277 (+  1866us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.568357 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:12.569544 (+  1187us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:12.569724 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:10:12.571982 (+  2258us) write_op.cc:312] APPLY: finished
0709 13:10:12.572186 (+   204us) log.cc:844] Serialized 33 byte log entry
0709 13:10:12.572743 (+   557us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.573273 (+   530us) write_op.cc:454] Released schema lock
0709 13:10:12.573311 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:12.600052 (+ 26741us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.600086 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":267,"reported_tablets":53,"spinlock_wait_cycles":63821696,"child_traces":[["op",{"apply.queue_time_us":287,"apply.run_cpu_time_us":4110,"apply.run_wall_time_us":26188,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":3196,"prepare.run_wall_time_us":6801,"replication_time_us":2397}]]}
I20260709 13:10:12.767284  1684 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.729882 26501 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 10 to 13, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 13 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:12.777971 26501 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 20, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 20 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.784446 26501 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.786422 26501 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 18, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 18 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:12.789269 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 73605.5us
W20260709 13:10:12.766566 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 74669.7us
I20260709 13:10:12.797120 26761 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:12.801330 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:12.850718  1330 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:12.857461 27316 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:12.896299 26501 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 11 to 15, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 15 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.898327 26501 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:12.899655 26501 catalog_manager.cc:5697] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 17, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.903277 26501 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 17, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.905121 26501 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 17, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 17 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:12.862953  1640 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:10:12.907331 26501 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 15 to 17, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.912755 26501 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 18. New cstate: current_term: 18 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.914687 26501 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.920605 26604 raft_consensus.cc:1275] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:10:12.941879 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 103367us
I20260709 13:10:12.943919 26604 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:12.934206  1591 consensus_queue.cc:1048] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:10:12.968204 26501 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 16, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 16 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.970072 26501 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 14, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 14 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.978847  1690 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:13.005895 26501 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:13.007134 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 115059us
I20260709 13:10:13.024969 26501 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 16, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 16 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.046293  1693 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.026818 26501 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 16, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 16 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.052321  1693 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:13.088610  1693 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:13.091861  1667 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:13.092607  1667 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:13.097512 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:13.098115 27318 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 15.
I20260709 13:10:13.100666 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:13.101194 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:13.102005 26609 raft_consensus.cc:2410] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:13.102759  1693 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:13.107190 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:13.108069 26685 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 16.
I20260709 13:10:13.109274  1667 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:13.103350  1693 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.119632  1693 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.131037 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:13.133386 26685 raft_consensus.cc:2393] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c617823f2e4a938ef247a8924e299b in current term 16: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:13.137676 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:13.138799  1667 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.150695 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.169431  1667 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.182262  1693 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:13.214757 26759 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:13.219646 26612 raft_consensus.cc:1275] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:13.219517  1689 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:13.221517  1689 consensus_queue.cc:1048] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:13.242096 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:13.242777 26685 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.247992  1693 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:13.253026 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:13.253690 27316 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.290759 26685 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:10:13.293881 27316 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 17.
I20260709 13:10:13.295394 26575 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b; no voters: 
I20260709 13:10:13.305642  1376 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:13.307765  1376 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Becoming Leader. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:13.308697  1376 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:13.507589 26510 catalog_manager.cc:5697] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.509266 26510 catalog_manager.cc:5697] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 4 to 11, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 16 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:13.510725 26510 catalog_manager.cc:5697] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 20 to 25, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 25 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.514530 26510 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 19, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.520979 26510 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 18 to 22, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 22 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.522428 26510 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 6 to 19, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.527787 26510 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 22. New cstate: current_term: 22 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.529251 26510 catalog_manager.cc:5697] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 15 to 18, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 18 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.530616 26510 catalog_manager.cc:5697] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 19 to 21, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 21 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.577137 26510 catalog_manager.cc:5697] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.580439 26510 catalog_manager.cc:5697] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 16 to 17, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 17 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.581983 26510 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 23, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 23 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.583287 26510 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 22, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.613824 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:51502
W20260709 13:10:13.622093 26501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 220) took 35624 ms (client timeout 15000 ms). Trace:
I20260709 13:10:13.639916 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet c04d1d6cb7c54df78a1746de67ce6198 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
W20260709 13:10:13.622561 26501 rpcz_store.cc:269] 0709 13:09:38.014564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.035166 (+ 20602us) service_pool.cc:224] Handling call
0709 13:09:39.327375 (+1292209us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:13.621988 (+34294613us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:13.201978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:13.202494 (+   516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:13.202535 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:10:13.202552 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:13.204076 (+  1524us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:13.204153 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:13.204180 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:10:13.205392 (+  1212us) tablet.cc:701] Row locks acquired
0709 13:10:13.205410 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:13.205560 (+   150us) write_op.cc:270] Start()
0709 13:10:13.205676 (+   116us) write_op.cc:276] Timestamp: P: 1783602613205504 usec, L: 0
0709 13:10:13.205699 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:13.206349 (+   650us) log.cc:844] Serialized 6797 byte log entry
0709 13:10:13.232250 (+ 25901us) op_driver.cc:464] REPLICATION: finished
0709 13:10:13.304697 (+ 72447us) write_op.cc:301] APPLY: starting
0709 13:10:13.305717 (+  1020us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:13.347651 (+ 41934us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:13.360283 (+ 12632us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:13.408342 (+ 48059us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:13.410193 (+  1851us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:10:13.410243 (+    50us) write_op.cc:312] APPLY: finished
0709 13:10:13.410593 (+   350us) log.cc:844] Serialized 156 byte log entry
0709 13:10:13.416267 (+  5674us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.416432 (+   165us) write_op.cc:454] Released schema lock
0709 13:10:13.416496 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:13.424768 (+  8272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.424816 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":193747,"reported_tablets":52,"spinlock_wait_cycles":714930944,"child_traces":[["op",{"apply.queue_time_us":55794,"apply.run_cpu_time_us":22892,"apply.run_wall_time_us":132747,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":58931,"prepare.run_cpu_time_us":4556,"prepare.run_wall_time_us":24013,"replication_time_us":26392,"thread_start_us":78806,"threads_started":2}]]}
I20260709 13:10:13.621891 26510 catalog_manager.cc:5697] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 17 to 19, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 19 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.652719 26510 catalog_manager.cc:5697] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 17 to 23, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 23 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.654515 26510 catalog_manager.cc:5697] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 20, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 20 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.656111 26510 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 17 to 20, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 20 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.672382 26510 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 23, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 23 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.673915 26510 catalog_manager.cc:5697] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 16, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 16 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.675552 26510 catalog_manager.cc:5697] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.693471 26510 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 22, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 22 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.694936 26510 catalog_manager.cc:5697] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 16 to 20, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.696692 26510 catalog_manager.cc:5697] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 8 to 13, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 13 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.698314 26510 catalog_manager.cc:5697] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 16, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 16 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.723912 26510 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 24, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 24 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.725313 26510 catalog_manager.cc:5697] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 8 to 13, VOTER b9e8388401a74e84a2cc880930412709 (127.24.232.194) evicted. New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:13.726497  1695 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:13.726758 26510 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.727072  1695 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:13.728014 26510 catalog_manager.cc:5697] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 15, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 15 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.729444 26510 catalog_manager.cc:5697] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.730736 26510 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 11 to 23. New cstate: current_term: 23 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.731688 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:13.735494 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "687d192f79a044ce838f0bf292f0c09f" is_pre_election: true
I20260709 13:10:13.738279 26650 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:13.739017  1684 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:13.740935  1695 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:13.742269 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:13.748263 26510 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 12 to 18, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 18 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.749871 26510 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.777047 27318 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:13.751471 26510 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.779867  1303 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:13.781049 26510 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.782747 26510 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:13.818478 26685 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Refusing update from remote peer 687d192f79a044ce838f0bf292f0c09f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:13.820706  1693 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:14.325392 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.348533 26510 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 222) took 1406 ms. Trace:
I20260709 13:10:14.348975 26510 rpcz_store.cc:276] 0709 13:10:12.941894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.942175 (+   281us) service_pool.cc:224] Handling call
0709 13:10:14.348443 (+1406268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:13.947044 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:13.952342 (+  5298us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:13.952374 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:10:13.952389 (+    15us) tablet.cc:662] Decoding operations
0709 13:10:13.959297 (+  6908us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:13.959390 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:13.959414 (+    24us) tablet.cc:685] Acquiring locks for 35 operations
0709 13:10:13.977285 (+ 17871us) tablet.cc:701] Row locks acquired
0709 13:10:13.977307 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:13.977458 (+   151us) write_op.cc:270] Start()
0709 13:10:13.977580 (+   122us) write_op.cc:276] Timestamp: P: 1783602613977412 usec, L: 0
0709 13:10:13.977605 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:13.978289 (+   684us) log.cc:844] Serialized 13816 byte log entry
0709 13:10:14.027915 (+ 49626us) op_driver.cc:464] REPLICATION: finished
0709 13:10:14.110845 (+ 82930us) write_op.cc:301] APPLY: starting
0709 13:10:14.110925 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:14.186260 (+ 75335us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:14.186349 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:14.251239 (+ 64890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:14.251651 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=70,key_file_lookups=70,delta_file_lookups=0,mrs_lookups=0
0709 13:10:14.251714 (+    63us) write_op.cc:312] APPLY: finished
0709 13:10:14.252227 (+   513us) log.cc:844] Serialized 300 byte log entry
0709 13:10:14.259823 (+  7596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.260110 (+   287us) write_op.cc:454] Released schema lock
0709 13:10:14.260189 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.266962 (+  6773us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.266991 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63650,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":80487,"apply.run_cpu_time_us":41677,"apply.run_wall_time_us":156102,"cfile_cache_hit":142,"cfile_cache_hit_bytes":150357,"num_ops":35,"prepare.queue_time_us":71029,"prepare.run_cpu_time_us":7744,"prepare.run_wall_time_us":76870,"replication_time_us":50167,"spinlock_wait_cycles":2304,"thread_start_us":119953,"threads_started":2}]]}
I20260709 13:10:14.399544 26502 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 16 to 19, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 19 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.441466 26502 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f reported cstate change: term changed from 14 to 16, leader changed from e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 16 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.460813 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:14.461452 26612 raft_consensus.cc:606] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:14.468901 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:14.469421 26612 raft_consensus.cc:606] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:14.482327 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:14.482894 26612 raft_consensus.cc:606] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Received request to transfer leadership to TS b9e8388401a74e84a2cc880930412709
I20260709 13:10:14.489390 26612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b"
dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
mode: GRACEFUL
new_leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:36480
I20260709 13:10:14.489951 26612 raft_consensus.cc:606] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Received request to transfer leadership to TS e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:14.491390 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:35680
I20260709 13:10:14.492583 26672 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with delete_type TABLET_DATA_TOMBSTONED (TS b9e8388401a74e84a2cc880930412709 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35680
I20260709 13:10:14.498394  1721 tablet_replica.cc:333] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:14.500649  1721 raft_consensus.cc:2243] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.503250 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:10:14.504382  1690 raft_consensus.cc:670] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:10:14.510002 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.510389 26510 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 16 to 21, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 21 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:14.512072 26510 catalog_manager.cc:5697] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:14.519469  1721 raft_consensus.cc:2272] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.534672  1721 ts_tablet_manager.cc:1916] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.539721 26506 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 14 to 15, leader changed from 77c617823f2e4a938ef247a8924e299b (127.24.232.196) to 687d192f79a044ce838f0bf292f0c09f (127.24.232.193). New cstate: current_term: 15 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:14.557013 26502 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with cas_config_opid_index 8: aborting the task: latest config opid_index 13; task opid_index 8
I20260709 13:10:14.559033  1712 raft_consensus.cc:993] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
W20260709 13:10:14.559484 26502 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 217) took 25929 ms (client timeout 15000 ms). Trace:
I20260709 13:10:14.559641  1712 raft_consensus.cc:1081] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:14.562680 26685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:14.563272 26685 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:10:14.559960 26502 rpcz_store.cc:269] 0709 13:09:48.630510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.631415 (+   905us) service_pool.cc:224] Handling call
0709 13:09:50.113760 (+1482345us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:14.559375 (+24445615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:14.461171 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:14.461725 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:14.461764 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:10:14.461786 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:14.462197 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:14.462259 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:14.462289 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:14.462604 (+   315us) tablet.cc:701] Row locks acquired
0709 13:10:14.462625 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:14.462779 (+   154us) write_op.cc:270] Start()
0709 13:10:14.462890 (+   111us) write_op.cc:276] Timestamp: P: 1783602614462731 usec, L: 0
0709 13:10:14.462913 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:14.463529 (+   616us) log.cc:844] Serialized 935 byte log entry
0709 13:10:14.466338 (+  2809us) op_driver.cc:464] REPLICATION: finished
0709 13:10:14.466668 (+   330us) write_op.cc:301] APPLY: starting
0709 13:10:14.466769 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:14.468198 (+  1429us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:14.468316 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:14.469732 (+  1416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:14.469900 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:10:14.469950 (+    50us) write_op.cc:312] APPLY: finished
0709 13:10:14.470151 (+   201us) log.cc:844] Serialized 33 byte log entry
0709 13:10:14.470310 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.470398 (+    88us) write_op.cc:454] Released schema lock
0709 13:10:14.470441 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.470842 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.470872 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":848237,"reported_tablets":52,"spinlock_wait_cycles":107865472,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":4129,"apply.run_wall_time_us":4129,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2657,"prepare.run_wall_time_us":5049,"replication_time_us":3309}]]}
I20260709 13:10:14.563638 26685 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:14.568112 26506 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47192 (request call id 122) took 1927 ms. Trace:
I20260709 13:10:14.568506 26506 rpcz_store.cc:276] 0709 13:10:12.641024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.641193 (+   169us) service_pool.cc:224] Handling call
0709 13:10:14.568054 (+1926861us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:14.548459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:14.549013 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:14.549065 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:10:14.549079 (+    14us) tablet.cc:662] Decoding operations
0709 13:10:14.549428 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:14.549485 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:14.549514 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:14.549702 (+   188us) tablet.cc:701] Row locks acquired
0709 13:10:14.549715 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:10:14.549861 (+   146us) write_op.cc:270] Start()
0709 13:10:14.549965 (+   104us) write_op.cc:276] Timestamp: P: 1783602614549813 usec, L: 0
0709 13:10:14.549980 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:10:14.550599 (+   619us) log.cc:844] Serialized 539 byte log entry
0709 13:10:14.552496 (+  1897us) op_driver.cc:464] REPLICATION: finished
0709 13:10:14.552927 (+   431us) write_op.cc:301] APPLY: starting
0709 13:10:14.553000 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:14.553764 (+   764us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:14.553844 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:14.554475 (+   631us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:14.554635 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:10:14.554676 (+    41us) write_op.cc:312] APPLY: finished
0709 13:10:14.554842 (+   166us) log.cc:844] Serialized 25 byte log entry
0709 13:10:14.554983 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.555060 (+    77us) write_op.cc:454] Released schema lock
0709 13:10:14.555094 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.555423 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.555450 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16903,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":2452,"apply.run_wall_time_us":2452,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":2400,"prepare.run_wall_time_us":2401,"replication_time_us":2406}]]}
I20260709 13:10:14.581770 26685 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.585302 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:14.585898 26609 raft_consensus.cc:3055] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:14.586199 26609 raft_consensus.cc:740] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:14.586944 26609 consensus_queue.cc:260] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.588151 26685 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:14.588205 26609 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:14.589133 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:14.589694 26761 raft_consensus.cc:3060] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:14.613705 26506 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "687d192f79a044ce838f0bf292f0c09f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:14.700625 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 92199.1us
I20260709 13:10:14.709286  1721 ts_tablet_manager.cc:1929] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:10:14.709820  1721 log.cc:1199] T 2da4a43c4ca64471b27b22ea1a167d13 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/2da4a43c4ca64471b27b22ea1a167d13
I20260709 13:10:14.712432  1721 tablet_replica.cc:333] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:14.712498 26761 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:14.717852 26686 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:14.719439  1721 raft_consensus.cc:2243] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.720758  1721 raft_consensus.cc:2272] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:14.722229 26509 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 215) took 17766 ms (client timeout 15000 ms). Trace:
W20260709 13:10:14.722657 26509 rpcz_store.cc:269] 0709 13:09:57.021210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.180615 (+159405us) service_pool.cc:224] Handling call
0709 13:10:14.722044 (+17541429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249,"reported_tablets":53}
I20260709 13:10:14.725533  1721 ts_tablet_manager.cc:1916] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.729161  1376 raft_consensus.cc:993] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:10:14.738703 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 2da4a43c4ca64471b27b22ea1a167d13 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:14.744117  1376 raft_consensus.cc:1081] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Signalling peer e09ea9b455894a0189912a7b9b6b2f84 to start an election
I20260709 13:10:14.745651  1712 raft_consensus.cc:993] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:14.746148  1303 raft_consensus.cc:1081] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:14.740355 26651 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:14.747627  1684 raft_consensus.cc:2804] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:14.747903 26761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b"
dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
 from {username='slave'} at 127.0.0.1:35540
I20260709 13:10:14.748380  1684 raft_consensus.cc:697] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 22 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:14.753098  1684 consensus_queue.cc:237] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.755897 26761 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.757139 26761 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.777195 26609 raft_consensus.cc:2468] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:14.779254 26685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:14.779935 26685 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.780328 26685 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:14.775396 26761 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:14.798036 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:14.798684 27318 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.804401 26761 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:14.804237 26685 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.806815 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
W20260709 13:10:14.807086 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 129255us
W20260709 13:10:14.809907 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 52208.5us
I20260709 13:10:14.807453 26604 raft_consensus.cc:3055] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:14.812309 26604 raft_consensus.cc:740] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:14.813104 26604 consensus_queue.cc:260] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:14.814453 26604 raft_consensus.cc:3060] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.817984 27318 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:14.836261 26685 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:14.837990 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:14.838980 26609 raft_consensus.cc:3055] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:14.839428 26609 raft_consensus.cc:740] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:14.819934 26724 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:14.841500  1224 raft_consensus.cc:2804] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:14.841243 26609 consensus_queue.cc:260] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.842900 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:14.856061 26761 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:14.856442 26609 raft_consensus.cc:3060] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:14.858081 26604 raft_consensus.cc:2468] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:14.868854 26761 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:10:14.870349 26651 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:14.871853  1690 raft_consensus.cc:2804] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:14.872418  1690 raft_consensus.cc:697] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 23 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:14.873378  1690 consensus_queue.cc:237] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:14.878739  1721 ts_tablet_manager.cc:1929] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:10:14.889784 26609 raft_consensus.cc:2468] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:10:14.889988 27318 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:14.885658  1721 log.cc:1199] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P b9e8388401a74e84a2cc880930412709: Deleting WAL directory at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/wals/3a6cdf3163c8419d9d0c3ee399cc76d1
I20260709 13:10:14.891757 26752 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:14.907544  1224 raft_consensus.cc:697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:14.909303  1224 consensus_queue.cc:237] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:14.918188  1726 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:14.932650 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
W20260709 13:10:14.987797 26496 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 56679.3us
I20260709 13:10:15.046975  1725 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:10:15.067911 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 84411.2us
W20260709 13:10:15.223189 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61859.2us
W20260709 13:10:15.240970  1734 log.cc:927] Time spent T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:10:15.243058  1736 log.cc:927] Time spent T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:10:15.271160 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 142315us
W20260709 13:10:15.285212 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 51676.7us
I20260709 13:10:15.287138 26759 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:15.349620  1749 raft_consensus.cc:993] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: : Instructing follower b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:15.350215  1749 raft_consensus.cc:1081] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Signalling peer b9e8388401a74e84a2cc880930412709 to start an election
I20260709 13:10:15.366997 26509 catalog_manager.cc:5697] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 18 to 19, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 19 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.376310  1745 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:15.379565 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 45259.5us
W20260709 13:10:15.337553 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 182343us
W20260709 13:10:15.421406 26504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 216) took 47042 ms (client timeout 15000 ms). Trace:
W20260709 13:10:15.421911 26504 rpcz_store.cc:269] 0709 13:09:28.378654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.379030 (+   376us) service_pool.cc:224] Handling call
0709 13:10:15.421192 (+47042162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27,"reported_tablets":52}
I20260709 13:10:15.422425 26609 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:10:15.437222 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 160642us
I20260709 13:10:15.446998 27316 raft_consensus.cc:1275] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:15.441712  1727 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:10:15.480216  1224 consensus_queue.cc:1048] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:15.485903 26682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "830acec67d794b8f8517f8240289bd62"
dest_uuid: "b9e8388401a74e84a2cc880930412709"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:15.486568 26682 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.486944 26682 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.490816 26759 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:15.541636 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.540719 26682 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:15.583531 26682 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:15.583325  1732 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 9 to 13, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:15.589442 26756 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 9 to 13, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:15.591567 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:15.592177 26761 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.608026 26611 raft_consensus.cc:1275] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:15.618073 26761 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:15.559968  1745 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:10:15.619279 26651 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:15.644748 26611 raft_consensus.cc:1275] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:15.651763  1751 raft_consensus.cc:2804] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:15.652383  1751 raft_consensus.cc:697] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:15.653242  1751 consensus_queue.cc:237] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:15.661294 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "687d192f79a044ce838f0bf292f0c09f"
I20260709 13:10:15.661963 26609 raft_consensus.cc:3055] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:15.662266 26609 raft_consensus.cc:740] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:15.656898 27318 raft_consensus.cc:2955] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 9 to 13, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:15.673003 26609 consensus_queue.cc:260] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:15.677801 26609 raft_consensus.cc:3060] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.688418  1752 consensus_queue.cc:1048] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:10:15.751336 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 61406.4us
I20260709 13:10:15.720122  1728 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:15.754526  1728 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:15.708462 26609 raft_consensus.cc:2468] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:15.757637  1728 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:15.758612 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:15.779738 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:15.783627 26576 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:15.784945 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:15.793386  1748 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:15.771203  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35680 (request call id 2) took 1063 ms. Trace:
W20260709 13:10:15.858495 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 191875us
I20260709 13:10:15.861959 26685 raft_consensus.cc:1240] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:15.863199  1745 consensus_queue.cc:1048] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:10:15.836975  1732 rpcz_store.cc:276] 0709 13:10:14.708203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.708328 (+   125us) service_pool.cc:224] Handling call
0709 13:10:14.737405 (+ 29077us) log.cc:844] Serialized 508 byte log entry
0709 13:10:14.877302 (+139897us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b54002a33a0. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31f9571 00007f40f3209142 00007f40f31e9eaa 00007f40f31f0d53 00007f40f31f0cd9 00007f40f31f0c69 00007f40f31f0c31 00007f40f31efdfd 000000000038f354 000000000038f199 00007f40f01a3475
0709 13:10:15.771108 (+893806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3527,"raft.queue_time_us":12155,"raft.run_cpu_time_us":2760,"raft.run_wall_time_us":103252,"spinlock_wait_cycles":16329088,"thread_start_us":66373,"threads_started":1,"wal-append.queue_time_us":114640}
I20260709 13:10:15.895363 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 272d473e821e4c15a9f3fa0471adfdc6 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:10:15.922348 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:10:15.921324 26509 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 9 to 13, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 14 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:15.931252 26724 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:15.988929 26650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 55712.2us
W20260709 13:10:15.989372 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.007644 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 76410.1us
I20260709 13:10:16.086555 26507 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 218) took 9369 ms. Trace:
I20260709 13:10:16.087037 26507 rpcz_store.cc:276] 0709 13:10:06.717375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.265150 (+547775us) service_pool.cc:224] Handling call
0709 13:10:07.889414 (+624264us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b5400002210. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016bb71 00007f40f016c0b2 00007f40f90e5a89 00007f40f907dda6 00007f40f904f088 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc
0709 13:10:07.961449 (+ 72035us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54000ae6d4. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f31fa090 00007f40f3298f3a 00007f40f904f1cc 00007f40f914d37e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:16.086457 (+8125008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2773,"reported_tablets":52,"spinlock_wait_cycles":114746496}
W20260709 13:10:16.110823 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.191110 26724 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.195895 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.198326 26724 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.199472 26650 consensus_peers.cc:597] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.199222 26724 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.204679 26724 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.204998 26650 consensus_peers.cc:597] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.203922 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:10:16.207347 26724 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.207933 26650 consensus_peers.cc:597] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.208786 26650 consensus_peers.cc:597] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.211055 26724 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.209311 26650 consensus_peers.cc:597] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.215785 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.215948 26650 consensus_peers.cc:597] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.227519 26650 consensus_peers.cc:597] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.232192 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.231014 26504 catalog_manager.cc:5697] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 21 to 22, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 22 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
I20260709 13:10:16.243640 26504 catalog_manager.cc:5697] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 22 to 23, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 23 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:10:16.242447 26650 consensus_peers.cc:597] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.248456 26650 consensus_peers.cc:597] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.251137 26650 consensus_peers.cc:597] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.257766 26650 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.259215 26761 raft_consensus.cc:1275] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:10:16.272073 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.273036 26724 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.276072 26724 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.279755 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.264191  1778 consensus_queue.cc:1048] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:10:16.300765 27284 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.311343 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.333250 26724 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.334860 27284 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.338539 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.342659 26650 consensus_peers.cc:597] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.343535 26650 consensus_peers.cc:597] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.358129 26508 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 272d473e821e4c15a9f3fa0471adfdc6 with cas_config_opid_index 9: aborting the task: latest config opid_index 13; task opid_index 9
I20260709 13:10:16.361989 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35680
I20260709 13:10:16.368110 26508 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 216) took 4273 ms. Trace:
I20260709 13:10:16.370755 26508 rpcz_store.cc:276] 0709 13:10:12.091167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.337009 (+245842us) service_pool.cc:224] Handling call
0709 13:10:12.447517 (+110508us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b5400002210. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f002bdb1 00007f40f016c640 00007f40f9043b76 00007f40f914dc3e 00007f40f760e2a4 00007f40f760e232 00007f40f760e161 00007f40f760e0dc 00007f40f760d392 00007f40f15cb48c 00007f40f15ca8c6
0709 13:10:16.364024 (+3916507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2776,"reported_tablets":53,"spinlock_wait_cycles":20917120}
I20260709 13:10:16.374981 26672 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:35680
W20260709 13:10:16.402875 26650 consensus_peers.cc:597] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.480584 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 2da4a43c4ca64471b27b22ea1a167d13 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
W20260709 13:10:16.486177 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 48335.2us
W20260709 13:10:16.485183 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 47924.1us
W20260709 13:10:16.528718 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:16.579370 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 88299.6us
I20260709 13:10:16.565086 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
W20260709 13:10:16.595381 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 105522us
I20260709 13:10:16.624872 26504 catalog_manager.cc:5697] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } }
W20260709 13:10:16.667435 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 68284.8us
W20260709 13:10:16.677181 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 77944.5us
I20260709 13:10:16.662401  1740 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:16.690791  1740 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:16.702889  1740 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:16.706202 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:16.710381 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:16.721053 26577 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:16.726081  1798 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:16.816736 26575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 68251.1us
W20260709 13:10:16.822739 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 73828.6us
I20260709 13:10:16.904116  1740 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.905460  1740 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:16.907965  1759 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:16.908924  1759 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:16.912135  1759 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:16.915849  1800 raft_consensus.cc:493] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:16.917958  1800 raft_consensus.cc:515] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:16.918788 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:16.921382  1800 leader_election.cc:290] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:16.922750  1740 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:16.940380 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed7d6e90f44f25b6d48f7d3fd0b857" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:16.943455 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:16.947826 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:16.949923 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae2b4b46548d6b153c9953ffe1708" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:16.972884 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:16.977077  1797 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:16.978008  1797 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:16.980893  1797 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:16.995802 26576 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:16.997002  1797 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:16.998025 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 50415us
I20260709 13:10:17.006750 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:17.025539 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 104306us
I20260709 13:10:17.028884 26751 tablet_service.cc:1558] Processing DeleteTablet for tablet c04d1d6cb7c54df78a1746de67ce6198 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:51502
W20260709 13:10:17.030905 26503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52286 (request call id 221) took 19634 ms (client timeout 15000 ms). Trace:
W20260709 13:10:17.031471 26503 rpcz_store.cc:269] 0709 13:09:57.396577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.305275 (+2908698us) service_pool.cc:224] Handling call
0709 13:10:17.030693 (+16725418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154110,"reported_tablets":52}
I20260709 13:10:17.050767 26495 catalog_manager.cc:5028] TS e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): tablet c04d1d6cb7c54df78a1746de67ce6198 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:17.052282  1797 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.053202  1797 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.055567  1797 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.056216 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.063220  1800 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.064021  1800 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.069779  1800 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.078089 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.086675 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.130110  1797 raft_consensus.cc:493] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.131088  1797 raft_consensus.cc:515] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.134271  1797 leader_election.cc:290] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.141870  1797 raft_consensus.cc:493] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
W20260709 13:10:17.143831 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 66825.1us
I20260709 13:10:17.160535 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.159245 26577 leader_election.cc:304] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.158854  1800 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.172685  1800 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.188237  1759 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.189034  1759 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.190651  1800 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.191257  1800 raft_consensus.cc:493] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.191938  1800 raft_consensus.cc:515] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.194476  1800 leader_election.cc:290] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.196724 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.199954  1797 raft_consensus.cc:515] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.191350  1759 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.202636  1792 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.203291  1792 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:17.214066 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 54875.7us
I20260709 13:10:17.223918 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.218724  1759 raft_consensus.cc:2749] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.220768  1792 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.236151 26577 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.238360 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.238792 26675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2da4a43c4ca64471b27b22ea1a167d13 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35680
I20260709 13:10:17.239236  1792 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.239809 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.237360 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.239921  1792 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.242926  1797 leader_election.cc:290] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.245486  1792 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.256266 26756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.259975  1798 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:17.256026 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.261816 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.263485  1801 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.264667 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.266553 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.274240  1801 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.275122 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.274995  1801 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.277398  1801 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.277884 26505 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 272d473e821e4c15a9f3fa0471adfdc6 with cas_config_opid_index 9: aborting the task: latest config opid_index 13; task opid_index 9
W20260709 13:10:17.280557 26505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 214) took 41305 ms (client timeout 15000 ms). Trace:
I20260709 13:10:17.280578 26672 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:35680
W20260709 13:10:17.281160 26505 rpcz_store.cc:269] 0709 13:09:35.974771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.975030 (+   259us) service_pool.cc:224] Handling call
0709 13:10:17.280467 (+41305437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61745,"reported_tablets":53}
I20260709 13:10:17.281219  1801 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.282231  1801 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.286489 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.286635 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463e1353202746e9b791d1dc0cc818f8" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.289871 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.291042 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.292223  1803 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.298381 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.301859 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.291579  1801 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.305275 26576 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.312628 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d46fffe7ef44d4c95a01a5e1b261924" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.315973 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 2da4a43c4ca64471b27b22ea1a167d13 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:17.324934 26496 catalog_manager.cc:5028] TS b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): tablet 3a6cdf3163c8419d9d0c3ee399cc76d1 (table test-workload [id=53065f01274e4d70b03e81ed71365825]) successfully deleted
I20260709 13:10:17.319471  1803 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:17.329066 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.330902 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.336905 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432efd5ca613406d884cf1deda00ed97" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:17.337064 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:17.339098  1803 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.339794  1803 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.341936  1803 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.343519  1792 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.345575 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.346675 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.349375 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.348382  1801 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.353255  1800 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:17.354768  1801 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.344097  1792 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.357506  1792 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.357833  1801 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.358492  1762 raft_consensus.cc:493] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.364396  1762 raft_consensus.cc:515] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.365069  1792 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.365850  1792 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.366999  1762 leader_election.cc:290] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.358979  1803 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:17.359107  1800 raft_consensus.cc:493] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.368009  1800 raft_consensus.cc:515] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.361202  1797 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.369920  1797 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.372592  1762 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.373246  1762 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.374593  1803 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.375232  1803 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.375944 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.379166 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.380743 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.380949  1803 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.382438  1762 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.382997  1762 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.383606  1762 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.385785  1762 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.390251 26509 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52272 (request call id 219) took 1151 ms. Trace:
I20260709 13:10:17.391069  1801 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.391691  1801 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.391933  1797 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.392033  1805 raft_consensus.cc:493] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.392499  1803 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.392850  1805 raft_consensus.cc:515] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.395231  1805 leader_election.cc:290] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.397097  1805 raft_consensus.cc:493] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:17.397723  1805 raft_consensus.cc:515] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:17.398445  1800 leader_election.cc:290] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.396973  1801 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.399279 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.399834  1805 leader_election.cc:290] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:17.390709 26509 rpcz_store.cc:276] 0709 13:10:16.239143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.239264 (+   121us) service_pool.cc:224] Handling call
0709 13:10:17.390045 (+1150781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31616,"reported_tablets":28}
I20260709 13:10:17.393244  1803 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.403779  1803 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.407228 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.407891 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.408653 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.413687 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f65a3c62194ad385b5c3a9d0b22e2b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.413923 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.414414 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3f44630f03419aaf2afaa55030ded4" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.415006 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.415762 27314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:17.416326 26575 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.417202 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.417780 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.417780 26575 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.420174 26575 leader_election.cc:304] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.420468  1805 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:17.420205 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.421341  1805 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:17.422152  1805 raft_consensus.cc:2749] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:17.423166  1801 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.423563 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.423774  1801 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.426043  1801 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.426630 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.427910 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.429072 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.431746 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.433130 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.396934  1792 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.442806 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.443054  1762 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:17.443866  1797 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:17.443936  1762 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.444759  1797 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:17.446563  1762 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.448700  1797 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:17.448817  1792 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:17.450352 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.451318  1797 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:17.459828 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.462028 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:17.451907 26577 leader_election.cc:304] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.470253  1801 raft_consensus.cc:2749] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.478444 26577 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.479907  1805 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:17.495718 26577 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.501518  1805 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:17.503803 26577 leader_election.cc:304] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:17.504559  1805 raft_consensus.cc:2749] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.514285 26577 leader_election.cc:304] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.524457  1805 raft_consensus.cc:2749] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.528862 26577 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:17.530120  1797 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.535542 26577 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.536394  1805 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.537708 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.538429  1805 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.539808 26577 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:17.540759  1805 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.565548 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2d7a4b795a4095a12bf45ed815682e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.580412 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589b7d1d64684da8b771d0b30a73579f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.582928 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce09a05f88f44c7188fd7b1975336615" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.585525 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d4a32f52541d5a619dddf54757a10" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:17.588502 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a33496b2c4716b8e1e571c2bd3a5e" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:17.822219 25507 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 26637)
I20260709 13:10:18.106455  1808 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.107242  1808 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.117059  1807 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:18.328514  1808 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.117751  1807 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:18.336054  1807 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:18.341012  1808 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:18.341609  1808 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.344179  1808 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.355374 26577 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:18.355949 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:18.359885  1807 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.361011 26577 leader_election.cc:304] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.362262 26577 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.363262 26577 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.364253 26577 leader_election.cc:304] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.366052  1807 raft_consensus.cc:2749] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.366967  1807 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.367800  1807 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.368517  1807 raft_consensus.cc:2749] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.406457 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:18.409020 25507 tablet_replica.cc:333] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.410166  1797 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:18.410841 25507 raft_consensus.cc:2243] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.412721 25507 raft_consensus.cc:2272] T 8a056abe51184f1d85dc02b3ff21b29f P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.421703 25507 tablet_replica.cc:333] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.423346 25507 raft_consensus.cc:2243] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.424234 25507 raft_consensus.cc:2272] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.410887  1797 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.436043  1797 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.466921 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:18.472438  1751 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.473313  1751 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:18.484246 26650 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:18.493988 26576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.529585  1751 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.547029  1822 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:18.560613  1822 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.563027  1822 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.553013 25507 tablet_replica.cc:333] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.565083 25507 raft_consensus.cc:2243] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.566017 25507 raft_consensus.cc:2272] T 7c3f44630f03419aaf2afaa55030ded4 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.583019  1818 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.583654  1818 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.585780  1818 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.590853  1815 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.591419  1815 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:18.602504 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c820b8b86e594946bfb5f18fbb98296d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.603914  1815 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:18.604077 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2457711189fa40e5bb77aa8997eca24b" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.605400 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.602592  1718 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.605850 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e750113ebc4804835df06f3637c083" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.607458 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:18.609927 26650 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.608215 26680 raft_consensus.cc:2468] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687d192f79a044ce838f0bf292f0c09f in term 22.
I20260709 13:10:18.612675  1718 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.617316  1718 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:18.620810 25507 tablet_replica.cc:333] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.622211 25507 raft_consensus.cc:2243] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.622999 25507 raft_consensus.cc:2272] T 1e0a742797f949c583d86fd5006dab3d P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.627393 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.634523 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:18.636723 26558 auto_rebalancer.cc:629] Failed to schedule move for tablet 6d135ef1afa441eb97645c3639222a71: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.639235 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.639901 26757 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:18.642784 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.644877 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:18.653266 26541 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0400 after lost signal to thread 25510
W20260709 13:10:18.653697 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 69566us
W20260709 13:10:18.654439 26541 debug-util.cc:398] Leaking SignalData structure 0x7b0800324800 after lost signal to thread 26544
W20260709 13:10:18.655958 26541 debug-util.cc:398] Leaking SignalData structure 0x7b0800034ba0 after lost signal to thread 26711
W20260709 13:10:18.659091 26541 debug-util.cc:398] Leaking SignalData structure 0x7b0800245ea0 after lost signal to thread 27345
W20260709 13:10:18.654455 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 119472us
I20260709 13:10:18.667189 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.667795 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:18.669401 26650 leader_election.cc:336] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.670688 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.669438  1718 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:18.672259  1718 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.674376  1718 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:18.679388 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830acec67d794b8f8517f8240289bd62" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.682740 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:18.683735  1824 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:18.684136  1824 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.684479  1824 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:18.684959 26650 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.685448 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:18.690891 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.693194 25507 tablet_replica.cc:333] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.694468 25507 raft_consensus.cc:2243] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.695561 26757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c94b0ed2c04d78b5e39ffdf89ff51c" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.694700  1824 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.697837  1815 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.698796 26651 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.699573  1815 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.699363 26577 leader_election.cc:304] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.701167  1798 raft_consensus.cc:2749] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.701472 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81a23e6878f49ccb8b9f964611190bc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.703143 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:18.703227 26724 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.703949 26724 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.704032 26577 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.704806  1823 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.704836  1798 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.706223 26577 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:18.707253 26724 leader_election.cc:336] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.695542 25507 raft_consensus.cc:2272] T 584ae2b4b46548d6b153c9953ffe1708 P 687d192f79a044ce838f0bf292f0c09f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.713975 26726 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.714905  1823 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.708122  1824 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:18.731623 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 63941.9us
W20260709 13:10:18.733430 26575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.733889  1798 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:18.733582 26577 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.734898  1825 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:18.735739  1798 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:18.736156  1825 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.738499  1825 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:18.739289 26577 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709; no voters: e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.741590 26651 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.742679  1824 raft_consensus.cc:2749] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:18.744134 26724 leader_election.cc:336] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.745234  1808 raft_consensus.cc:2804] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:18.745826  1808 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Starting leader election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:18.746201  1808 raft_consensus.cc:3060] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:18.745208 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:18.749080 25507 tablet_replica.cc:333] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.750048 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89abadd4c4c4ff0b1ac684dff13b140" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.750317 25507 raft_consensus.cc:2243] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.760114 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.767527  1823 raft_consensus.cc:2749] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.765331  1808 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:18.751657 25507 raft_consensus.cc:2272] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.774374 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:18.777032  1808 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:18.777810 26577 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:18.779242  1798 raft_consensus.cc:2706] T 272d473e821e4c15a9f3fa0471adfdc6 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Received pre-election callback for term 15 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:10:18.780021 26576 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.781232 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:18.782346  1801 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.781967 26758 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:18.782575 26576 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:18.786324 26650 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:18.786841  1806 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.786943 26650 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.788767  1815 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.787467 26576 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.792563  1798 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:18.794601 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af410dd1881e4b8b87c381cfbb16f9f7" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:18.794777 25507 tablet_replica.cc:333] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.795855 25507 raft_consensus.cc:2243] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.796319 26576 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:18.796617 25507 raft_consensus.cc:2272] T 2457711189fa40e5bb77aa8997eca24b P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.801017 25507 tablet_replica.cc:333] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.797139  1798 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:18.813633 25507 raft_consensus.cc:2243] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.823902 25507 raft_consensus.cc:2272] T 8f4358ddab16449aa08eeb30a7b58bc2 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.826771 26678 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:10:18.827848 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af410dd1881e4b8b87c381cfbb16f9f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:18.828899 25507 tablet_replica.cc:333] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.829198  1825 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:18.830029 25507 raft_consensus.cc:2243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.830814 25507 raft_consensus.cc:2272] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:18.833588 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:18.834329 25507 tablet_replica.cc:333] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.835633 25507 raft_consensus.cc:2243] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.837571 25507 raft_consensus.cc:2272] T a2c94b0ed2c04d78b5e39ffdf89ff51c P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.842288 25507 tablet_replica.cc:333] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.847369 25507 raft_consensus.cc:2243] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.849550 25507 raft_consensus.cc:2272] T 6c24ff1c29324f5a8133ee5214778e97 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.853912 25507 tablet_replica.cc:333] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.856324 25507 raft_consensus.cc:2243] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.857043 25507 raft_consensus.cc:2272] T ff2d7a4b795a4095a12bf45ed815682e P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.882162 25507 tablet_replica.cc:333] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.883193 25507 raft_consensus.cc:2243] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.885764 25507 raft_consensus.cc:2272] T 6d135ef1afa441eb97645c3639222a71 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.891525  1821 raft_consensus.cc:2955] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:18.899266 26686 raft_consensus.cc:2955] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
W20260709 13:10:18.901757 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:18.910862 25507 tablet_replica.cc:333] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.918567 25507 raft_consensus.cc:2243] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.924775 25507 raft_consensus.cc:2272] T 839ee616b28745bca2748a7ec4f718dd P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.930104 25507 tablet_replica.cc:333] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.930627  1806 raft_consensus.cc:493] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:18.948055  1806 raft_consensus.cc:515] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:18.949553 25507 raft_consensus.cc:2243] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.946044  1801 raft_consensus.cc:493] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:18.956310 25507 raft_consensus.cc:2272] T 6d46fffe7ef44d4c95a01a5e1b261924 P 687d192f79a044ce838f0bf292f0c09f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.956043  1801 raft_consensus.cc:515] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:18.958526  1801 leader_election.cc:290] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:18.959229  1798 raft_consensus.cc:493] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:18.959838  1798 raft_consensus.cc:515] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:18.960310 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:18.961506 25507 tablet_replica.cc:333] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:18.967850  1798 leader_election.cc:290] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:18.950471  1806 leader_election.cc:290] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:18.968523 25507 raft_consensus.cc:2243] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.951123 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:18.951959 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdb199be824317848395c2d8402714" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
W20260709 13:10:18.938068 26650 consensus_peers.cc:597] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:18.966523 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:18.976541 26686 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:18.980201 25507 raft_consensus.cc:2272] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.982985 25507 tablet_replica.cc:333] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.000432 25507 raft_consensus.cc:2243] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.001529 25507 raft_consensus.cc:2272] T af410dd1881e4b8b87c381cfbb16f9f7 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.005553 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8af8f9b5044a94b8f38a96387fc68d" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.007252 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da4a43c4ca64471b27b22ea1a167d13" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.011053 26576 leader_election.cc:304] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.016963 25507 tablet_replica.cc:333] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
W20260709 13:10:19.017652 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 65553.8us
I20260709 13:10:19.018014 25507 raft_consensus.cc:2243] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.043519 26576 leader_election.cc:304] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.046792 26576 leader_election.cc:304] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.057660 25507 raft_consensus.cc:2272] T fc2fd83897434de6b94e4a1d72d147dc P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.022624 26509 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.049062  1806 raft_consensus.cc:2749] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:19.053965  1798 raft_consensus.cc:2749] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:19.052026  1808 raft_consensus.cc:2749] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.052186  1801 raft_consensus.cc:493] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:19.064391  1801 raft_consensus.cc:515] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:19.066835  1801 leader_election.cc:290] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:19.068462 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.078574  1808 raft_consensus.cc:493] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:19.085966  1808 raft_consensus.cc:515] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.089210  1808 leader_election.cc:290] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.089777 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.093288 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e56fc6bfb947aeb096f93897752238" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.095845 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04d1d6cb7c54df78a1746de67ce6198" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:19.097800 26575 leader_election.cc:304] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709
I20260709 13:10:19.102034  1806 raft_consensus.cc:2749] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:19.106582 26724 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.107012  1808 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:19.101727 26576 leader_election.cc:304] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.108386  1806 raft_consensus.cc:2749] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:19.108899  1801 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:19.109457  1801 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.109673  1808 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.111649  1801 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.113261  1806 raft_consensus.cc:493] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:19.113902  1806 raft_consensus.cc:515] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.115195 25507 tablet_replica.cc:333] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.116199 25507 raft_consensus.cc:2243] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.117322 25507 raft_consensus.cc:2272] T 5c18e1296ad84de08dd646beec73c343 P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.120936 25507 tablet_replica.cc:333] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.121932 25507 raft_consensus.cc:2243] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.122478 25507 raft_consensus.cc:2272] T 830acec67d794b8f8517f8240289bd62 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.117703 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.124194  1808 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.124671  1806 leader_election.cc:290] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.126453 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.132439 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.137997 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17759cb7022408583bb0bc7c6cc4eba" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.138496 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ea054f23d4b8f8034806c6b565279" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.140640 26577 leader_election.cc:304] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.144351 26577 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.144979  1798 raft_consensus.cc:2749] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.139562  1808 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:19.147609 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034fec0349004eddaaed6e75ce9c56ad" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.148212  1808 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.156813  1803 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:19.136657  1801 raft_consensus.cc:493] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:19.159137  1801 raft_consensus.cc:515] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:19.160081 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.161649  1801 leader_election.cc:290] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:19.162952 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:19.145059  1797 raft_consensus.cc:493] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 77c617823f2e4a938ef247a8924e299b)
I20260709 13:10:19.164708  1797 raft_consensus.cc:515] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:19.167222  1797 leader_election.cc:290] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:19.167898 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.168511 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403ab0598478421094af52431235a129" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:19.170323 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e107aa6da49eb820049f53360fba9" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.170452 26575 leader_election.cc:304] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.172065  1797 raft_consensus.cc:2749] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:19.176043 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6cdf3163c8419d9d0c3ee399cc76d1" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.177788 26576 leader_election.cc:304] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.183465 26577 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.185397 26686 raft_consensus.cc:1240] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Rejecting Update request from peer 687d192f79a044ce838f0bf292f0c09f for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:19.187849  1801 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.189821  1797 raft_consensus.cc:2749] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:19.187320 26577 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:19.191130 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 62286us
I20260709 13:10:19.195364  1797 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:19.202817  1801 consensus_queue.cc:1059] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:19.151467  1808 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:19.206097 26650 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.214933 26759 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:10:19.234849 26650 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78e89d788bee4a128b18985e582217d9. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:19.236193 26650 consensus_peers.cc:597] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.236774  1803 raft_consensus.cc:3055] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:19.237254  1803 raft_consensus.cc:740] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 687d192f79a044ce838f0bf292f0c09f, State: Running, Role: LEADER
I20260709 13:10:19.238226  1803 consensus_queue.cc:260] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.239634  1803 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:19.243849 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.246299  1843 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:19.246798 25507 tablet_replica.cc:333] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
W20260709 13:10:19.249514 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.250156 25507 raft_consensus.cc:2243] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.251368 25507 raft_consensus.cc:2272] T 923e107aa6da49eb820049f53360fba9 P 687d192f79a044ce838f0bf292f0c09f [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.250149 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.256435 25507 tablet_replica.cc:333] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.261889 25507 raft_consensus.cc:2243] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:10:19.263520 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.265319 25507 raft_consensus.cc:2272] T 512480111cea40cebe7a32ae9439af70 P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.278571 25507 tablet_replica.cc:333] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.288465 25507 raft_consensus.cc:2243] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.289378 25507 raft_consensus.cc:2272] T 463e1353202746e9b791d1dc0cc818f8 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.292773 25507 tablet_replica.cc:333] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.293706 25507 raft_consensus.cc:2243] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.294414 25507 raft_consensus.cc:2272] T 4b8af8f9b5044a94b8f38a96387fc68d P 687d192f79a044ce838f0bf292f0c09f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.299701 26752 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:19.302595  1803 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.303102  1803 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.297469  1751 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:19.305186  1803 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.306737 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.308100 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80723b610f4fe18839109c29ed64de" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.309423 26576 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.310551  1803 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:19.318991 25507 tablet_replica.cc:333] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.320014 25507 raft_consensus.cc:2243] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.320586 25507 raft_consensus.cc:2272] T 859da230e1ac4e1dadde67628eb91af0 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.323949 25507 tablet_replica.cc:333] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.324882 25507 raft_consensus.cc:2243] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.325693 25507 raft_consensus.cc:2272] T 034fec0349004eddaaed6e75ce9c56ad P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.328351 25507 tablet_replica.cc:333] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.329397 25507 raft_consensus.cc:2243] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.329960 25507 raft_consensus.cc:2272] T 7b80723b610f4fe18839109c29ed64de P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.335041 25507 tablet_replica.cc:333] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.336074 25507 raft_consensus.cc:2243] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.336805 25507 raft_consensus.cc:2272] T 403ab0598478421094af52431235a129 P 687d192f79a044ce838f0bf292f0c09f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.340224 25507 tablet_replica.cc:333] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.340909  1803 raft_consensus.cc:493] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:19.341482 25507 raft_consensus.cc:2243] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.341507  1803 raft_consensus.cc:515] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.342499 25507 raft_consensus.cc:2272] T 589b7d1d64684da8b771d0b30a73579f P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.346145 25507 tablet_replica.cc:333] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.347033 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.347229 25507 raft_consensus.cc:2243] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.348294 25507 raft_consensus.cc:2272] T c93a33496b2c4716b8e1e571c2bd3a5e P 687d192f79a044ce838f0bf292f0c09f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.349499  1801 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:19.349982  1801 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:19.350693 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719d8f6d8dda4888b6d16c7132ddde9f" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.351994  1801 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.354667 25507 tablet_replica.cc:333] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.355943 25507 raft_consensus.cc:2243] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.356411 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:19.356739 25507 raft_consensus.cc:2272] T c820b8b86e594946bfb5f18fbb98296d P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.359539 25507 tablet_replica.cc:333] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.360531 25507 raft_consensus.cc:2243] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.360384 26509 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 13, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 21 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:19.361377 26576 leader_election.cc:304] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.362226  1801 raft_consensus.cc:2749] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:19.361974 25507 raft_consensus.cc:2272] T e14c2c21312147dcbce6c84aad03a97f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.363238 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f1ccf978694c0f81383b6ddf01bedf" candidate_uuid: "687d192f79a044ce838f0bf292f0c09f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:19.364773 26576 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 687d192f79a044ce838f0bf292f0c09f; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:19.366794  1801 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.372112 25507 tablet_replica.cc:333] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.373407 25507 raft_consensus.cc:2243] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.374464  1803 leader_election.cc:290] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.375347 25507 raft_consensus.cc:2272] T ce0ea054f23d4b8f8034806c6b565279 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.373509 26759 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:19.378820 25507 tablet_replica.cc:333] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.380146 25507 raft_consensus.cc:2243] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.381143 25507 raft_consensus.cc:2272] T e17759cb7022408583bb0bc7c6cc4eba P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.383626 26650 consensus_peers.cc:597] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.384191 25507 tablet_replica.cc:333] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.385084 25507 raft_consensus.cc:2243] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.385901 25507 raft_consensus.cc:2272] T a3e56fc6bfb947aeb096f93897752238 P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.389061 25507 tablet_replica.cc:333] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.389909 25507 raft_consensus.cc:2243] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.390519 25507 raft_consensus.cc:2272] T 34cdb199be824317848395c2d8402714 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.393159 25507 tablet_replica.cc:333] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.393910 25507 raft_consensus.cc:2243] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.395377 25507 raft_consensus.cc:2272] T f81a23e6878f49ccb8b9f964611190bc P 687d192f79a044ce838f0bf292f0c09f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.397967 25507 tablet_replica.cc:333] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.398790 25507 raft_consensus.cc:2243] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.399458 25507 raft_consensus.cc:2272] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.402140 25507 tablet_replica.cc:333] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.403224 25507 raft_consensus.cc:2243] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.403999 25507 raft_consensus.cc:2272] T 78e89d788bee4a128b18985e582217d9 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.407279 25507 tablet_replica.cc:333] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.408110 25507 raft_consensus.cc:2243] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.409351 25507 raft_consensus.cc:2272] T 823c00a7d4b44bbea4d06e2ad87901ca P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.409955 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.412267 25507 tablet_replica.cc:333] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
W20260709 13:10:19.416301 26724 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.417371 25507 raft_consensus.cc:2243] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:19.417913 26650 consensus_peers.cc:597] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.418203 25507 raft_consensus.cc:2272] T c89abadd4c4c4ff0b1ac684dff13b140 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.421679 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653): Couldn't send request to peer 77c617823f2e4a938ef247a8924e299b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2457711189fa40e5bb77aa8997eca24b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.424567 26685 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:19.425920  1775 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:19.426818 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.439049  1848 ts_tablet_manager.cc:933] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:19.441496 25507 tablet_replica.cc:333] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
W20260709 13:10:19.453702 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.456799 25507 raft_consensus.cc:2243] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.457507 25507 raft_consensus.cc:2272] T f2e750113ebc4804835df06f3637c083 P 687d192f79a044ce838f0bf292f0c09f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.458360 26724 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.460956 25507 tablet_replica.cc:333] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.460302  1823 raft_consensus.cc:2955] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:19.461999 25507 raft_consensus.cc:2243] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.462623 25507 raft_consensus.cc:2272] T c4f65a3c62194ad385b5c3a9d0b22e2b P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.467118 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:19.468377 26685 raft_consensus.cc:2955] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } } }
I20260709 13:10:19.470259 25507 tablet_replica.cc:333] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.471143 25507 raft_consensus.cc:2243] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.471801 25507 raft_consensus.cc:2272] T 432efd5ca613406d884cf1deda00ed97 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.474587 25507 tablet_replica.cc:333] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.475322 25507 raft_consensus.cc:2243] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.477121 25507 raft_consensus.cc:2272] T 719d8f6d8dda4888b6d16c7132ddde9f P 687d192f79a044ce838f0bf292f0c09f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.480001 25507 tablet_replica.cc:333] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.480805 25507 raft_consensus.cc:2243] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.481341 25507 raft_consensus.cc:2272] T b14d4a32f52541d5a619dddf54757a10 P 687d192f79a044ce838f0bf292f0c09f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.483956 25507 tablet_replica.cc:333] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.484668 25507 raft_consensus.cc:2243] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.485164 25507 raft_consensus.cc:2272] T ce09a05f88f44c7188fd7b1975336615 P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.486912 26724 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.487821 25507 tablet_replica.cc:333] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.488636 25507 raft_consensus.cc:2243] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.489266 25507 raft_consensus.cc:2272] T c04d1d6cb7c54df78a1746de67ce6198 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.490167 27284 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.498348  1848 tablet_copy_client.cc:323] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
W20260709 13:10:19.499914 26724 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.504571 25507 tablet_replica.cc:333] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.505386 25507 raft_consensus.cc:2243] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.506274 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet af410dd1881e4b8b87c381cfbb16f9f7 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:10:19.506880 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet af410dd1881e4b8b87c381cfbb16f9f7 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-af410dd1881e4b8b87c381cfbb16f9f7
W20260709 13:10:19.512954 26724 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.515077 26771 tablet_copy_source_session.cc:215] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:19.518877 27284 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.529275 26508 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index -1 to 15, NON_VOTER 77c617823f2e4a938ef247a8924e299b (127.24.232.196) added. New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.523254  1848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af410dd1881e4b8b87c381cfbb16f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.521226 25507 raft_consensus.cc:2272] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 687d192f79a044ce838f0bf292f0c09f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.546921 25507 tablet_replica.cc:333] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.547719 25507 raft_consensus.cc:2243] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:19.548851 25507 raft_consensus.cc:2272] T 87d025654eac4cceb374a7a730d59309 P 687d192f79a044ce838f0bf292f0c09f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.557825 25507 tablet_replica.cc:333] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.558686 25507 raft_consensus.cc:2243] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:19.579226 26650 consensus_peers.cc:597] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.581674  1848 tablet_copy_client.cc:806] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
W20260709 13:10:19.592307 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:19.594318 26724 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.596210  1848 tablet_copy_client.cc:670] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:19.571588 25507 raft_consensus.cc:2272] T 30f1ccf978694c0f81383b6ddf01bedf P 687d192f79a044ce838f0bf292f0c09f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.600716  1848 tablet_copy_client.cc:538] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:19.607169 25507 tablet_replica.cc:333] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f: stopping tablet replica
I20260709 13:10:19.608286 25507 raft_consensus.cc:2243] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.609575 25507 raft_consensus.cc:2272] T 2da4a43c4ca64471b27b22ea1a167d13 P 687d192f79a044ce838f0bf292f0c09f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.634758  1848 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
W20260709 13:10:19.650861 26724 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:19.661393 26724 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:19.704006 26650 consensus_peers.cc:597] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.788722  1855 ts_tablet_manager.cc:933] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:19.793006 26650 consensus_peers.cc:597] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:19.831871 26650 consensus_peers.cc:597] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.833142  1855 tablet_copy_client.cc:323] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.194:36529
I20260709 13:10:19.835251 26697 tablet_copy_service.cc:140] P b9e8388401a74e84a2cc880930412709: Received BeginTabletCopySession request for tablet 78e89d788bee4a128b18985e582217d9 from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47704)
I20260709 13:10:19.835891 26697 tablet_copy_service.cc:161] P b9e8388401a74e84a2cc880930412709: Beginning new tablet copy session on tablet 78e89d788bee4a128b18985e582217d9 from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47704: session id = 77c617823f2e4a938ef247a8924e299b-78e89d788bee4a128b18985e582217d9
W20260709 13:10:19.853549 26650 consensus_peers.cc:597] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.863515 26697 tablet_copy_source_session.cc:215] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:19.876896  1848 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:19.878756  1855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e89d788bee4a128b18985e582217d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.896430  1848 tablet_bootstrap.cc:492] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:10:19.898000  1848 ts_tablet_manager.cc:1403] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.264s	user 0.045s	sys 0.012s
I20260709 13:10:19.901602  1848 raft_consensus.cc:359] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:19.902585  1848 raft_consensus.cc:740] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:10:19.903335  1848 consensus_queue.cc:260] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:19.906332  1848 ts_tablet_manager.cc:1434] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:19.909843  1855 tablet_copy_client.cc:806] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:19.912015  1855 tablet_copy_client.cc:670] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:19.912634 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-af410dd1881e4b8b87c381cfbb16f9f7 received from {username='slave'} at 127.0.0.1:47588
I20260709 13:10:19.913132 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-af410dd1881e4b8b87c381cfbb16f9f7 on tablet af410dd1881e4b8b87c381cfbb16f9f7 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:19.935322  1848 ts_tablet_manager.cc:933] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Initiating tablet copy from peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:19.941329 26650 consensus_peers.cc:597] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.954530  1855 tablet_copy_client.cc:538] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:19.973917 26650 consensus_peers.cc:597] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.976115  1848 tablet_copy_client.cc:323] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.232.195:42613
I20260709 13:10:19.977896 26771 tablet_copy_service.cc:140] P e09ea9b455894a0189912a7b9b6b2f84: Received BeginTabletCopySession request for tablet 2457711189fa40e5bb77aa8997eca24b from peer 77c617823f2e4a938ef247a8924e299b ({username='slave'} at 127.0.0.1:47588)
I20260709 13:10:19.978438 26771 tablet_copy_service.cc:161] P e09ea9b455894a0189912a7b9b6b2f84: Beginning new tablet copy session on tablet 2457711189fa40e5bb77aa8997eca24b from peer 77c617823f2e4a938ef247a8924e299b at {username='slave'} at 127.0.0.1:47588: session id = 77c617823f2e4a938ef247a8924e299b-2457711189fa40e5bb77aa8997eca24b
W20260709 13:10:19.979897 26650 consensus_peers.cc:597] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:19.986228 26771 tablet_copy_source_session.cc:215] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:19.988796  1855 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:10:19.989821  1848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2457711189fa40e5bb77aa8997eca24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.036487  1848 tablet_copy_client.cc:806] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.037178  1848 tablet_copy_client.cc:670] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.052419  1848 tablet_copy_client.cc:538] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.086068  1848 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Bootstrap starting.
I20260709 13:10:20.107873  1819 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.108506  1819 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.110715  1819 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.113179 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
W20260709 13:10:20.121754 26650 consensus_peers.cc:597] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:20.125566  1819 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.126147  1819 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.128197  1819 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:20.128768 26724 leader_election.cc:336] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.129441  1843 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.129997  1843 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.131354 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.135260  1843 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.137187 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:20.138562 26650 leader_election.cc:336] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.129484 26724 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.139613 26651 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:20.140026  1819 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:20.140950  1751 raft_consensus.cc:2749] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:20.141637  1751 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.142107  1751 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.144256  1751 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.145766 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.149509  1751 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.152581  1751 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.159129  1751 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:20.155979  1843 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:20.152030 26650 leader_election.cc:336] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.175618 26650 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:20.163729  1819 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.175554  1843 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.191433  1863 raft_consensus.cc:2749] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:20.192348  1863 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.192864  1863 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.195269  1863 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.189188  1823 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.196195  1823 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.190335  1777 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.196903 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.197567 26759 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 21.
I20260709 13:10:20.197296  1777 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.198254  1823 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.199318 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.201046 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.190936  1819 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.201745 26685 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:20.202922  1860 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.203217  1819 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.204802  1751 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:20.211838 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.212229  1751 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.212579 26685 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:20.212693  1751 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:20.199328  1777 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.220091 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.203984 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.221354 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.220742 26759 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:10:20.223008 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:20.222990 26724 leader_election.cc:336] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.224092 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.224520 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.203461  1860 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.225406  1861 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.225982  1861 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.226676  1777 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:20.227028  1860 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.227094  1777 raft_consensus.cc:493] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.227707  1777 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.228044  1861 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.228588  1861 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.228947  1861 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.229331  1861 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.229621 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.230294 26759 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 23.
I20260709 13:10:20.204916  1843 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.231555 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.233085  1819 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.233500  1819 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.233888  1819 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.234855 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.227898 26682 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:20.238072  1843 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.238461  1843 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.238811  1843 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.238930  1823 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.239481  1823 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.241088 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.263031  1861 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.263340  1777 raft_consensus.cc:515] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:20.304481 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63500.1us
I20260709 13:10:20.306205 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.307220 26682 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:20.314786  1777 leader_election.cc:290] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.311956  1823 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:20.323210 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 122909us
I20260709 13:10:20.320989  1864 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.325587  1864 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.326648 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:20.329694  1864 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.325398  1823 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.336983  1843 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:20.348584 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 125598us
I20260709 13:10:20.321597  1777 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:20.364923 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4358ddab16449aa08eeb30a7b58bc2" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.365592 26682 raft_consensus.cc:3060] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.354592  1823 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.368821 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.369933 26759 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:20.378787  1843 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.380927 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.388520  1777 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.389111  1777 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.390061  1869 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:20.390502  1869 raft_consensus.cc:493] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.390861  1869 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:20.394001 26682 raft_consensus.cc:2468] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:20.393853 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.398765 26685 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 17.
I20260709 13:10:20.399749 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.401019  1864 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.401407  1864 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.401739  1864 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.401769  1751 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.403374  1873 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.404011  1861 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.403959  1873 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.406143  1873 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.370657  1823 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.411361 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.412036 26686 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 19.
I20260709 13:10:20.392606  1777 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.419765  1841 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.420338  1841 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.393219  1819 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.423413  1819 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.423942  1841 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.428318  1855 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.433226 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.434121  1873 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:20.434520  1873 raft_consensus.cc:493] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.434878  1873 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.436021  1751 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:20.436484 27284 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.440114  1869 raft_consensus.cc:515] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.440452  1819 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.441160  1819 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.445837 26726 leader_election.cc:304] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.440714  1823 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.443693  1819 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.449307  1823 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.450829 26685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a056abe51184f1d85dc02b3ff21b29f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.451021 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.429375  1855 tablet_bootstrap.cc:492] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:10:20.468106 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0a742797f949c583d86fd5006dab3d" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.468909 26752 raft_consensus.cc:3060] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:20.472278  1855 ts_tablet_manager.cc:1403] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.485s	user 0.044s	sys 0.015s
I20260709 13:10:20.452113 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.456243 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.451591 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.456259 26685 raft_consensus.cc:3060] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:20.457139 26681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.444221  1869 leader_election.cc:290] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.488193 26761 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 24: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:20.480001 27318 raft_consensus.cc:1217] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:10:20.489324 26681 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 17.
I20260709 13:10:20.489929  1855 raft_consensus.cc:359] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:20.490830  1855 raft_consensus.cc:740] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:10:20.479580 26752 raft_consensus.cc:2468] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 22.
I20260709 13:10:20.488193 26682 raft_consensus.cc:2393] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 24: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:20.459471 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.455940  1819 raft_consensus.cc:2804] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:20.461609  1823 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:20.462357  1873 raft_consensus.cc:515] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.446182  1864 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.510560  1823 raft_consensus.cc:493] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.511034  1823 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.512228  1864 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.497244 26759 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b9e8388401a74e84a2cc880930412709 in current term 24: Already voted for candidate e09ea9b455894a0189912a7b9b6b2f84 in this term.
I20260709 13:10:20.498040 26685 raft_consensus.cc:2468] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
W20260709 13:10:20.499702 26724 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.514292 26724 leader_election.cc:336] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.519188 26724 leader_election.cc:336] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.520766  1819 raft_consensus.cc:697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:20.526505  1819 consensus_queue.cc:237] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.521986  1823 raft_consensus.cc:515] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.523149  1873 leader_election.cc:290] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.533612  1848 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.534642  1848 tablet_bootstrap.cc:492] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Bootstrap complete.
I20260709 13:10:20.535358  1848 ts_tablet_manager.cc:1403] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Time spent bootstrapping tablet: real 0.450s	user 0.051s	sys 0.022s
I20260709 13:10:20.510041 26651 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:20.525326 26724 leader_election.cc:336] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.491503  1855 consensus_queue.cc:260] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:20.538937  1855 ts_tablet_manager.cc:1434] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:10:20.551036  1823 leader_election.cc:290] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:20.554770 26650 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.555461 26650 leader_election.cc:336] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.559027  1819 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.559590  1819 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.562904  1876 raft_consensus.cc:2804] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:20.563467  1876 raft_consensus.cc:697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 22 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
W20260709 13:10:20.558709 26650 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.564594  1876 consensus_queue.cc:237] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.565620 26509 catalog_manager.cc:5697] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 18 to 19, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 19 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.569358  1819 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.569265  1848 raft_consensus.cc:359] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:20.570165  1848 raft_consensus.cc:740] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Initialized, Role: LEARNER
I20260709 13:10:20.570780  1848 consensus_queue.cc:260] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
W20260709 13:10:20.559875 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 49899.4us
I20260709 13:10:20.578096 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.579495  1865 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:20.580024  1865 raft_consensus.cc:493] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.580463  1865 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:20.581151 26724 leader_election.cc:336] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.582044 26724 leader_election.cc:336] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.582818 26724 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.583245 26724 leader_election.cc:336] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.583704 26724 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.584092 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.586107  1848 ts_tablet_manager.cc:1434] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
W20260709 13:10:20.588088 26724 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.589282 26724 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.592406 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859da230e1ac4e1dadde67628eb91af0" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.593015 26761 raft_consensus.cc:3060] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.593210 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.596312 26726 leader_election.cc:304] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.594033  1873 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:20.599102 26682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.597060  1878 raft_consensus.cc:2804] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:20.609584  1878 raft_consensus.cc:697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:20.610559  1878 consensus_queue.cc:237] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.612738 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414ef95ecc9a4f13ba0cc2a2bea97cf4" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.613399 26678 raft_consensus.cc:3060] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.601970  1869 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:20.602331 26682 raft_consensus.cc:2393] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e09ea9b455894a0189912a7b9b6b2f84 in current term 24: Already voted for candidate b9e8388401a74e84a2cc880930412709 in this term.
I20260709 13:10:20.606160 26697 tablet_copy_service.cc:342] P b9e8388401a74e84a2cc880930412709: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-78e89d788bee4a128b18985e582217d9 received from {username='slave'} at 127.0.0.1:47704
I20260709 13:10:20.623934 26697 tablet_copy_service.cc:434] P b9e8388401a74e84a2cc880930412709: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-78e89d788bee4a128b18985e582217d9 on tablet 78e89d788bee4a128b18985e582217d9 with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:20.591005 26771 tablet_copy_service.cc:342] P e09ea9b455894a0189912a7b9b6b2f84: Request end of tablet copy session 77c617823f2e4a938ef247a8924e299b-2457711189fa40e5bb77aa8997eca24b received from {username='slave'} at 127.0.0.1:47588
I20260709 13:10:20.618628  1876 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.625134 26771 tablet_copy_service.cc:434] P e09ea9b455894a0189912a7b9b6b2f84: ending tablet copy session 77c617823f2e4a938ef247a8924e299b-2457711189fa40e5bb77aa8997eca24b on tablet 2457711189fa40e5bb77aa8997eca24b with peer 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:20.625319  1876 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.627417  1876 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.619138 26508 catalog_manager.cc:5697] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 21 to 22, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 22 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.618655 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24ff1c29324f5a8133ee5214778e97" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.628158 26686 raft_consensus.cc:3060] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.620805 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.629317 26761 raft_consensus.cc:2468] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
W20260709 13:10:20.630445 26724 leader_election.cc:336] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.632292 26678 raft_consensus.cc:2468] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 20.
I20260709 13:10:20.629055 26680 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:10:20.638301  1874 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.638833  1874 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.640781  1874 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.643009 26650 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, 77c617823f2e4a938ef247a8924e299b
I20260709 13:10:20.643787  1861 raft_consensus.cc:2749] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:20.645963 26651 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.646327 26686 raft_consensus.cc:2468] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 18.
I20260709 13:10:20.648372  1874 raft_consensus.cc:2804] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:20.648922  1874 raft_consensus.cc:697] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 24 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:20.627924  1865 raft_consensus.cc:515] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.649765  1874 consensus_queue.cc:237] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.663425  1834 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:20.660166 26650 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.664247  1834 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:20.665624 26650 leader_election.cc:336] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.666463  1834 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.651891  1865 leader_election.cc:290] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:20.672782 27284 leader_election.cc:336] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.673501 26650 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:20.674741  1861 raft_consensus.cc:2749] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:20.676923 27284 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.675806 26650 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.678915 26724 leader_election.cc:336] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.684427 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.689471 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.691838 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.691975 26680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18e1296ad84de08dd646beec73c343" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.692569 26680 raft_consensus.cc:3060] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.696177 26726 leader_election.cc:304] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.697314 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.698130 26726 leader_election.cc:304] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.700204 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.706496 27319 raft_consensus.cc:1217] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:10:20.702919 26759 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:20.713871 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.699986  1777 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:20.706772  1870 raft_consensus.cc:2804] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:20.725807  1870 raft_consensus.cc:697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:20.713707  1867 raft_consensus.cc:2804] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:20.729604  1867 raft_consensus.cc:697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:10:20.730356 26724 leader_election.cc:336] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.730476  1867 consensus_queue.cc:237] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.733218  1841 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:20.708930  1869 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:20.735087  1869 raft_consensus.cc:493] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.735291  1865 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.735509  1869 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:20.735857  1865 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.716053 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:20.742416 26650 leader_election.cc:336] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.746548 26680 raft_consensus.cc:2468] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c617823f2e4a938ef247a8924e299b in term 18.
I20260709 13:10:20.743613  1843 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:20.747936  1843 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.748391  1843 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:20.754757 25507 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26633)
W20260709 13:10:20.756182 27284 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.727061  1870 consensus_queue.cc:237] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.759725  1868 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.760268  1868 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.762441  1868 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:10:20.764336  1865 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:20.770617 26650 leader_election.cc:336] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.771106 26650 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:20.778445 26724 leader_election.cc:336] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.796356  1874 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.797001  1874 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.799036  1861 raft_consensus.cc:2749] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:10:20.799564 26650 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.800096  1874 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.800206 26650 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:20.801455 27286 leader_election.cc:304] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
W20260709 13:10:20.802327 26650 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.802748 26650 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:20.802769 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:20.803412 26761 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
I20260709 13:10:20.801781  1874 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:20.804401  1865 raft_consensus.cc:2804] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:20.804890  1865 raft_consensus.cc:697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Becoming Leader. State: Replica: 77c617823f2e4a938ef247a8924e299b, State: Running, Role: LEADER
W20260709 13:10:20.806921 26650 leader_election.cc:336] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.807825 26650 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.799487  1869 raft_consensus.cc:515] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.810649 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.811851  1871 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.812893  1876 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:20.813067  1871 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.815429  1871 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:20.806109  1865 consensus_queue.cc:237] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.815935  1843 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.818142  1843 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:20.822926 26724 leader_election.cc:336] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.823832 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.824133  1869 leader_election.cc:290] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.824553 26686 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:20.830341 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
I20260709 13:10:20.831208  1843 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:20.831655  1843 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.832592 27286 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.834070  1834 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:20.835004 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:20.835544 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.835630 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2731f6fa719f4ecfa9f1f5dc06a0aef2" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.836365 26759 raft_consensus.cc:3060] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.832113  1843 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:20.837608 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2fd83897434de6b94e4a1d72d147dc" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.847083 26686 raft_consensus.cc:3060] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:20.835630 27318 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 18.
I20260709 13:10:20.838618  1874 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.838744  1869 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:10:20.841205 26650 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.852078  1874 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:20.852803 26650 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.853367 26650 leader_election.cc:336] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.854354  1874 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:20.854858 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.855042  1841 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.855526  1841 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.857589  1841 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:20.852068  1869 raft_consensus.cc:493] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.858860  1869 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.862278 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:20.870107  1876 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:20.870502  1876 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.870849  1876 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.872108 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:20.872735 27318 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:20.875725 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:20.881073  1861 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:20.881479  1861 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:20.881855  1861 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.886041 26686 raft_consensus.cc:2468] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 23.
I20260709 13:10:20.888803  1861 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.890897  1861 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:20.891378 27284 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:20.891597 26650 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.891976 27284 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:20.894877 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823c00a7d4b44bbea4d06e2ad87901ca" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:20.895486 27318 raft_consensus.cc:3060] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.901727 26726 leader_election.cc:304] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.902562  1870 raft_consensus.cc:2804] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:20.903045  1870 raft_consensus.cc:697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:20.903939  1870 consensus_queue.cc:237] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.907928  1841 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:20.908321  1869 raft_consensus.cc:515] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:20.915750 26724 leader_election.cc:336] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.920022 26678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14c2c21312147dcbce6c84aad03a97f" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709"
I20260709 13:10:20.933853 26678 raft_consensus.cc:3060] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:20.935650 26724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111) [suppressed 342 similar messages]
W20260709 13:10:20.917299 26650 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.924816  1869 leader_election.cc:290] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483)
I20260709 13:10:20.911593  1876 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.941856  1876 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:20.912566 26759 raft_consensus.cc:2468] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:20.946473 26651 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.946756 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4ad5bc4dd54937a7e4f9b1604a7d22" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:20.947907 27319 raft_consensus.cc:3060] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:20.949380 26650 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.927238  1843 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.953823  1843 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:20.954500  1843 raft_consensus.cc:2804] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:20.954962  1843 raft_consensus.cc:697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:20.956415 27319 raft_consensus.cc:2468] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
W20260709 13:10:20.958922 26650 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:20.959909 26650 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.960479 27318 raft_consensus.cc:2468] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:20.963253 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512480111cea40cebe7a32ae9439af70" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:20.963967 26759 raft_consensus.cc:3060] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:20.962865  1876 raft_consensus.cc:2804] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:20.958967 26678 raft_consensus.cc:2468] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 24.
I20260709 13:10:20.969689 26650 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.975487  1861 raft_consensus.cc:2804] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:20.976328  1861 raft_consensus.cc:697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:20.968544  1876 raft_consensus.cc:697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:20.975360 26726 leader_election.cc:304] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:20.978021  1867 raft_consensus.cc:2804] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:20.977624  1843 consensus_queue.cc:237] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.978609  1867 raft_consensus.cc:697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 24 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:20.979534  1867 consensus_queue.cc:237] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:20.984472  1876 consensus_queue.cc:237] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.988711  1861 consensus_queue.cc:237] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:20.999948  1872 raft_consensus.cc:1064] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
I20260709 13:10:21.002753  1872 consensus_queue.cc:237] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:21.007009 27318 raft_consensus.cc:1217] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:10:21.009933 26759 raft_consensus.cc:2468] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 25.
I20260709 13:10:21.011066 26651 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:21.011830 26504 catalog_manager.cc:5697] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b reported cstate change: term changed from 17 to 18, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to 77c617823f2e4a938ef247a8924e299b (127.24.232.196). New cstate: current_term: 18 leader_uuid: "77c617823f2e4a938ef247a8924e299b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.014870  1874 raft_consensus.cc:2804] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:21.015481  1874 raft_consensus.cc:697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:21.016423  1874 consensus_queue.cc:237] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:21.035799  1876 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
I20260709 13:10:21.037153  1876 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:21.055315 26650 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:21.061430 26678 raft_consensus.cc:1275] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:21.085460 26761 raft_consensus.cc:1275] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:21.083344  1870 consensus_queue.cc:1048] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:10:21.093483 26724 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.095921  1876 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:21.100464 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:21.101217 27318 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 19.
I20260709 13:10:21.103299 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:21.104001  1864 consensus_queue.cc:1048] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:10:21.125754 26759 raft_consensus.cc:1275] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:10:21.136410 27318 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:21.139437 26680 raft_consensus.cc:1275] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:21.132153  1861 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:21.144531  1862 consensus_queue.cc:1048] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:10:21.173116  1869 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:10:21.213639  1872 consensus_queue.cc:1048] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:21.216532 26650 consensus_peers.cc:597] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.173168  1861 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 687d192f79a044ce838f0bf292f0c09f)
W20260709 13:10:21.252343 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 78677.7us
I20260709 13:10:21.245214  1861 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:21.311705  1898 raft_consensus.cc:1064] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:10:21.355824 26651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.393191 26680 raft_consensus.cc:1275] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:21.396085 26681 raft_consensus.cc:1275] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:21.400468 26678 raft_consensus.cc:1275] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:10:21.430847 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 75453.7us
I20260709 13:10:21.439846 26681 raft_consensus.cc:1275] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Refusing update from remote peer 77c617823f2e4a938ef247a8924e299b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:21.442476  1905 consensus_queue.cc:1048] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:21.446491  1861 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:21.473762 27319 raft_consensus.cc:1275] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:21.477145  1861 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:21.478785  1898 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:21.481328 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d025654eac4cceb374a7a730d59309" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:21.481895 27319 raft_consensus.cc:3060] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:21.484127 27318 raft_consensus.cc:1275] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:21.485263 26508 catalog_manager.cc:5697] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 20 to 21, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 21 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.486774 26508 catalog_manager.cc:5697] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 20 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:21.487393 26650 consensus_peers.cc:597] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.488742  1861 consensus_queue.cc:1048] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:21.489486 27319 raft_consensus.cc:2468] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 20.
I20260709 13:10:21.491521 26508 catalog_manager.cc:5697] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 22 to 23, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 23 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.494570 26508 catalog_manager.cc:5697] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 17 to 18, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 18 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.495062 26650 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, b9e8388401a74e84a2cc880930412709; no voters: 
I20260709 13:10:21.497485  1863 raft_consensus.cc:2804] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:21.498008  1863 raft_consensus.cc:697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:21.498916  1863 consensus_queue.cc:237] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:21.499724  1862 consensus_queue.cc:1048] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:21.499557 26508 catalog_manager.cc:5697] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 23 to 24, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 24 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:21.503695 26724 consensus_peers.cc:597] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.508798 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.509413 26724 consensus_peers.cc:597] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.515064 27284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 61772us
W20260709 13:10:21.515703 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:21.516104 27284 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.516175 26761 raft_consensus.cc:1275] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:21.517740  1900 consensus_queue.cc:1048] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:21.520146 26650 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:21.522354 26504 catalog_manager.cc:5697] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 22 to 24, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 24 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.524065 26504 catalog_manager.cc:5697] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 24 to 25, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 25 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.525538 26504 catalog_manager.cc:5697] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.527050 26504 catalog_manager.cc:5697] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.528213 26504 catalog_manager.cc:5697] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 18 to 19, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 19 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:21.529731 26724 consensus_peers.cc:597] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.630445 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 91981us
W20260709 13:10:21.681195 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:21.685863 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:21.735208 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:21.755247 25507 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 26633)
W20260709 13:10:21.794435 26724 consensus_peers.cc:597] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.795051 26724 consensus_peers.cc:597] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.818313  1914 raft_consensus.cc:1064] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: attempting to promote NON_VOTER 77c617823f2e4a938ef247a8924e299b to VOTER
W20260709 13:10:21.823097 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 384386us
I20260709 13:10:21.830070  1914 consensus_queue.cc:237] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:21.833701 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:21.880468  1907 consensus_queue.cc:1048] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:10:21.882031  1867 consensus_queue.cc:1048] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:21.901046 27319 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 LEARNER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:21.846451  1877 consensus_queue.cc:1048] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:10:21.956308  1924 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:10:21.982208 26681 raft_consensus.cc:1275] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:10:21.987280 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 44363.3us
I20260709 13:10:21.989351 26686 raft_consensus.cc:1275] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:10:21.990979 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:21.998793 26724 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:21.999884 26724 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.000362 26724 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.045923 27285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 48910.8us
I20260709 13:10:22.047108 26758 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:22.051293 26758 raft_consensus.cc:1275] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:22.062822  1907 consensus_queue.cc:1048] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:22.063234  1870 consensus_queue.cc:1048] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:22.068568 26724 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.098217  1930 log.cc:927] Time spent T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:10:22.116658  1751 consensus_queue.cc:1048] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:22.118731  1864 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:10:22.162919 27286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 63497.3us
W20260709 13:10:22.210170 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 45246.2us
I20260709 13:10:22.212996 27319 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 LEARNER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:10:22.227535 26650 consensus_peers.cc:597] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:22.228104 26650 consensus_peers.cc:597] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:22.228744 26650 consensus_peers.cc:597] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:22.229169 26650 consensus_peers.cc:597] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.251020 26683 raft_consensus.cc:2955] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:22.254019 26724 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.261073 26724 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.246582  1877 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 13:10:22.263094 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.269552  1909 raft_consensus.cc:2955] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:22.263583 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.278932 26504 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52284 (request call id 227) took 1134 ms. Trace:
I20260709 13:10:22.279357 26504 rpcz_store.cc:276] 0709 13:10:21.144303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.144687 (+   384us) service_pool.cc:224] Handling call
0709 13:10:22.278873 (+1134186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:21.670685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:21.671185 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:21.671212 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:10:21.671226 (+    14us) tablet.cc:662] Decoding operations
0709 13:10:21.671845 (+   619us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:21.671899 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:21.671945 (+    46us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:21.672601 (+   656us) tablet.cc:701] Row locks acquired
0709 13:10:21.672625 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:10:21.672791 (+   166us) write_op.cc:270] Start()
0709 13:10:21.672909 (+   118us) write_op.cc:276] Timestamp: P: 1783602621672735 usec, L: 0
0709 13:10:21.672936 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:10:21.678891 (+  5955us) log.cc:844] Serialized 2099 byte log entry
0709 13:10:21.948661 (+269770us) op_driver.cc:464] REPLICATION: finished
0709 13:10:21.979602 (+ 30941us) write_op.cc:301] APPLY: starting
0709 13:10:21.979719 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:22.000816 (+ 21097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:22.000917 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:22.080308 (+ 79391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:22.080546 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:10:22.080602 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:22.080874 (+   272us) log.cc:844] Serialized 57 byte log entry
0709 13:10:22.081030 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:22.081120 (+    90us) write_op.cc:454] Released schema lock
0709 13:10:22.081158 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:22.081524 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:22.081558 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4686,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":25344,"apply.run_cpu_time_us":8894,"apply.run_wall_time_us":101910,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25017,"num_ops":5,"prepare.queue_time_us":12355,"prepare.run_cpu_time_us":3361,"prepare.run_wall_time_us":12754,"replication_time_us":212501,"thread_start_us":21992,"threads_started":1}]]}
W20260709 13:10:22.286051 27284 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.291838 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.306016 27284 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.331123  1819 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:22.346228  1819 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: NON_VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: true } }
I20260709 13:10:22.349372  1819 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:22.380018 26724 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:22.382553 27319 raft_consensus.cc:2955] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:22.387250 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:22.446201 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 120533us
W20260709 13:10:22.465302  1954 log.cc:927] Time spent T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:10:22.468410 26650 consensus_peers.cc:597] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.473614 26650 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:22.474570 26650 consensus_peers.cc:597] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.475529 26650 consensus_peers.cc:597] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:22.475972  1860 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.476573  1860 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:22.480101  1860 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:22.487741  1925 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.488577 26650 consensus_peers.cc:597] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:22.488298  1925 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:22.490659  1925 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:22.491425 26650 consensus_peers.cc:597] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.496429 26726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:36529, user_credentials={real_user=slave}} blocked reactor thread for 44668.9us
I20260709 13:10:22.504120 27319 raft_consensus.cc:1275] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:10:22.505897 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:34653, user_credentials={real_user=slave}} blocked reactor thread for 52129.1us
I20260709 13:10:22.508617  1863 consensus_queue.cc:1048] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:22.518019 26759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:22.518567 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:22.518743 26759 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
W20260709 13:10:22.512194 26650 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:22.519186 26761 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 24.
I20260709 13:10:22.535239 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:22.539799  1864 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:22.540287  1864 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.540678  1864 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:22.611405 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 43496.6us
I20260709 13:10:22.612286 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 
W20260709 13:10:22.612711 26724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 44328.4us
I20260709 13:10:22.630316 26504 catalog_manager.cc:5697] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b reported cstate change: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:22.624403  1863 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:22.637485  1863 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.637902  1863 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:22.669394 26724 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.696048  1864 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:22.699115 26724 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.700502  1864 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:22.711202 26724 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.737253 26650 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:22.741845 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 124762us
I20260709 13:10:22.752972 26686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9e8388401a74e84a2cc880930412709" is_pre_election: true
I20260709 13:10:22.755110 26686 raft_consensus.cc:1275] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:10:22.755874 25507 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 26633)
I20260709 13:10:22.755838  1863 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:22.758229  1863 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Requested vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:22.770246 26650 consensus_peers.cc:597] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.792137 26726 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:22.794775  1869 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:22.799815 26650 consensus_peers.cc:597] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:22.802465 26650 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:22.805325  1909 consensus_queue.cc:1048] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:22.815187 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d135ef1afa441eb97645c3639222a71" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:22.816358 26758 raft_consensus.cc:3060] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:22.803048 26650 consensus_peers.cc:597] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:22.839337  1876 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:22.853889 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ee616b28745bca2748a7ec4f718dd" candidate_uuid: "b9e8388401a74e84a2cc880930412709" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84"
I20260709 13:10:22.854733 26761 raft_consensus.cc:3060] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:22.858084 26650 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:22.864065 26759 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:22.922742 26758 raft_consensus.cc:2468] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 25.
I20260709 13:10:22.924221 26651 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:22.929262  1967 raft_consensus.cc:2804] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:22.929776  1967 raft_consensus.cc:697] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:22.930649 26761 raft_consensus.cc:2468] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e8388401a74e84a2cc880930412709 in term 25.
I20260709 13:10:22.930603  1967 consensus_queue.cc:237] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:22.931911 26651 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f
I20260709 13:10:22.932735  1864 raft_consensus.cc:2804] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:22.933260  1864 raft_consensus.cc:697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Becoming Leader. State: Replica: b9e8388401a74e84a2cc880930412709, State: Running, Role: LEADER
I20260709 13:10:22.934156  1864 consensus_queue.cc:237] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:22.940158 26508 catalog_manager.cc:5697] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 19 to 20, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 20 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.964547  1867 raft_consensus.cc:2955] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:22.974784 26685 raft_consensus.cc:2955] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:23.000415 26650 consensus_peers.cc:597] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:23.001155 26650 consensus_peers.cc:597] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:23.004067 27319 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.007874 26504 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 13 to 14, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } attrs { replace: true } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.073246 27319 raft_consensus.cc:2955] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.099164 26508 catalog_manager.cc:5697] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 23 to 25, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 25 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.101326 26508 catalog_manager.cc:5697] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 reported cstate change: term changed from 23 to 25, leader changed from 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) to b9e8388401a74e84a2cc880930412709 (127.24.232.194). New cstate: current_term: 25 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.103057 26508 catalog_manager.cc:5697] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 reported cstate change: config changed from index 15 to 16, 77c617823f2e4a938ef247a8924e299b (127.24.232.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.153257 26681 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:23.167353 26759 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:23.169486  1876 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:23.172118 27319 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:23.179999  1967 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:10:23.195009 26761 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.201561 27319 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.226305 26508 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: config changed from index 14 to 15, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New cstate: current_term: 21 leader_uuid: "b9e8388401a74e84a2cc880930412709" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
I20260709 13:10:23.191107  1863 raft_consensus.cc:2955] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 687d192f79a044ce838f0bf292f0c09f (127.24.232.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } } }
W20260709 13:10:23.279235 26650 consensus_peers.cc:597] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:23.291285 26650 consensus_peers.cc:597] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:23.309077 26650 consensus_peers.cc:597] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:23.316759 26496 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78e89d788bee4a128b18985e582217d9 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:23.318507 26494 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 45627.8us
W20260709 13:10:23.340893 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78e89d788bee4a128b18985e582217d9: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:23.441164 26650 consensus_peers.cc:597] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:23.479895 26650 consensus_peers.cc:597] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:23.496050 26758 raft_consensus.cc:1275] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:10:23.498759  1967 consensus_queue.cc:1048] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:23.552919 26650 consensus_peers.cc:597] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.554803 26761 raft_consensus.cc:1275] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Refusing update from remote peer b9e8388401a74e84a2cc880930412709: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:10:23.556691  1967 consensus_queue.cc:1048] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:23.758674 25507 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 26633)
W20260709 13:10:23.765156 26724 consensus_peers.cc:597] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.794104 26724 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.826846 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:23.917179 27284 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.922446 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:23.960366 26724 consensus_peers.cc:597] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.994724 26724 consensus_peers.cc:597] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.006106 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.157445 26724 consensus_peers.cc:597] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.169545 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.217476 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.221400 26724 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.254067 26724 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.272541 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.295246 26724 consensus_peers.cc:597] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.299741 26650 consensus_peers.cc:597] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.307579 26724 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.370812 26650 consensus_peers.cc:597] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.387524 26724 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.448553 26650 consensus_peers.cc:597] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.540486 26724 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.551652 26724 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.565871 26650 consensus_peers.cc:597] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.582026 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78e89d788bee4a128b18985e582217d9: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:24.594241 26650 consensus_peers.cc:597] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.611935 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.654369 26650 consensus_peers.cc:597] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.683130 26651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:42613, user_credentials={real_user=slave}} blocked reactor thread for 57563.9us
W20260709 13:10:24.759227 25507 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 26633)
W20260709 13:10:24.767472 26650 consensus_peers.cc:597] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.869313 26650 consensus_peers.cc:597] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.872272 26650 consensus_peers.cc:597] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.907326 26650 consensus_peers.cc:597] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:24.911103 26724 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:24.928606 26650 consensus_peers.cc:597] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.041064 26650 consensus_peers.cc:597] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.050032 26650 consensus_peers.cc:597] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:25.100813 26650 consensus_peers.cc:597] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.102272 26724 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:25.132462 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
W20260709 13:10:25.200552 26650 consensus_peers.cc:597] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.230378 26724 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.384377 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.385228 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.385692 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.421556 26650 consensus_peers.cc:597] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:25.489137 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
W20260709 13:10:25.519189 26726 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.544070 27286 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.545766 26726 consensus_peers.cc:597] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.574172 26726 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.613014 26726 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.622574 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.623736 25507 tablet_replica.cc:333] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.624735 25507 raft_consensus.cc:2243] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.626744 25507 raft_consensus.cc:2272] T 8a056abe51184f1d85dc02b3ff21b29f P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.629602 25507 tablet_replica.cc:333] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.631075 25507 raft_consensus.cc:2243] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.632956 25507 raft_consensus.cc:2272] T 1e0a742797f949c583d86fd5006dab3d P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.636636 25507 tablet_replica.cc:333] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.637869 25507 raft_consensus.cc:2243] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.638697 25507 raft_consensus.cc:2272] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.641443 25507 tablet_replica.cc:333] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.642302 25507 raft_consensus.cc:2243] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.642974 25507 raft_consensus.cc:2272] T 584ae2b4b46548d6b153c9953ffe1708 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.646175 25507 tablet_replica.cc:333] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.647575 25507 raft_consensus.cc:2243] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.649009 25507 raft_consensus.cc:2272] T f64501a1194b4fc59c6dc2502e1b7c73 P b9e8388401a74e84a2cc880930412709 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.660337 25507 tablet_replica.cc:333] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
W20260709 13:10:25.662065 27286 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.662699 25507 raft_consensus.cc:2243] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.665182 25507 raft_consensus.cc:2272] T 272d473e821e4c15a9f3fa0471adfdc6 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.670495 25507 tablet_replica.cc:333] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.671365 25507 raft_consensus.cc:2243] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.672211 25507 raft_consensus.cc:2272] T 2457711189fa40e5bb77aa8997eca24b P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.679230 25507 tablet_replica.cc:333] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
W20260709 13:10:25.681118 27284 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:25.681262 25507 raft_consensus.cc:2243] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.682497 25507 raft_consensus.cc:2272] T 8f4358ddab16449aa08eeb30a7b58bc2 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.695854 27286 consensus_peers.cc:597] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.697608 25507 tablet_replica.cc:333] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.698637 25507 raft_consensus.cc:2243] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.699292 25507 raft_consensus.cc:2272] T 6d46fffe7ef44d4c95a01a5e1b261924 P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.699489 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78e89d788bee4a128b18985e582217d9: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:25.703400 25507 tablet_replica.cc:333] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.704347 25507 raft_consensus.cc:2243] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.705700 25507 raft_consensus.cc:2272] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.708280 25507 tablet_replica.cc:333] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.709154 25507 raft_consensus.cc:2243] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.710386 25507 raft_consensus.cc:2272] T ff2d7a4b795a4095a12bf45ed815682e P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.713769 25507 tablet_replica.cc:333] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.716071 25507 raft_consensus.cc:2243] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.717607 25507 raft_consensus.cc:2272] T 6d135ef1afa441eb97645c3639222a71 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.722021 25507 tablet_replica.cc:333] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.723536 25507 raft_consensus.cc:2243] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.725644 25507 raft_consensus.cc:2272] T a2c94b0ed2c04d78b5e39ffdf89ff51c P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.729018 25507 tablet_replica.cc:333] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.729950 25507 raft_consensus.cc:2243] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.730564 25507 raft_consensus.cc:2272] T 6c24ff1c29324f5a8133ee5214778e97 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.733557 26726 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.733867 25507 tablet_replica.cc:333] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.734886 25507 raft_consensus.cc:2243] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.736204 25507 raft_consensus.cc:2272] T 839ee616b28745bca2748a7ec4f718dd P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.738713 25507 tablet_replica.cc:333] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.739516 25507 raft_consensus.cc:2243] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.742972 25507 raft_consensus.cc:2272] T af410dd1881e4b8b87c381cfbb16f9f7 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.745216 26726 consensus_peers.cc:597] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.745601 25507 tablet_replica.cc:333] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.746500 25507 raft_consensus.cc:2243] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.747354 25507 raft_consensus.cc:2272] T fc2fd83897434de6b94e4a1d72d147dc P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.750061 25507 tablet_replica.cc:333] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.750969 25507 raft_consensus.cc:2243] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.751629 25507 raft_consensus.cc:2272] T f607ad667e17480ca4cc0366f3f7ce3b P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.755190 25507 tablet_replica.cc:333] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.756057 25507 raft_consensus.cc:2243] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.757169 25507 raft_consensus.cc:2272] T 859da230e1ac4e1dadde67628eb91af0 P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.760509 25507 tablet_replica.cc:333] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709: stopping tablet replica
W20260709 13:10:25.761178 26726 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.761722 25507 raft_consensus.cc:2243] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.762396 25507 raft_consensus.cc:2272] T c93a33496b2c4716b8e1e571c2bd3a5e P b9e8388401a74e84a2cc880930412709 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.764612 26726 consensus_peers.cc:597] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.765712 25507 tablet_replica.cc:333] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.766623 25507 raft_consensus.cc:2243] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.767308 25507 raft_consensus.cc:2272] T c820b8b86e594946bfb5f18fbb98296d P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.770071 25507 tablet_replica.cc:333] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.771654 25507 raft_consensus.cc:2243] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.772331 25507 raft_consensus.cc:2272] T e14c2c21312147dcbce6c84aad03a97f P b9e8388401a74e84a2cc880930412709 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.773658 26726 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.774946 25507 tablet_replica.cc:333] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.776526 25507 raft_consensus.cc:2243] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.777709 25507 raft_consensus.cc:2272] T 3d654edc77c345a4859c8e9dcbac7a2e P b9e8388401a74e84a2cc880930412709 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.778162 26726 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.780509 26726 consensus_peers.cc:597] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.781183 25507 tablet_replica.cc:333] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.785471 25507 raft_consensus.cc:2243] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.786129 25507 raft_consensus.cc:2272] T ce0ea054f23d4b8f8034806c6b565279 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.790247 26726 consensus_peers.cc:597] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.791652 25507 tablet_replica.cc:333] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.793465 25507 raft_consensus.cc:2243] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.796397 26726 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.803297 26650 consensus_peers.cc:597] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:25.803771 26726 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.804601 25507 raft_consensus.cc:2272] T 034fec0349004eddaaed6e75ce9c56ad P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.817929 27286 consensus_peers.cc:597] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.822185 25507 tablet_replica.cc:333] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.824048 25507 raft_consensus.cc:2243] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.827174 25507 raft_consensus.cc:2272] T 7b80723b610f4fe18839109c29ed64de P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.828141 26726 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.835361 25507 tablet_replica.cc:333] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.836622 25507 raft_consensus.cc:2243] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.837409 25507 raft_consensus.cc:2272] T 8e4cacedac354143ab8977803382d0af P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.855656 27286 consensus_peers.cc:597] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.873914 25507 tablet_replica.cc:333] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.874962 25507 raft_consensus.cc:2243] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.875690 25507 raft_consensus.cc:2272] T 4e42105a7b264fbeb08ebb417ed538f0 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.878878 25507 tablet_replica.cc:333] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.879784 25507 raft_consensus.cc:2243] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.880442 25507 raft_consensus.cc:2272] T 589b7d1d64684da8b771d0b30a73579f P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.883813 25507 tablet_replica.cc:333] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.884732 25507 raft_consensus.cc:2243] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.885423 25507 raft_consensus.cc:2272] T 5c18e1296ad84de08dd646beec73c343 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.888170 25507 tablet_replica.cc:333] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.889005 25507 raft_consensus.cc:2243] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.890162 25507 raft_consensus.cc:2272] T ce09a05f88f44c7188fd7b1975336615 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.892848 25507 tablet_replica.cc:333] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.893602 25507 raft_consensus.cc:2243] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.894483 27284 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:25.894761 25507 raft_consensus.cc:2272] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.897552 25507 tablet_replica.cc:333] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.900651 25507 raft_consensus.cc:2243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.901297 25507 raft_consensus.cc:2272] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.905157 25507 tablet_replica.cc:333] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.905998 25507 raft_consensus.cc:2243] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.907068 25507 raft_consensus.cc:2272] T b14d4a32f52541d5a619dddf54757a10 P b9e8388401a74e84a2cc880930412709 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.910183 25507 tablet_replica.cc:333] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.911043 25507 raft_consensus.cc:2243] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.911857 25507 raft_consensus.cc:2272] T c04d1d6cb7c54df78a1746de67ce6198 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.914677 25507 tablet_replica.cc:333] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709: stopping tablet replica
W20260709 13:10:25.921281 27286 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.915684 25507 raft_consensus.cc:2243] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.930238 25507 raft_consensus.cc:2272] T e17759cb7022408583bb0bc7c6cc4eba P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.933194 25507 tablet_replica.cc:333] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.933981 25507 raft_consensus.cc:2243] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.934815 25507 raft_consensus.cc:2272] T a3e56fc6bfb947aeb096f93897752238 P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.937690 25507 tablet_replica.cc:333] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.938517 25507 raft_consensus.cc:2243] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.939652 25507 raft_consensus.cc:2272] T f81a23e6878f49ccb8b9f964611190bc P b9e8388401a74e84a2cc880930412709 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.942500 27286 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 490 similar messages]
W20260709 13:10:25.944904 27286 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.954478 25507 tablet_replica.cc:333] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.955765 25507 raft_consensus.cc:2243] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.957139 25507 raft_consensus.cc:2272] T 830acec67d794b8f8517f8240289bd62 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.960129 25507 tablet_replica.cc:333] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.960934 25507 raft_consensus.cc:2243] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.962401 27286 consensus_peers.cc:597] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.967718 25507 raft_consensus.cc:2272] T 512480111cea40cebe7a32ae9439af70 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.970602 25507 tablet_replica.cc:333] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.971454 25507 raft_consensus.cc:2243] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.972162 25507 raft_consensus.cc:2272] T 463e1353202746e9b791d1dc0cc818f8 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.974993 25507 tablet_replica.cc:333] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.975855 25507 raft_consensus.cc:2243] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.977344 25507 raft_consensus.cc:2272] T 923e107aa6da49eb820049f53360fba9 P b9e8388401a74e84a2cc880930412709 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.980134 25507 tablet_replica.cc:333] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.980938 25507 raft_consensus.cc:2243] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.982167 25507 raft_consensus.cc:2272] T 87d025654eac4cceb374a7a730d59309 P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.985059 25507 tablet_replica.cc:333] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.985848 25507 raft_consensus.cc:2243] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.986586 25507 raft_consensus.cc:2272] T 432efd5ca613406d884cf1deda00ed97 P b9e8388401a74e84a2cc880930412709 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.989239 25507 tablet_replica.cc:333] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.990028 25507 raft_consensus.cc:2243] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.990691 25507 raft_consensus.cc:2272] T 719d8f6d8dda4888b6d16c7132ddde9f P b9e8388401a74e84a2cc880930412709 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.993556 25507 tablet_replica.cc:333] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:25.994413 25507 raft_consensus.cc:2243] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.995831 25507 raft_consensus.cc:2272] T 30f1ccf978694c0f81383b6ddf01bedf P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.010452 25507 tablet_replica.cc:333] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:26.013396 25507 raft_consensus.cc:2243] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.014205 25507 raft_consensus.cc:2272] T d7a03ebddf0c40ebb4879344f54f5d24 P b9e8388401a74e84a2cc880930412709 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:26.014634 26726 consensus_peers.cc:597] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.016865 25507 tablet_replica.cc:333] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:26.017851 25507 raft_consensus.cc:2243] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.019778 25507 raft_consensus.cc:2272] T 78e89d788bee4a128b18985e582217d9 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.022266 25507 tablet_replica.cc:333] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:26.022991 25507 raft_consensus.cc:2243] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.024350 25507 raft_consensus.cc:2272] T 823c00a7d4b44bbea4d06e2ad87901ca P b9e8388401a74e84a2cc880930412709 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:26.025171 27286 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.027213 25507 tablet_replica.cc:333] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:26.036487 25507 raft_consensus.cc:2243] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.037683 25507 raft_consensus.cc:2272] T c89abadd4c4c4ff0b1ac684dff13b140 P b9e8388401a74e84a2cc880930412709 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.043231 25507 tablet_replica.cc:333] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709: stopping tablet replica
I20260709 13:10:26.044006 25507 raft_consensus.cc:2243] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.045082 25507 raft_consensus.cc:2272] T f2e750113ebc4804835df06f3637c083 P b9e8388401a74e84a2cc880930412709 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:26.270211 26726 connection.cc:573] client connection to 127.24.232.194:36529 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:26.309070 26724 consensus_peers.cc:597] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.309670 26724 consensus_peers.cc:597] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.419251 26724 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:26.500494 26724 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.567797 26724 consensus_peers.cc:597] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.570534 26724 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:26.672041  1984 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.672672  1984 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:26.677524  1999 raft_consensus.cc:493] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.677943 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:26.678115  1999 raft_consensus.cc:515] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:26.680239  1999 leader_election.cc:290] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:26.681142  1996 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.681704  1996 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:26.683779  1996 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:26.687089 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
W20260709 13:10:26.688809 26724 leader_election.cc:336] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:26.689915 27286 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.690369 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:26.690799  1984 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:26.691571  1984 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:26.690446 26726 leader_election.cc:336] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.692406 26726 leader_election.cc:304] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.693524  1999 raft_consensus.cc:2749] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:26.695609 27286 leader_election.cc:336] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.696089 27286 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:26.698156  1996 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:26.743821 26724 consensus_peers.cc:597] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.762410 26724 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:26.763711 26724 consensus_peers.cc:597] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:26.771284  1999 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.771816  1999 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:26.780788  1999 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:26.782217 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:26.783128 27316 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
W20260709 13:10:26.783270 26726 leader_election.cc:336] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.784711 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.786218  1999 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.786633  1999 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.787045  1999 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.796763  1984 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.797425  1984 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:26.800639 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:26.801075  1984 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:26.805675 27286 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.806768 27285 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:26.807819  1984 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:26.809305  1999 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:26.818186  1993 raft_consensus.cc:493] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.818766  1993 raft_consensus.cc:515] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:26.824839  1993 leader_election.cc:290] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:26.828033 26724 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:26.832062 26726 leader_election.cc:336] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.832775 26726 leader_election.cc:304] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.834007  1993 raft_consensus.cc:2749] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:26.841709 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d473e821e4c15a9f3fa0471adfdc6" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:26.842428 27316 raft_consensus.cc:3060] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:26.842705 26726 leader_election.cc:336] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.843379  1999 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:26.852001 27316 raft_consensus.cc:2468] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:10:26.854182 26724 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.855020  1999 raft_consensus.cc:2804] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:26.855492  1999 raft_consensus.cc:697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:26.856580  1999 consensus_queue.cc:237] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:26.873334 26724 consensus_peers.cc:597] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:26.874133  1993 raft_consensus.cc:493] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.874697  1993 raft_consensus.cc:515] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:26.876844  1993 leader_election.cc:290] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:26.877884 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:26.888450 26724 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:26.889257 26726 leader_election.cc:336] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.889667 26726 leader_election.cc:304] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.890717  1993 raft_consensus.cc:493] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.890805  2001 raft_consensus.cc:2749] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:26.891286  1993 raft_consensus.cc:515] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:26.893409  1993 leader_election.cc:290] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:26.898972 26724 leader_election.cc:336] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:26.901925 26726 leader_election.cc:336] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.902340 26726 leader_election.cc:304] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.903450  1993 raft_consensus.cc:2749] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:26.944505  1993 raft_consensus.cc:493] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:26.945081  1993 raft_consensus.cc:515] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:26.946199 26508 catalog_manager.cc:5697] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 15, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 15 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.948508  1993 leader_election.cc:290] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:26.954106 26724 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:26.954574 26724 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:26.956054 26726 leader_election.cc:336] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:26.956470 26726 leader_election.cc:304] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:26.957967  1993 raft_consensus.cc:2749] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:27.025272  2008 raft_consensus.cc:493] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.026678  2008 raft_consensus.cc:515] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.039919  2008 leader_election.cc:290] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.042874  2008 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:27.047605  2007 log.cc:927] Time spent T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:27.061844  1984 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.061673  2008 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.062827  1984 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:27.078656 26726 leader_election.cc:336] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.080009  2000 raft_consensus.cc:493] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.080855  2000 raft_consensus.cc:515] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.090054  2010 raft_consensus.cc:493] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.091377  2010 raft_consensus.cc:515] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.092000  2001 raft_consensus.cc:493] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.092944  2001 raft_consensus.cc:515] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.096278  1984 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.096699  1996 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.100518  1996 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.103163  1996 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:27.103559  2000 leader_election.cc:290] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.105389 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.105654  2001 leader_election.cc:290] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.110062  2008 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
W20260709 13:10:27.121357 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.125911  2011 raft_consensus.cc:493] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.126914  2011 raft_consensus.cc:515] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.128146  2010 leader_election.cc:290] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.129251  2011 leader_election.cc:290] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.129812 27286 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.130311 27284 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.133948 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.135308  1902 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:27.140357 27284 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:27.141906 26724 leader_election.cc:336] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.142477 26724 leader_election.cc:304] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.142987 27286 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.144043  2010 raft_consensus.cc:2749] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.148001 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:27.149207 27316 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:10:27.161351  2010 raft_consensus.cc:493] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.162300  2010 raft_consensus.cc:515] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:27.146714 26726 leader_election.cc:336] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.164098 26726 leader_election.cc:336] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.164664 26726 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.143414 26724 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:27.165777 26724 consensus_peers.cc:597] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.168669  2011 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.169425  2011 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.171860  2008 raft_consensus.cc:493] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.172663  2008 raft_consensus.cc:515] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.175184  2008 leader_election.cc:290] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.176901  2011 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:27.177625  2010 leader_election.cc:290] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.182885 26758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "77c617823f2e4a938ef247a8924e299b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e09ea9b455894a0189912a7b9b6b2f84" is_pre_election: true
I20260709 13:10:27.169291 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.194939 26726 leader_election.cc:336] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.195938  2011 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:27.196444  2011 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.196827  2011 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:27.197618 26724 leader_election.cc:336] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.198189 26724 leader_election.cc:304] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.195554 26726 leader_election.cc:336] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.202446 27285 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:27.203303  1902 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:27.203708  2001 raft_consensus.cc:2749] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:27.205909 26724 leader_election.cc:336] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.206346 26724 leader_election.cc:304] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.213346  2010 raft_consensus.cc:2749] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:27.214553 26724 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.219312 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:27.219638  2010 raft_consensus.cc:493] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.220206 27316 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 13.
I20260709 13:10:27.211297  2011 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.223582  2011 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:27.225358  2001 raft_consensus.cc:493] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.227778  2013 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:27.212864 26726 leader_election.cc:336] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.228161  2001 raft_consensus.cc:515] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:27.228895 26726 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.228681  2013 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:27.229410 26726 leader_election.cc:336] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.231058  2013 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.231221  2001 leader_election.cc:290] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.236256 27284 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.238418  2013 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.239398  2013 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.220355  2010 raft_consensus.cc:515] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:27.248338 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.251588  2010 leader_election.cc:290] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.253300 26726 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.253866 26726 leader_election.cc:336] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.254817 27286 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.255255 27286 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.262406  1902 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:27.268512  2013 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.269663  2011 raft_consensus.cc:493] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.270427  2011 raft_consensus.cc:515] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:27.272387 26726 leader_election.cc:336] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.272606  2011 leader_election.cc:290] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.275142 26724 leader_election.cc:336] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.277499 26724 leader_election.cc:304] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.278350  2010 raft_consensus.cc:2749] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:27.279387 26724 leader_election.cc:336] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.279867 26724 leader_election.cc:304] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.280718  2010 raft_consensus.cc:2749] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:27.283340 27284 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:27.283478 26726 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.284740 25507 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26708)
I20260709 13:10:27.289212  2010 raft_consensus.cc:493] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.289971  2010 raft_consensus.cc:515] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.292264  2010 leader_election.cc:290] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.296098 27286 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.296563 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.297255  2013 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.299115 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d654edc77c345a4859c8e9dcbac7a2e" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:27.301136 27316 raft_consensus.cc:3060] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:27.309337 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.311928 26726 leader_election.cc:336] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.313599  2011 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:27.313798 27316 raft_consensus.cc:2468] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 15.
I20260709 13:10:27.314101  2011 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.314925  2011 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.324836  2011 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.326972  2011 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:27.314673  2010 raft_consensus.cc:493] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.328145  2010 raft_consensus.cc:515] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
W20260709 13:10:27.331103 26724 leader_election.cc:336] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.331560 26724 leader_election.cc:304] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.332496 26724 leader_election.cc:336] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.332937 26724 leader_election.cc:304] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.338882  2010 leader_election.cc:290] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.347750  2001 raft_consensus.cc:2749] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.348568  2001 raft_consensus.cc:2749] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:27.352074 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64501a1194b4fc59c6dc2502e1b7c73" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:27.352778 27318 raft_consensus.cc:3060] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:27.354799 26726 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.357297  2001 raft_consensus.cc:493] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.357934  2001 raft_consensus.cc:515] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.358170 26724 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.359798  2008 raft_consensus.cc:2804] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:27.360435 26724 consensus_peers.cc:597] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.360303  2008 raft_consensus.cc:697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
W20260709 13:10:27.361017 26724 leader_election.cc:336] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.361701 26724 leader_election.cc:304] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.360141  2001 leader_election.cc:290] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:27.363049 26726 leader_election.cc:336] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.374639  2011 raft_consensus.cc:493] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
W20260709 13:10:27.364420 26724 leader_election.cc:336] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.375355  2011 raft_consensus.cc:515] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } }
I20260709 13:10:27.375931 26724 leader_election.cc:304] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.376888 26724 leader_election.cc:336] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.377254 26724 leader_election.cc:304] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.377624  2011 leader_election.cc:290] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
I20260709 13:10:27.361747  2008 consensus_queue.cc:237] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.378214  2011 raft_consensus.cc:2749] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:27.362665  1999 raft_consensus.cc:2749] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:10:27.381924 26724 leader_election.cc:336] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.362134 27318 raft_consensus.cc:2468] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 14.
I20260709 13:10:27.378034  2009 raft_consensus.cc:2749] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:27.385612 26726 leader_election.cc:336] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.386291 26724 leader_election.cc:304] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.386977 26726 leader_election.cc:336] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.387281  2009 raft_consensus.cc:2749] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.372066  2010 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.392936  2010 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.398322  2010 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:27.395651 26724 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
W20260709 13:10:27.399736 26724 leader_election.cc:336] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.400136 26724 leader_election.cc:304] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.401314  2001 raft_consensus.cc:2804] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:27.401834  2001 raft_consensus.cc:697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:27.402897  2001 consensus_queue.cc:237] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.405932  2008 raft_consensus.cc:2749] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:27.407743 26726 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:27.417526 27318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b" is_pre_election: true
I20260709 13:10:27.418258 27318 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 21.
I20260709 13:10:27.420565 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.421356  2010 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:27.421705  2010 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:27.422051  2010 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:27.426234 26726 consensus_peers.cc:597] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.419716 26508 catalog_manager.cc:5697] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 14 to 15, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 15 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:27.432045 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:27.432359 26724 leader_election.cc:336] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.432850 26724 leader_election.cc:304] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.433627  2008 raft_consensus.cc:2749] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:27.434655 26724 leader_election.cc:336] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.435119 26724 leader_election.cc:304] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09ea9b455894a0189912a7b9b6b2f84; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.435909  2008 raft_consensus.cc:2749] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.442863  2010 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:27.443252 27318 raft_consensus.cc:1275] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:27.445484  2009 consensus_queue.cc:1048] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:27.450311  2010 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Requested vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), 77c617823f2e4a938ef247a8924e299b (127.24.232.196:34653)
I20260709 13:10:27.452041 27319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e89d788bee4a128b18985e582217d9" candidate_uuid: "e09ea9b455894a0189912a7b9b6b2f84" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "77c617823f2e4a938ef247a8924e299b"
I20260709 13:10:27.452729 27319 raft_consensus.cc:3060] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:27.455605 26726 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:27.464515 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.465826 27319 raft_consensus.cc:2468] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09ea9b455894a0189912a7b9b6b2f84 in term 22.
I20260709 13:10:27.467439 26724 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b, e09ea9b455894a0189912a7b9b6b2f84; no voters: b9e8388401a74e84a2cc880930412709
I20260709 13:10:27.468765  2009 raft_consensus.cc:2804] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:27.469404  2009 raft_consensus.cc:697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Becoming Leader. State: Replica: e09ea9b455894a0189912a7b9b6b2f84, State: Running, Role: LEADER
I20260709 13:10:27.471025  2009 consensus_queue.cc:237] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:27.495905 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.508320 26508 catalog_manager.cc:5697] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 13 to 14, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 14 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:27.516109 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.547230 26508 catalog_manager.cc:5697] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 reported cstate change: term changed from 21 to 22, leader changed from b9e8388401a74e84a2cc880930412709 (127.24.232.194) to e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195). New cstate: current_term: 22 leader_uuid: "e09ea9b455894a0189912a7b9b6b2f84" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:27.644476 26724 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:27.770361 26724 consensus_peers.cc:597] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:27.946369 27318 raft_consensus.cc:1275] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:27.950230  2001 consensus_queue.cc:1048] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:27.963624 27318 raft_consensus.cc:1275] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:10:27.966336 26726 consensus_peers.cc:597] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:27.966996 26494 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.232.193:41483, user_credentials={real_user=slave}} blocked reactor thread for 88334.4us
W20260709 13:10:27.978212 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78e89d788bee4a128b18985e582217d9: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:27.987347 27319 raft_consensus.cc:1275] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Refusing update from remote peer e09ea9b455894a0189912a7b9b6b2f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:27.986807  2001 consensus_queue.cc:1048] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:27.996279  2001 consensus_queue.cc:1048] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:28.033299 26726 consensus_peers.cc:597] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.052883 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
W20260709 13:10:28.066991 26726 consensus_peers.cc:597] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.068089 26726 consensus_peers.cc:597] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.104319 26726 consensus_peers.cc:597] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.104584 27286 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.128975 26726 consensus_peers.cc:597] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.138679 26726 consensus_peers.cc:597] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.146893 27286 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.194051 26726 consensus_peers.cc:597] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.201216 26726 consensus_peers.cc:597] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.199331 27286 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.231117 26726 consensus_peers.cc:597] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.244427 26726 consensus_peers.cc:597] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.261991 27284 consensus_peers.cc:597] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:28.275724 26726 consensus_peers.cc:597] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:28.276150 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
W20260709 13:10:28.312489 27285 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.313529 27285 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.322130 27286 consensus_peers.cc:597] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.328096 26726 consensus_peers.cc:597] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.328661 26726 consensus_peers.cc:597] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.337726 27286 consensus_peers.cc:597] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.345386 27286 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:28.364730 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:28.365972 25507 tablet_replica.cc:333] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.367219 25507 raft_consensus.cc:2243] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.368412 25507 raft_consensus.cc:2272] T 8a056abe51184f1d85dc02b3ff21b29f P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.371030 25507 tablet_replica.cc:333] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.371898 25507 raft_consensus.cc:2243] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.372609 25507 raft_consensus.cc:2272] T 7c3f44630f03419aaf2afaa55030ded4 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.376051 25507 tablet_replica.cc:333] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.376982 25507 raft_consensus.cc:2243] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.378297 25507 raft_consensus.cc:2272] T 414ef95ecc9a4f13ba0cc2a2bea97cf4 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.380574 25507 tablet_replica.cc:333] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.381296 25507 raft_consensus.cc:2243] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.381997 25507 raft_consensus.cc:2272] T 1e0a742797f949c583d86fd5006dab3d P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.384761 25507 tablet_replica.cc:333] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.386155 25507 raft_consensus.cc:2243] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.387367 25507 raft_consensus.cc:2272] T 584ae2b4b46548d6b153c9953ffe1708 P e09ea9b455894a0189912a7b9b6b2f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.389827 25507 tablet_replica.cc:333] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.390455 25507 raft_consensus.cc:2243] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.391546 25507 raft_consensus.cc:2272] T f64501a1194b4fc59c6dc2502e1b7c73 P e09ea9b455894a0189912a7b9b6b2f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.394932 25507 tablet_replica.cc:333] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.395560 25507 raft_consensus.cc:2243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.396608 25507 raft_consensus.cc:2272] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.398846 25507 tablet_replica.cc:333] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.399551 25507 raft_consensus.cc:2243] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.401069 25507 raft_consensus.cc:2272] T 2457711189fa40e5bb77aa8997eca24b P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.404654 25507 tablet_replica.cc:333] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.405465 25507 raft_consensus.cc:2243] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.406659 25507 raft_consensus.cc:2272] T 8f4358ddab16449aa08eeb30a7b58bc2 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.409540 25507 tablet_replica.cc:333] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.410403 25507 raft_consensus.cc:2243] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.412063 25507 raft_consensus.cc:2272] T 272d473e821e4c15a9f3fa0471adfdc6 P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.416939 25507 tablet_replica.cc:333] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.417820 25507 raft_consensus.cc:2243] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.418820 25507 raft_consensus.cc:2272] T ff2d7a4b795a4095a12bf45ed815682e P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.421630 25507 tablet_replica.cc:333] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.422946 25507 raft_consensus.cc:2243] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.424052 25507 raft_consensus.cc:2272] T 6d135ef1afa441eb97645c3639222a71 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.426232 27286 consensus_peers.cc:597] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:28.426779 25507 tablet_replica.cc:333] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.427618 25507 raft_consensus.cc:2243] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.428378 25507 raft_consensus.cc:2272] T a2c94b0ed2c04d78b5e39ffdf89ff51c P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.431121 25507 tablet_replica.cc:333] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.431905 25507 raft_consensus.cc:2243] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.434056 25507 raft_consensus.cc:2272] T 6c24ff1c29324f5a8133ee5214778e97 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.434448 27285 consensus_peers.cc:597] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.437332 25507 tablet_replica.cc:333] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.438208 25507 raft_consensus.cc:2243] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.439013 25507 raft_consensus.cc:2272] T 2731f6fa719f4ecfa9f1f5dc06a0aef2 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.441738 25507 tablet_replica.cc:333] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.442567 25507 raft_consensus.cc:2243] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.443318 25507 raft_consensus.cc:2272] T 839ee616b28745bca2748a7ec4f718dd P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.446312 25507 tablet_replica.cc:333] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.447400 25507 raft_consensus.cc:2243] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:10:28.448921 26726 consensus_peers.cc:597] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:28.449414 25507 raft_consensus.cc:2272] T af410dd1881e4b8b87c381cfbb16f9f7 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.454712 25507 tablet_replica.cc:333] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.455734 25507 raft_consensus.cc:2243] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.457052 25507 raft_consensus.cc:2272] T fc2fd83897434de6b94e4a1d72d147dc P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.460157 25507 tablet_replica.cc:333] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.460963 25507 raft_consensus.cc:2243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.461588 25507 raft_consensus.cc:2272] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.464304 25507 tablet_replica.cc:333] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.465065 25507 raft_consensus.cc:2243] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.465803 25507 raft_consensus.cc:2272] T b14d4a32f52541d5a619dddf54757a10 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.466961 27286 consensus_peers.cc:597] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:28.468365 25507 tablet_replica.cc:333] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.469373 25507 raft_consensus.cc:2243] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.470120 25507 raft_consensus.cc:2272] T ce09a05f88f44c7188fd7b1975336615 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.472434 25507 tablet_replica.cc:333] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.473151 25507 raft_consensus.cc:2243] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.473625 25507 raft_consensus.cc:2272] T f607ad667e17480ca4cc0366f3f7ce3b P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.476020 25507 tablet_replica.cc:333] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.476596 25507 raft_consensus.cc:2243] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.477216 25507 raft_consensus.cc:2272] T 4b8af8f9b5044a94b8f38a96387fc68d P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.479729 25507 tablet_replica.cc:333] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.480297 25507 raft_consensus.cc:2243] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.480935 25507 raft_consensus.cc:2272] T 859da230e1ac4e1dadde67628eb91af0 P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.483515 25507 tablet_replica.cc:333] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.484233 25507 raft_consensus.cc:2243] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.485312 25507 raft_consensus.cc:2272] T e14c2c21312147dcbce6c84aad03a97f P e09ea9b455894a0189912a7b9b6b2f84 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.487533 25507 tablet_replica.cc:333] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.488173 25507 raft_consensus.cc:2243] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.489415 25507 raft_consensus.cc:2272] T 3d654edc77c345a4859c8e9dcbac7a2e P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.492686 25507 tablet_replica.cc:333] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.493443 25507 raft_consensus.cc:2243] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.494622 25507 raft_consensus.cc:2272] T c93a33496b2c4716b8e1e571c2bd3a5e P e09ea9b455894a0189912a7b9b6b2f84 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.496672 27285 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.497269 25507 tablet_replica.cc:333] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.498032 25507 raft_consensus.cc:2243] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.499034 25507 raft_consensus.cc:2272] T ce0ea054f23d4b8f8034806c6b565279 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.501577 25507 tablet_replica.cc:333] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.503180 25507 raft_consensus.cc:2243] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.503847 25507 raft_consensus.cc:2272] T 830acec67d794b8f8517f8240289bd62 P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.504146 27285 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.506114 25507 tablet_replica.cc:333] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.506755 25507 raft_consensus.cc:2243] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.507453 25507 raft_consensus.cc:2272] T 512480111cea40cebe7a32ae9439af70 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.509801 25507 tablet_replica.cc:333] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.510560 25507 raft_consensus.cc:2243] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.511693 25507 raft_consensus.cc:2272] T 463e1353202746e9b791d1dc0cc818f8 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.514111 25507 tablet_replica.cc:333] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.514760 25507 raft_consensus.cc:2243] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:28.515393 27284 consensus_peers.cc:597] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:28.515502 25507 raft_consensus.cc:2272] T 923e107aa6da49eb820049f53360fba9 P e09ea9b455894a0189912a7b9b6b2f84 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.518944 25507 tablet_replica.cc:333] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.519796 25507 raft_consensus.cc:2243] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.520363 25507 raft_consensus.cc:2272] T 034fec0349004eddaaed6e75ce9c56ad P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.522432 25507 tablet_replica.cc:333] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.523072 25507 raft_consensus.cc:2243] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.523639 25507 raft_consensus.cc:2272] T 7b80723b610f4fe18839109c29ed64de P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.525621 25507 tablet_replica.cc:333] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.526171 25507 raft_consensus.cc:2243] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.526808 25507 raft_consensus.cc:2272] T 403ab0598478421094af52431235a129 P e09ea9b455894a0189912a7b9b6b2f84 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.528861 25507 tablet_replica.cc:333] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.529455 25507 raft_consensus.cc:2243] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.530469 25507 raft_consensus.cc:2272] T 8e4cacedac354143ab8977803382d0af P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.532595 25507 tablet_replica.cc:333] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.533100 25507 raft_consensus.cc:2243] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.533598 25507 raft_consensus.cc:2272] T 4e42105a7b264fbeb08ebb417ed538f0 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.535534 25507 tablet_replica.cc:333] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.536191 25507 raft_consensus.cc:2243] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.536847 25507 raft_consensus.cc:2272] T 30f1ccf978694c0f81383b6ddf01bedf P e09ea9b455894a0189912a7b9b6b2f84 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.538825 25507 tablet_replica.cc:333] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.539398 25507 raft_consensus.cc:2243] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.540336 25507 raft_consensus.cc:2272] T d7a03ebddf0c40ebb4879344f54f5d24 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.542616 25507 tablet_replica.cc:333] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.543354 25507 raft_consensus.cc:2243] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.544854 25507 raft_consensus.cc:2272] T 432efd5ca613406d884cf1deda00ed97 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.547386 25507 tablet_replica.cc:333] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.549127 25507 raft_consensus.cc:2243] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.550233 25507 raft_consensus.cc:2272] T 719d8f6d8dda4888b6d16c7132ddde9f P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.552892 25507 tablet_replica.cc:333] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.553622 25507 raft_consensus.cc:2243] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.554486 25507 raft_consensus.cc:2272] T f2e750113ebc4804835df06f3637c083 P e09ea9b455894a0189912a7b9b6b2f84 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.557027 25507 tablet_replica.cc:333] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.557832 25507 raft_consensus.cc:2243] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.558403 25507 raft_consensus.cc:2272] T c89abadd4c4c4ff0b1ac684dff13b140 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.559894 27285 consensus_peers.cc:597] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.561053 25507 tablet_replica.cc:333] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.561939 25507 raft_consensus.cc:2243] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.563242 25507 raft_consensus.cc:2272] T c4f65a3c62194ad385b5c3a9d0b22e2b P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.566075 25507 tablet_replica.cc:333] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.566823 25507 raft_consensus.cc:2243] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.568567 25507 raft_consensus.cc:2272] T 78e89d788bee4a128b18985e582217d9 P e09ea9b455894a0189912a7b9b6b2f84 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.571955 25507 tablet_replica.cc:333] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.572636 25507 raft_consensus.cc:2243] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.573487 25507 raft_consensus.cc:2272] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P e09ea9b455894a0189912a7b9b6b2f84 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.573596 27285 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.575783 25507 tablet_replica.cc:333] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.576370 25507 raft_consensus.cc:2243] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.577136 25507 raft_consensus.cc:2272] T 2da4a43c4ca64471b27b22ea1a167d13 P e09ea9b455894a0189912a7b9b6b2f84 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.580235 25507 tablet_replica.cc:333] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.580925 25507 raft_consensus.cc:2243] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.581516 25507 raft_consensus.cc:2272] T e17759cb7022408583bb0bc7c6cc4eba P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.584550 25507 tablet_replica.cc:333] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.585314 25507 raft_consensus.cc:2243] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:28.586462 25507 raft_consensus.cc:2272] T a3e56fc6bfb947aeb096f93897752238 P e09ea9b455894a0189912a7b9b6b2f84 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.588908 25507 tablet_replica.cc:333] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.589579 25507 raft_consensus.cc:2243] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.590565 25507 raft_consensus.cc:2272] T 34cdb199be824317848395c2d8402714 P e09ea9b455894a0189912a7b9b6b2f84 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.593226 25507 tablet_replica.cc:333] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84: stopping tablet replica
I20260709 13:10:28.593852 25507 raft_consensus.cc:2243] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.594424 25507 raft_consensus.cc:2272] T f81a23e6878f49ccb8b9f964611190bc P e09ea9b455894a0189912a7b9b6b2f84 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:28.632896 27285 consensus_peers.cc:597] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.672361 27286 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Couldn't send request to peer b9e8388401a74e84a2cc880930412709. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:28.682725 27285 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.687644 26726 connection.cc:466] server connection from 127.0.0.1:47588 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47588 (request call id 1299) could send its response
W20260709 13:10:28.689471 27285 consensus_peers.cc:597] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b -> Peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Couldn't send request to peer e09ea9b455894a0189912a7b9b6b2f84. Status: Network error: recv got EOF from 127.24.232.195:42613 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.765424  1902 raft_consensus.cc:493] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:28.766026  1902 raft_consensus.cc:515] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:28.768466  1902 leader_election.cc:290] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:28.775533 27286 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:28.778734 27284 leader_election.cc:336] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:28.779188 27284 leader_election.cc:304] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:28.781647  2013 raft_consensus.cc:2749] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.830936  1902 raft_consensus.cc:493] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:28.831511  1902 raft_consensus.cc:515] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:28.834681  1902 leader_election.cc:290] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:28.851234 27286 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
W20260709 13:10:28.858593 27284 leader_election.cc:336] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:28.859174 27284 leader_election.cc:304] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:28.859972  1902 raft_consensus.cc:2749] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:29.085134  2013 raft_consensus.cc:493] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9e8388401a74e84a2cc880930412709)
I20260709 13:10:29.085757  2013 raft_consensus.cc:515] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.088181  2013 leader_election.cc:290] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529)
W20260709 13:10:29.095415 27284 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:29.104728 27286 leader_election.cc:336] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.106773 27286 leader_election.cc:304] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, b9e8388401a74e84a2cc880930412709
I20260709 13:10:29.107739  2013 raft_consensus.cc:2749] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:29.282047 27284 consensus_peers.cc:597] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:29.423897 27284 consensus_peers.cc:597] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:29.437973  2013 raft_consensus.cc:493] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.438599  2013 raft_consensus.cc:515] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.441701  2013 leader_election.cc:290] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.448294 27285 leader_election.cc:336] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
W20260709 13:10:29.451970 27284 leader_election.cc:336] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:29.452445 27284 leader_election.cc:304] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.453410  2013 raft_consensus.cc:2749] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:29.458559 27286 leader_election.cc:336] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.542601  2013 raft_consensus.cc:493] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.543272  2013 raft_consensus.cc:515] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.546429  2013 leader_election.cc:290] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.552373 27285 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:29.561216  2027 raft_consensus.cc:493] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.561746  2027 raft_consensus.cc:515] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.564389  2027 leader_election.cc:290] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.569628 27285 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
W20260709 13:10:29.592337 27286 leader_election.cc:336] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.593892  2027 raft_consensus.cc:493] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.596060  2027 raft_consensus.cc:515] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.598177  2027 leader_election.cc:290] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
I20260709 13:10:29.600881 27286 leader_election.cc:304] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
W20260709 13:10:29.604221 27284 consensus_peers.cc:597] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:29.604779  2027 raft_consensus.cc:2749] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:29.607625 27285 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
W20260709 13:10:29.619390 27286 leader_election.cc:336] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.621870 27286 leader_election.cc:304] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.623040  2027 raft_consensus.cc:2749] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:29.629659  2027 raft_consensus.cc:493] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.630190  2027 raft_consensus.cc:515] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.632249  2027 leader_election.cc:290] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.633631 27286 leader_election.cc:336] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.634517 27286 leader_election.cc:304] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.641180  2027 raft_consensus.cc:2749] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:29.639274 27284 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:29.645020 27285 leader_election.cc:336] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:29.646898 27285 leader_election.cc:304] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.648859  2027 raft_consensus.cc:2749] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:29.714098 27284 consensus_peers.cc:597] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:29.731498 27284 consensus_peers.cc:597] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:29.829226 27284 consensus_peers.cc:597] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:29.829828 27284 consensus_peers.cc:597] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:29.841645  2027 raft_consensus.cc:493] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.842298  2027 raft_consensus.cc:515] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
I20260709 13:10:29.844908  2027 leader_election.cc:290] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.853708 27286 leader_election.cc:336] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.858268 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
W20260709 13:10:29.861889 27285 leader_election.cc:336] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:29.862489 27285 leader_election.cc:304] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.863804  2027 raft_consensus.cc:2749] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:29.897401 27284 consensus_peers.cc:597] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:29.904994  2027 raft_consensus.cc:493] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.905658  2027 raft_consensus.cc:515] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:29.914140 27285 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:29.915993  2027 leader_election.cc:290] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.921389 27284 leader_election.cc:336] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:29.922068 27284 leader_election.cc:304] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.923568  2027 raft_consensus.cc:2749] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:29.933878  2027 raft_consensus.cc:493] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.934926  2027 raft_consensus.cc:515] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "687d192f79a044ce838f0bf292f0c09f" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 41483 } } peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } attrs { replace: true } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:29.944219 27285 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:29.949945  2027 leader_election.cc:290] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483), b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:29.958635 27284 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:29.960454 27284 leader_election.cc:304] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: 687d192f79a044ce838f0bf292f0c09f, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:29.962419  2027 raft_consensus.cc:2749] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:29.963313 27286 leader_election.cc:336] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:29.994315  2027 raft_consensus.cc:493] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e09ea9b455894a0189912a7b9b6b2f84)
I20260709 13:10:29.995098  2027 raft_consensus.cc:515] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b9e8388401a74e84a2cc880930412709" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 36529 } } peers { permanent_uuid: "e09ea9b455894a0189912a7b9b6b2f84" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 42613 } } peers { permanent_uuid: "77c617823f2e4a938ef247a8924e299b" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 34653 } attrs { promote: false } }
W20260709 13:10:30.003537 27285 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613): Network error: Client connection negotiation failed: client connection to 127.24.232.195:42613: connect: Connection refused (error 111)
I20260709 13:10:30.003868 25507 tablet_server.cc:179] TabletServer@127.24.232.196:0 shutting down...
I20260709 13:10:30.005427  2027 leader_election.cc:290] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529), e09ea9b455894a0189912a7b9b6b2f84 (127.24.232.195:42613)
W20260709 13:10:30.022861 27286 leader_election.cc:336] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9e8388401a74e84a2cc880930412709 (127.24.232.194:36529): Network error: Client connection negotiation failed: client connection to 127.24.232.194:36529: connect: Connection refused (error 111)
I20260709 13:10:30.023269 27286 leader_election.cc:304] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c617823f2e4a938ef247a8924e299b; no voters: b9e8388401a74e84a2cc880930412709, e09ea9b455894a0189912a7b9b6b2f84
I20260709 13:10:30.023944  2013 raft_consensus.cc:2749] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:30.062659 27284 consensus_peers.cc:597] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b -> Peer 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): Couldn't send request to peer 687d192f79a044ce838f0bf292f0c09f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:30.070102 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:30.071264 25507 tablet_replica.cc:333] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.072492 25507 raft_consensus.cc:2243] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.073372 25507 raft_consensus.cc:2272] T 2457711189fa40e5bb77aa8997eca24b P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.080688 25507 tablet_replica.cc:333] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.081830 25507 raft_consensus.cc:2243] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.082700 25507 raft_consensus.cc:2272] T af410dd1881e4b8b87c381cfbb16f9f7 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.086153 25507 tablet_replica.cc:333] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.087036 25507 raft_consensus.cc:2243] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.087713 25507 raft_consensus.cc:2272] T 272d473e821e4c15a9f3fa0471adfdc6 P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.091282 25507 tablet_replica.cc:333] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.092206 25507 raft_consensus.cc:2243] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.093127 25507 raft_consensus.cc:2272] T 0a4ad5bc4dd54937a7e4f9b1604a7d22 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.097352 25507 tablet_replica.cc:333] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.098363 25507 raft_consensus.cc:2243] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.099462 25507 raft_consensus.cc:2272] T f8d2ac1df6a84a8eb9a6a4510b47b6e0 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.102535 25507 tablet_replica.cc:333] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.103385 25507 raft_consensus.cc:2243] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.104725 25507 raft_consensus.cc:2272] T c04d1d6cb7c54df78a1746de67ce6198 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.107554 25507 tablet_replica.cc:333] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.108389 25507 raft_consensus.cc:2243] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.109586 25507 raft_consensus.cc:2272] T 2da4a43c4ca64471b27b22ea1a167d13 P 77c617823f2e4a938ef247a8924e299b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.112819 25507 tablet_replica.cc:333] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.113679 25507 raft_consensus.cc:2243] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.114871 25507 raft_consensus.cc:2272] T 34cdb199be824317848395c2d8402714 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.117913 25507 tablet_replica.cc:333] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.118791 25507 raft_consensus.cc:2243] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.120020 25507 raft_consensus.cc:2272] T 6d46fffe7ef44d4c95a01a5e1b261924 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.123090 25507 tablet_replica.cc:333] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.124107 25507 raft_consensus.cc:2243] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.124864 25507 raft_consensus.cc:2272] T 87d025654eac4cceb374a7a730d59309 P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.132540 25507 tablet_replica.cc:333] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.133404 25507 raft_consensus.cc:2243] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.134006 25507 raft_consensus.cc:2272] T 3d654edc77c345a4859c8e9dcbac7a2e P 77c617823f2e4a938ef247a8924e299b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.136953 25507 tablet_replica.cc:333] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.137847 25507 raft_consensus.cc:2243] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.139191 25507 raft_consensus.cc:2272] T c820b8b86e594946bfb5f18fbb98296d P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.142100 25507 tablet_replica.cc:333] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.142874 25507 raft_consensus.cc:2243] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.143517 25507 raft_consensus.cc:2272] T c4f65a3c62194ad385b5c3a9d0b22e2b P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.146590 25507 tablet_replica.cc:333] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.147465 25507 raft_consensus.cc:2243] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.148689 25507 raft_consensus.cc:2272] T 7c3f44630f03419aaf2afaa55030ded4 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.151721 25507 tablet_replica.cc:333] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.152508 25507 raft_consensus.cc:2243] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.153139 25507 raft_consensus.cc:2272] T 48ed7d6e90f44f25b6d48f7d3fd0b857 P 77c617823f2e4a938ef247a8924e299b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.156028 25507 tablet_replica.cc:333] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.156888 25507 raft_consensus.cc:2243] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.157555 25507 raft_consensus.cc:2272] T 8e4cacedac354143ab8977803382d0af P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.160674 25507 tablet_replica.cc:333] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.161567 25507 raft_consensus.cc:2243] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.162875 25507 raft_consensus.cc:2272] T 589b7d1d64684da8b771d0b30a73579f P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.165949 25507 tablet_replica.cc:333] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.166759 25507 raft_consensus.cc:2243] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.167898 25507 raft_consensus.cc:2272] T f607ad667e17480ca4cc0366f3f7ce3b P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.170917 25507 tablet_replica.cc:333] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.171713 25507 raft_consensus.cc:2243] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.172309 25507 raft_consensus.cc:2272] T f64501a1194b4fc59c6dc2502e1b7c73 P 77c617823f2e4a938ef247a8924e299b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.174999 25507 tablet_replica.cc:333] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.175820 25507 raft_consensus.cc:2243] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.177018 25507 raft_consensus.cc:2272] T 4b8af8f9b5044a94b8f38a96387fc68d P 77c617823f2e4a938ef247a8924e299b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.180038 25507 tablet_replica.cc:333] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.180871 25507 raft_consensus.cc:2243] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.181411 25507 raft_consensus.cc:2272] T 78e89d788bee4a128b18985e582217d9 P 77c617823f2e4a938ef247a8924e299b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.184783 25507 tablet_replica.cc:333] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.185523 25507 raft_consensus.cc:2243] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.186633 25507 raft_consensus.cc:2272] T 4e42105a7b264fbeb08ebb417ed538f0 P 77c617823f2e4a938ef247a8924e299b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.189568 25507 tablet_replica.cc:333] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.190315 25507 raft_consensus.cc:2243] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.191056 25507 raft_consensus.cc:2272] T 823c00a7d4b44bbea4d06e2ad87901ca P 77c617823f2e4a938ef247a8924e299b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.194200 25507 tablet_replica.cc:333] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.194931 25507 raft_consensus.cc:2243] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.196158 25507 raft_consensus.cc:2272] T 403ab0598478421094af52431235a129 P 77c617823f2e4a938ef247a8924e299b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.199232 25507 tablet_replica.cc:333] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.200163 25507 raft_consensus.cc:2243] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.201278 25507 raft_consensus.cc:2272] T 3a6cdf3163c8419d9d0c3ee399cc76d1 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.204205 25507 tablet_replica.cc:333] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.204867 25507 raft_consensus.cc:2243] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.205915 25507 raft_consensus.cc:2272] T d7a03ebddf0c40ebb4879344f54f5d24 P 77c617823f2e4a938ef247a8924e299b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.208876 25507 tablet_replica.cc:333] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b: stopping tablet replica
I20260709 13:10:30.209522 25507 raft_consensus.cc:2243] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:30.210757 25507 raft_consensus.cc:2272] T 5c18e1296ad84de08dd646beec73c343 P 77c617823f2e4a938ef247a8924e299b [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:31.265247 25507 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27342)
I20260709 13:10:31.527206 25507 tablet_server.cc:196] TabletServer@127.24.232.196:0 shutdown complete.
I20260709 13:10:31.578964 25507 master.cc:562] Master@127.24.232.254:38345 shutting down...
W20260709 13:10:31.619422 26558 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:10:31.619693 26558 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:31.619908 26558 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:32.081140 26494 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 13:10:32.084388 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78e89d788bee4a128b18985e582217d9: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
W20260709 13:10:34.084777 26494 catalog_manager.cc:4755] TS 687d192f79a044ce838f0bf292f0c09f (127.24.232.193:41483): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 272d473e821e4c15a9f3fa0471adfdc6: Network error: Client connection negotiation failed: client connection to 127.24.232.193:41483: connect: Connection refused (error 111)
I20260709 13:10:34.502303 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.502985 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.503341 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P d386a230fc3e442b8633387e891e63d1: stopping tablet replica
I20260709 13:10:34.627650 25507 master.cc:584] Master@127.24.232.254:38345 shutdown complete.
I20260709 13:10:34.667264 25507 test_util.cc:182] -----------------------------------------------
I20260709 13:10:34.667505 25507 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602376029226-25507-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (235414 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:10:34.670859 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:39959
I20260709 13:10:34.672143 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:34.677676  2033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:34.677685  2034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:34.680137  2036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:34.680645 25507 server_base.cc:1061] running on GCE node
I20260709 13:10:34.684048 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:34.684311 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:34.684477 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602634684459 us; error 0 us; skew 500 ppm
I20260709 13:10:34.685019 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:34.688004 25507 webserver.cc:533] Webserver started at http://127.24.232.254:43579/ using document root <none> and password file <none>
I20260709 13:10:34.688545 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:34.688756 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:34.689035 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:34.690305 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "aeb247cb566049d9a7cc92c0aae7dbb9"
format_stamp: "Formatted at 2026-07-09 13:10:34 on dist-test-slave-sdg5"
I20260709 13:10:34.694864 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:10:34.698436  2041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:34.699208 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:10:34.699529 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "aeb247cb566049d9a7cc92c0aae7dbb9"
format_stamp: "Formatted at 2026-07-09 13:10:34 on dist-test-slave-sdg5"
I20260709 13:10:34.699873 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:34.724162 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:34.725636 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:34.769461 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:39959
I20260709 13:10:34.769593  2092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:39959 every 8 connection(s)
I20260709 13:10:34.773849  2093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.786221  2093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: Bootstrap starting.
I20260709 13:10:34.791247  2093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.795750  2093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: No bootstrap required, opened a new log
I20260709 13:10:34.798013  2093 raft_consensus.cc:359] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER }
I20260709 13:10:34.798424  2093 raft_consensus.cc:385] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.798700  2093 raft_consensus.cc:740] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb247cb566049d9a7cc92c0aae7dbb9, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.799408  2093 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER }
I20260709 13:10:34.799958  2093 raft_consensus.cc:399] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:34.800171  2093 raft_consensus.cc:493] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:34.800468  2093 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.805508  2093 raft_consensus.cc:515] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER }
I20260709 13:10:34.806131  2093 leader_election.cc:304] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeb247cb566049d9a7cc92c0aae7dbb9; no voters: 
I20260709 13:10:34.807320  2093 leader_election.cc:290] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:34.807785  2096 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.809278  2096 raft_consensus.cc:697] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 1 LEADER]: Becoming Leader. State: Replica: aeb247cb566049d9a7cc92c0aae7dbb9, State: Running, Role: LEADER
I20260709 13:10:34.810019  2096 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER }
I20260709 13:10:34.810546  2093 sys_catalog.cc:565] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:34.814888  2097 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER } }
I20260709 13:10:34.820889  2098 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeb247cb566049d9a7cc92c0aae7dbb9. Latest consensus state: current_term: 1 leader_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb247cb566049d9a7cc92c0aae7dbb9" member_type: VOTER } }
I20260709 13:10:34.821344  2097 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:34.821580  2098 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:34.824307  2103 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:34.831049  2103 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:34.832222 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:34.840893  2103 catalog_manager.cc:1383] Generated new cluster ID: 72d242bc92d6411aa3df88de1bc68360
I20260709 13:10:34.841248  2103 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:34.863801  2103 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:34.865125  2103 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:34.877866  2103 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: Generated new TSK 0
I20260709 13:10:34.878530  2103 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:34.898820 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:34.905058  2114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:34.906849  2115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:34.910058  2117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:34.910383 25507 server_base.cc:1061] running on GCE node
I20260709 13:10:34.913280 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:34.913492 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:34.913622 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602634913611 us; error 0 us; skew 500 ppm
I20260709 13:10:34.914079 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:34.916507 25507 webserver.cc:533] Webserver started at http://127.24.232.193:38703/ using document root <none> and password file <none>
I20260709 13:10:34.916934 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:34.917085 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:34.917290 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:34.918388 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "e8b718068a784b5cabecfb16859665a4"
format_stamp: "Formatted at 2026-07-09 13:10:34 on dist-test-slave-sdg5"
I20260709 13:10:34.922896 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:34.926568  2122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:34.927408 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:34.927804 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "e8b718068a784b5cabecfb16859665a4"
format_stamp: "Formatted at 2026-07-09 13:10:34 on dist-test-slave-sdg5"
I20260709 13:10:34.928112 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:34.961584 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:34.962818 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:34.964350 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:34.966787 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:34.967017 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:34.967279 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:34.967471 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.009783 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:34297
I20260709 13:10:35.009886  2184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:34297 every 8 connection(s)
I20260709 13:10:35.015223 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.022297  2189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.022658  2190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.025357  2192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.027658 25507 server_base.cc:1061] running on GCE node
I20260709 13:10:35.028532  2185 heartbeater.cc:344] Connected to a master server at 127.24.232.254:39959
I20260709 13:10:35.028914  2185 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:35.029704  2185 heartbeater.cc:507] Master 127.24.232.254:39959 requested a full tablet report, sending...
I20260709 13:10:35.030481 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.030800 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.031013 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602635030993 us; error 0 us; skew 500 ppm
I20260709 13:10:35.031733 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.032239  2058 ts_manager.cc:194] Registered new tserver with Master: e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:35.034543 25507 webserver.cc:533] Webserver started at http://127.24.232.194:44051/ using document root <none> and password file <none>
I20260709 13:10:35.034914  2058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53984
I20260709 13:10:35.035202 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.035532 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.035869 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.037181 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "030f4f0790ed4737bfc5a454f29d1e67"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.041702 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:10:35.045531  2197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.046353 25507 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:35.046691 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "030f4f0790ed4737bfc5a454f29d1e67"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.047056 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.061210 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.062441 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.063977 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.066134 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.066367 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.066610 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.066787 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.108816 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:46655
I20260709 13:10:35.108927  2259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:46655 every 8 connection(s)
I20260709 13:10:35.113840 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.121644  2263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.123000  2264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.126482 25507 server_base.cc:1061] running on GCE node
W20260709 13:10:35.127183  2266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.127970  2260 heartbeater.cc:344] Connected to a master server at 127.24.232.254:39959
I20260709 13:10:35.128413  2260 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:35.128909 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:35.129240 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.129350  2260 heartbeater.cc:507] Master 127.24.232.254:39959 requested a full tablet report, sending...
I20260709 13:10:35.129503 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602635129485 us; error 0 us; skew 500 ppm
I20260709 13:10:35.130393 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.131913  2058 ts_manager.cc:194] Registered new tserver with Master: 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:35.133178 25507 webserver.cc:533] Webserver started at http://127.24.232.195:36181/ using document root <none> and password file <none>
I20260709 13:10:35.133879  2058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53990
I20260709 13:10:35.133992 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.134331 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.134734 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.136113 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "d815906ba3ba41ef8887f7e5b261553f"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.140550 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:35.143777  2271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.144558 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:35.145028 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "d815906ba3ba41ef8887f7e5b261553f"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.145555 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.164324 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.165639 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.167212 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.169641 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.169875 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.170125 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.170300 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.211989 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:41011
I20260709 13:10:35.212150  2333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:41011 every 8 connection(s)
I20260709 13:10:35.217144 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:35.224618  2337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:35.226922  2338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.228706 25507 server_base.cc:1061] running on GCE node
W20260709 13:10:35.229168  2340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:35.230228  2334 heartbeater.cc:344] Connected to a master server at 127.24.232.254:39959
I20260709 13:10:35.230607 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:35.230680  2334 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:35.231042 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:35.231269 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602635231252 us; error 0 us; skew 500 ppm
I20260709 13:10:35.231781  2334 heartbeater.cc:507] Master 127.24.232.254:39959 requested a full tablet report, sending...
I20260709 13:10:35.232110 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:35.234162  2058 ts_manager.cc:194] Registered new tserver with Master: d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:35.235251 25507 webserver.cc:533] Webserver started at http://127.24.232.196:42769/ using document root <none> and password file <none>
I20260709 13:10:35.235921 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:35.236160 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:35.236101  2058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54000
I20260709 13:10:35.236688 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:35.237919 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-3-root/instance:
uuid: "fd4fb5266da747deb5bece4024d936a7"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.242460 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:35.246078  2345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.246873 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:35.247233 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
uuid: "fd4fb5266da747deb5bece4024d936a7"
format_stamp: "Formatted at 2026-07-09 13:10:35 on dist-test-slave-sdg5"
I20260709 13:10:35.247617 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:35.269551 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:35.270818 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:35.272351 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:35.274507 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:35.274739 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.275012 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:35.275189 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:35.317467 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.196:36647
I20260709 13:10:35.317564  2407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.196:36647 every 8 connection(s)
I20260709 13:10:35.335390  2408 heartbeater.cc:344] Connected to a master server at 127.24.232.254:39959
I20260709 13:10:35.335829  2408 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:35.336539  2408 heartbeater.cc:507] Master 127.24.232.254:39959 requested a full tablet report, sending...
I20260709 13:10:35.338418  2058 ts_manager.cc:194] Registered new tserver with Master: fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:35.339064 25507 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018323088s
I20260709 13:10:35.340153  2058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54006
I20260709 13:10:35.364856  2058 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54012:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:10:35.615087  2225 tablet_service.cc:1511] Processing CreateTablet for tablet c5ec0fc46c1a4c17bfd2365bae887fef (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:35.616648  2225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ec0fc46c1a4c17bfd2365bae887fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.620786  2224 tablet_service.cc:1511] Processing CreateTablet for tablet d3eb1da29ee2465dbde39c0fbab92e02 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:35.622277  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3eb1da29ee2465dbde39c0fbab92e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.624729  2222 tablet_service.cc:1511] Processing CreateTablet for tablet 81f14baaa48c49a7af6015e316412405 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:35.625100  2221 tablet_service.cc:1511] Processing CreateTablet for tablet 791cf48580174beebd42190628c6d944 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:35.625211  2223 tablet_service.cc:1511] Processing CreateTablet for tablet 25d2543e217d4435ac6c5d4291853933 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:35.626320  2222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f14baaa48c49a7af6015e316412405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.626979  2223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d2543e217d4435ac6c5d4291853933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.628438  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791cf48580174beebd42190628c6d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.630642  2220 tablet_service.cc:1511] Processing CreateTablet for tablet e79c83b7c75f4271b2a7814b1cc83f25 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:35.632448  2220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c83b7c75f4271b2a7814b1cc83f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.635790  2219 tablet_service.cc:1511] Processing CreateTablet for tablet ba7611fef54f45fc86c75f42ba1d83cc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:35.637187  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7611fef54f45fc86c75f42ba1d83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.639781  2373 tablet_service.cc:1511] Processing CreateTablet for tablet d3eb1da29ee2465dbde39c0fbab92e02 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:35.641263  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3eb1da29ee2465dbde39c0fbab92e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.641189  2150 tablet_service.cc:1511] Processing CreateTablet for tablet c5ec0fc46c1a4c17bfd2365bae887fef (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:35.642649  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ec0fc46c1a4c17bfd2365bae887fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.644954  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 8715de42fd7d4b2b825e082594d4a654 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:35.646462  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8715de42fd7d4b2b825e082594d4a654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.644954  2368 tablet_service.cc:1511] Processing CreateTablet for tablet e79c83b7c75f4271b2a7814b1cc83f25 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:35.648432  2368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c83b7c75f4271b2a7814b1cc83f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.648461  2370 tablet_service.cc:1511] Processing CreateTablet for tablet 791cf48580174beebd42190628c6d944 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:35.649739  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7f38d8faec46fdb1b78d7295af42a6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:35.650573  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791cf48580174beebd42190628c6d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.654158  2371 tablet_service.cc:1511] Processing CreateTablet for tablet 25d2543e217d4435ac6c5d4291853933 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:35.657146  2371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d2543e217d4435ac6c5d4291853933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.660065  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7f38d8faec46fdb1b78d7295af42a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.673705  2299 tablet_service.cc:1511] Processing CreateTablet for tablet c5ec0fc46c1a4c17bfd2365bae887fef (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:35.674773  2296 tablet_service.cc:1511] Processing CreateTablet for tablet 81f14baaa48c49a7af6015e316412405 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:35.675308  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ec0fc46c1a4c17bfd2365bae887fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.676252  2296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f14baaa48c49a7af6015e316412405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.677600  2298 tablet_service.cc:1511] Processing CreateTablet for tablet 8715de42fd7d4b2b825e082594d4a654 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:35.678987  2298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8715de42fd7d4b2b825e082594d4a654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.680950  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7f38d8faec46fdb1b78d7295af42a6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:35.682286  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7f38d8faec46fdb1b78d7295af42a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.684964  2294 tablet_service.cc:1511] Processing CreateTablet for tablet e79c83b7c75f4271b2a7814b1cc83f25 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:35.686519  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c83b7c75f4271b2a7814b1cc83f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.688951  2293 tablet_service.cc:1511] Processing CreateTablet for tablet ba7611fef54f45fc86c75f42ba1d83cc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:35.689596  2149 tablet_service.cc:1511] Processing CreateTablet for tablet d3eb1da29ee2465dbde39c0fbab92e02 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:35.690551  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7611fef54f45fc86c75f42ba1d83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.691062  2149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3eb1da29ee2465dbde39c0fbab92e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.692911  2218 tablet_service.cc:1511] Processing CreateTablet for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:35.694263  2218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.696610  2217 tablet_service.cc:1511] Processing CreateTablet for tablet a3e5799014e34cefa5db5e5147740a98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:35.697449  2148 tablet_service.cc:1511] Processing CreateTablet for tablet 8715de42fd7d4b2b825e082594d4a654 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:35.698823  2148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8715de42fd7d4b2b825e082594d4a654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.684968  2297 tablet_service.cc:1511] Processing CreateTablet for tablet 25d2543e217d4435ac6c5d4291853933 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:35.704540  2297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d2543e217d4435ac6c5d4291853933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.708441  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e5799014e34cefa5db5e5147740a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.725529  2143 tablet_service.cc:1511] Processing CreateTablet for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:35.727123  2143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.736510  2428 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:35.739328  2146 tablet_service.cc:1511] Processing CreateTablet for tablet 791cf48580174beebd42190628c6d944 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:35.739688  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7f38d8faec46fdb1b78d7295af42a6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:35.740818  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791cf48580174beebd42190628c6d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.741614  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7f38d8faec46fdb1b78d7295af42a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.741789  2367 tablet_service.cc:1511] Processing CreateTablet for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:35.743292  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e6f3e3a23c4711bd7d8c6f2a624e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.742908  2291 tablet_service.cc:1511] Processing CreateTablet for tablet a3e5799014e34cefa5db5e5147740a98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:35.744340  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e5799014e34cefa5db5e5147740a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.744891  2366 tablet_service.cc:1511] Processing CreateTablet for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:35.748265  2366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.748973  2144 tablet_service.cc:1511] Processing CreateTablet for tablet ba7611fef54f45fc86c75f42ba1d83cc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:35.729043  2147 tablet_service.cc:1511] Processing CreateTablet for tablet 81f14baaa48c49a7af6015e316412405 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:35.752961  2292 tablet_service.cc:1511] Processing CreateTablet for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:35.754338  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.729028  2142 tablet_service.cc:1511] Processing CreateTablet for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:35.784137  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7611fef54f45fc86c75f42ba1d83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.787386  2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f14baaa48c49a7af6015e316412405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.792047  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9981aab8ad0c4366b6fb8bd99b57e6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.803711  2428 tablet_bootstrap.cc:654] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.824157  2429 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
W20260709 13:10:35.828528  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:35.825632  2368 tablet_service.cc:1511] Processing CreateTablet for tablet a3e5799014e34cefa5db5e5147740a98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:35.840247  2431 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:35.843954  2368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e5799014e34cefa5db5e5147740a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.846958  2431 tablet_bootstrap.cc:654] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.866605  2430 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:35.874176  2429 tablet_bootstrap.cc:654] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.877046  2146 tablet_service.cc:1511] Processing CreateTablet for tablet e122c6caef20456896b39c5eef556a78 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:35.885497  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e122c6caef20456896b39c5eef556a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.889011  2430 tablet_bootstrap.cc:654] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.893541  2224 tablet_service.cc:1511] Processing CreateTablet for tablet e122c6caef20456896b39c5eef556a78 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:35.896710  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e122c6caef20456896b39c5eef556a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.896744  2367 tablet_service.cc:1511] Processing CreateTablet for tablet 6820d35ebf7d4653abe467f32fbfffb6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:35.907825  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6820d35ebf7d4653abe467f32fbfffb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.908097  2428 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:35.908666  2428 ts_tablet_manager.cc:1403] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.000s
I20260709 13:10:35.913504  2150 tablet_service.cc:1511] Processing CreateTablet for tablet 6820d35ebf7d4653abe467f32fbfffb6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:35.915027  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6820d35ebf7d4653abe467f32fbfffb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.915916  2292 tablet_service.cc:1511] Processing CreateTablet for tablet e122c6caef20456896b39c5eef556a78 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:35.921273  2430 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:35.921904  2430 ts_tablet_manager.cc:1403] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.009s
I20260709 13:10:35.924100  2428 raft_consensus.cc:359] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.924957  2428 raft_consensus.cc:385] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.925173  2430 raft_consensus.cc:359] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.926146  2430 raft_consensus.cc:385] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.926589  2430 raft_consensus.cc:740] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.925941  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e122c6caef20456896b39c5eef556a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.927753  2430 consensus_queue.cc:260] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.925298  2428 raft_consensus.cc:740] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.933769  2428 consensus_queue.cc:260] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.939853  2429 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:35.940567  2429 ts_tablet_manager.cc:1403] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.004s
I20260709 13:10:35.942431  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 6820d35ebf7d4653abe467f32fbfffb6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:35.943975  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6820d35ebf7d4653abe467f32fbfffb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.944468  2431 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:35.945003  2431 ts_tablet_manager.cc:1403] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.012s
I20260709 13:10:35.945863  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2da80d88594f89a913a340eea355d9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:35.947325  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2da80d88594f89a913a340eea355d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.948748  2431 raft_consensus.cc:359] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.949587  2431 raft_consensus.cc:385] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.949890  2431 raft_consensus.cc:740] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.950771  2431 consensus_queue.cc:260] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:35.955619  2373 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2da80d88594f89a913a340eea355d9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:35.957012  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2da80d88594f89a913a340eea355d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.962397  2185 heartbeater.cc:499] Master 127.24.232.254:39959 was elected leader, sending a full tablet report...
I20260709 13:10:35.962538  2218 tablet_service.cc:1511] Processing CreateTablet for tablet d3ff066c4d7042ddace1185779bcfc97 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:35.963634  2430 ts_tablet_manager.cc:1434] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.005s
I20260709 13:10:35.964404  2218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ff066c4d7042ddace1185779bcfc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.964917  2430 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:35.962538  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2da80d88594f89a913a340eea355d9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:35.972316  2430 tablet_bootstrap.cc:654] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.973532  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2da80d88594f89a913a340eea355d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.977784  2429 raft_consensus.cc:359] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:35.978941  2429 raft_consensus.cc:385] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.979337  2429 raft_consensus.cc:740] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.980400  2429 consensus_queue.cc:260] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:35.992017  2334 heartbeater.cc:499] Master 127.24.232.254:39959 was elected leader, sending a full tablet report...
I20260709 13:10:35.993556  2260 heartbeater.cc:499] Master 127.24.232.254:39959 was elected leader, sending a full tablet report...
I20260709 13:10:35.994556  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfe584445644027a6adf14def8b44f9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:35.991838  2293 tablet_service.cc:1511] Processing CreateTablet for tablet d3ff066c4d7042ddace1185779bcfc97 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:35.995927  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfe584445644027a6adf14def8b44f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:35.996671  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ff066c4d7042ddace1185779bcfc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.001217  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfe584445644027a6adf14def8b44f9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:36.005348  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 035e31f9034b4c46beab764ce654d702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:36.007005  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e31f9034b4c46beab764ce654d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.007571  2428 ts_tablet_manager.cc:1434] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.099s	user 0.021s	sys 0.021s
I20260709 13:10:36.008713  2428 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:36.008955  2221 tablet_service.cc:1511] Processing CreateTablet for tablet 035e31f9034b4c46beab764ce654d702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:36.010088  2146 tablet_service.cc:1511] Processing CreateTablet for tablet 035e31f9034b4c46beab764ce654d702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:36.011148  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfe584445644027a6adf14def8b44f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.011435  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e31f9034b4c46beab764ce654d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.014281  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfe584445644027a6adf14def8b44f9 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 13:10:36.014842  2186 tablet.cc:2406] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:36.010475  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e31f9034b4c46beab764ce654d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.016786  2367 tablet_service.cc:1511] Processing CreateTablet for tablet d3ff066c4d7042ddace1185779bcfc97 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:36.031117  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ff066c4d7042ddace1185779bcfc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.018087  2430 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:36.028463  2142 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:36.032639  2430 ts_tablet_manager.cc:1403] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.001s
I20260709 13:10:36.032406  2219 tablet_service.cc:1511] Processing CreateTablet for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:36.033100  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.033828  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.032437  2431 ts_tablet_manager.cc:1434] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.003s
I20260709 13:10:36.037168  2431 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:36.036821  2292 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:36.036697  2368 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:36.035853  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfe584445644027a6adf14def8b44f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.040760  2430 raft_consensus.cc:359] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.041620  2430 raft_consensus.cc:385] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.041963  2430 raft_consensus.cc:740] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.043027  2368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.042830  2430 consensus_queue.cc:260] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.049273  2428 tablet_bootstrap.cc:654] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.053433  2370 tablet_service.cc:1511] Processing CreateTablet for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:36.053685  2294 tablet_service.cc:1511] Processing CreateTablet for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:36.054944  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.054975  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9d61ad9bc4e6dbfb3b264e1fc2805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.085861  2431 tablet_bootstrap.cc:654] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.086650  2408 heartbeater.cc:499] Master 127.24.232.254:39959 was elected leader, sending a full tablet report...
I20260709 13:10:36.096230  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f50d9d2d54028a40b1d72fb5a6bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.098598  2299 tablet_service.cc:1511] Processing CreateTablet for tablet 62d3ef1464da4fef82b6b02de793694c (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:36.100684  2220 tablet_service.cc:1511] Processing CreateTablet for tablet 62d3ef1464da4fef82b6b02de793694c (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:36.102064  2220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d3ef1464da4fef82b6b02de793694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.104031  2436 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.104552  2436 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.105031  2430 ts_tablet_manager.cc:1434] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:10:36.106230  2430 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:36.109810  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 62d3ef1464da4fef82b6b02de793694c (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:36.109720  2436 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:36.111431  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d3ef1464da4fef82b6b02de793694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.112162  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d3ef1464da4fef82b6b02de793694c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.124951  2429 ts_tablet_manager.cc:1434] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.184s	user 0.011s	sys 0.006s
I20260709 13:10:36.126497  2429 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:36.140933  2429 tablet_bootstrap.cc:654] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.141049  2372 tablet_service.cc:1511] Processing CreateTablet for tablet f9cf437aef6b4035aec14b3974a896ae (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:36.143293  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cf437aef6b4035aec14b3974a896ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.154780  2150 tablet_service.cc:1511] Processing CreateTablet for tablet f9cf437aef6b4035aec14b3974a896ae (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:36.160915  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cf437aef6b4035aec14b3974a896ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.165630  2295 tablet_service.cc:1511] Processing CreateTablet for tablet cd4827539b954a14b8ce1a0ca348a353 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:36.167376  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4827539b954a14b8ce1a0ca348a353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.192570  2437 raft_consensus.cc:493] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.193162  2437 raft_consensus.cc:515] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.195227  2428 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:36.195811  2428 ts_tablet_manager.cc:1403] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.032s
I20260709 13:10:36.198930  2428 raft_consensus.cc:359] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.198988  2221 tablet_service.cc:1511] Processing CreateTablet for tablet f9cf437aef6b4035aec14b3974a896ae (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:36.203869  2428 raft_consensus.cc:385] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.204238  2428 raft_consensus.cc:740] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.204589  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cf437aef6b4035aec14b3974a896ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.205184  2428 consensus_queue.cc:260] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.206606  2370 tablet_service.cc:1511] Processing CreateTablet for tablet cd4827539b954a14b8ce1a0ca348a353 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:36.208060  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4827539b954a14b8ce1a0ca348a353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.214648  2430 tablet_bootstrap.cc:654] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.215247  2436 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.218648  2436 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.219022  2145 tablet_service.cc:1511] Processing CreateTablet for tablet cd4827539b954a14b8ce1a0ca348a353 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:36.220376  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4827539b954a14b8ce1a0ca348a353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.221118  2436 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.226662  2437 leader_election.cc:290] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:36.249321  2429 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:36.250066  2429 ts_tablet_manager.cc:1403] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.008s
I20260709 13:10:36.265749  2219 tablet_service.cc:1511] Processing CreateTablet for tablet fc8f4ba6025b41a5b7acfa364c00c104 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:36.273486  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8f4ba6025b41a5b7acfa364c00c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.295359  2438 raft_consensus.cc:493] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.295976  2438 raft_consensus.cc:515] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.307339  2429 raft_consensus.cc:359] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.308674  2429 raft_consensus.cc:385] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.309134  2429 raft_consensus.cc:740] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.311844  2438 leader_election.cc:290] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.309015  2428 ts_tablet_manager.cc:1434] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.113s	user 0.015s	sys 0.017s
I20260709 13:10:36.352771  2428 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:36.367691  2431 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:36.368316  2431 ts_tablet_manager.cc:1403] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.332s	user 0.022s	sys 0.017s
I20260709 13:10:36.368541  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:36.370357  2124 leader_election.cc:343] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.321193  2429 consensus_queue.cc:260] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.380290  2440 raft_consensus.cc:493] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.387524  2440 raft_consensus.cc:515] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.371599  2431 raft_consensus.cc:359] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.396168  2440 leader_election.cc:290] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:36.404811  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:36.417171  2235 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:36.409627  2368 tablet_service.cc:1511] Processing CreateTablet for tablet fc8f4ba6025b41a5b7acfa364c00c104 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:36.410688  2150 tablet_service.cc:1511] Processing CreateTablet for tablet 78ff2c9d85f64480be1ad48eba7c6c5f (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:36.405076  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:36.403530  2430 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:36.404412  2431 raft_consensus.cc:385] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.427803  2440 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.429417  2126 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:36.428871  2440 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.430676  2436 raft_consensus.cc:2804] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.431159  2436 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.431749  2436 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.432750  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ff2c9d85f64480be1ad48eba7c6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.435307  2368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8f4ba6025b41a5b7acfa364c00c104. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:36.431267  2126 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.426087  2431 raft_consensus.cc:740] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.455889  2295 tablet_service.cc:1511] Processing CreateTablet for tablet fc8f4ba6025b41a5b7acfa364c00c104 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:36.457968  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8f4ba6025b41a5b7acfa364c00c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.457551  2431 consensus_queue.cc:260] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.461032  2431 ts_tablet_manager.cc:1434] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.001s
I20260709 13:10:36.462319  2431 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:36.467522  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:36.468519  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 78ff2c9d85f64480be1ad48eba7c6c5f (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:10:36.469272  2198 leader_election.cc:343] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.469894  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ff2c9d85f64480be1ad48eba7c6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.467585  2430 ts_tablet_manager.cc:1403] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.335s	user 0.028s	sys 0.013s
I20260709 13:10:36.490211  2144 tablet_service.cc:1511] Processing CreateTablet for tablet ce0fc298147e494fadd29bc6f429c1f8 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:36.492249  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0fc298147e494fadd29bc6f429c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.511511  2219 tablet_service.cc:1511] Processing CreateTablet for tablet ce0fc298147e494fadd29bc6f429c1f8 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:36.513057  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0fc298147e494fadd29bc6f429c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.517701  2428 tablet_bootstrap.cc:654] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.524354  2429 ts_tablet_manager.cc:1434] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.274s	user 0.017s	sys 0.005s
I20260709 13:10:36.524847  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:36.525547  2429 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:36.526355  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 535d380792024fadb561b39a0e80f7e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:36.527278  2293 tablet_service.cc:1511] Processing CreateTablet for tablet 78ff2c9d85f64480be1ad48eba7c6c5f (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:36.527781  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d380792024fadb561b39a0e80f7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.528651  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ff2c9d85f64480be1ad48eba7c6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:36.529680  2347 leader_election.cc:343] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.529744  2440 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.533339  2367 tablet_service.cc:1511] Processing CreateTablet for tablet ce0fc298147e494fadd29bc6f429c1f8 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:36.538218  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0fc298147e494fadd29bc6f429c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.542670  2429 tablet_bootstrap.cc:654] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.518832  2430 raft_consensus.cc:359] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.546072  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:36.555321  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 6b477970d0584d3db6ce2eccbfc45617 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:10:36.556702  2272 leader_election.cc:343] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.556592  2373 tablet_service.cc:1511] Processing CreateTablet for tablet 535d380792024fadb561b39a0e80f7e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:36.557950  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d380792024fadb561b39a0e80f7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.558202  2146 tablet_service.cc:1511] Processing CreateTablet for tablet ae6d76be90254ddb84a418f4fd751562 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:36.558888  2430 raft_consensus.cc:385] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.559230  2430 raft_consensus.cc:740] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.555303  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:36.560370  2383 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:36.560163  2430 consensus_queue.cc:260] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.556732  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b477970d0584d3db6ce2eccbfc45617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.559516  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6d76be90254ddb84a418f4fd751562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.563881  2436 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.564771  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 6b477970d0584d3db6ce2eccbfc45617 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:36.566105  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b477970d0584d3db6ce2eccbfc45617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.566560  2436 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:36.568760  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:36.566977  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:36.570677  2234 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.570868  2124 leader_election.cc:343] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.553437  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 6b477970d0584d3db6ce2eccbfc45617 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:36.558393  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:36.551059  2142 tablet_service.cc:1511] Processing CreateTablet for tablet 535d380792024fadb561b39a0e80f7e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:36.586002  2123 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:36.583359  2309 raft_consensus.cc:2468] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:36.592326  2199 leader_election.cc:304] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.595588  2448 raft_consensus.cc:2804] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.596002  2448 raft_consensus.cc:493] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.596335  2448 raft_consensus.cc:3060] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.597297  2221 tablet_service.cc:1511] Processing CreateTablet for tablet ae6d76be90254ddb84a418f4fd751562 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:36.597889  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d380792024fadb561b39a0e80f7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.599229  2430 ts_tablet_manager.cc:1434] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.127s	user 0.000s	sys 0.017s
I20260709 13:10:36.597599  2234 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:36.590176  2436 raft_consensus.cc:2804] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.603998  2436 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.600682  2126 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:36.605327  2436 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.606405  2292 tablet_service.cc:1511] Processing CreateTablet for tablet ae6d76be90254ddb84a418f4fd751562 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:36.607883  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6d76be90254ddb84a418f4fd751562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.617031  2430 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:36.623677  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:36.625757  2349 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.602928  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b477970d0584d3db6ce2eccbfc45617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.633421  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6d76be90254ddb84a418f4fd751562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.636189  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:36.637172  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:36.638675  2346 leader_election.cc:343] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.639133  2346 leader_election.cc:304] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.640313  2440 raft_consensus.cc:2749] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.644337  2436 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.645618  2159 raft_consensus.cc:2393] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:36.647253  2430 tablet_bootstrap.cc:654] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.654150  2431 tablet_bootstrap.cc:654] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.650983  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:36.663959  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:36.650826  2448 raft_consensus.cc:515] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.657779  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:36.664906  2370 tablet_service.cc:1511] Processing CreateTablet for tablet b7ae74c702234728abca428ef7868d6a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:36.665232  2383 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.665638  2126 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.666289  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ae74c702234728abca428ef7868d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.659895  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 816062140ff0488493bee4a5d1a50872 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:36.668867  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816062140ff0488493bee4a5d1a50872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.659895  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 816062140ff0488493bee4a5d1a50872 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:36.672840  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816062140ff0488493bee4a5d1a50872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.672714  2293 tablet_service.cc:1511] Processing CreateTablet for tablet b7ae74c702234728abca428ef7868d6a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:36.674626  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ae74c702234728abca428ef7868d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.661425  2219 tablet_service.cc:1511] Processing CreateTablet for tablet 816062140ff0488493bee4a5d1a50872 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:36.662928  2436 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.676141  2436 raft_consensus.cc:2804] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.676476  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816062140ff0488493bee4a5d1a50872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.676600  2436 raft_consensus.cc:697] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:36.677510  2436 consensus_queue.cc:237] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.680431  2234 raft_consensus.cc:2393] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:36.682698  2448 leader_election.cc:290] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:36.683421  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:36.684670  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:36.685323  2309 raft_consensus.cc:3060] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.685773  2198 leader_election.cc:343] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.690109  2346 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.693085  2275 leader_election.cc:304] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.696081  2309 raft_consensus.cc:2468] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:36.696650  2438 raft_consensus.cc:2749] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.699704  2199 leader_election.cc:304] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.700632  2437 raft_consensus.cc:2804] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.722572  2383 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:36.723302  2440 raft_consensus.cc:2749] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.723950  2123 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:36.726392  2436 raft_consensus.cc:2804] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.727815  2436 raft_consensus.cc:697] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:36.727459  2057 catalog_manager.cc:5697] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.728727  2436 consensus_queue.cc:237] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.730331  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 1c273a3ff30d4d62834d75d88cd4a1f3 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:36.733490  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c273a3ff30d4d62834d75d88cd4a1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.732963  2150 tablet_service.cc:1511] Processing CreateTablet for tablet b7ae74c702234728abca428ef7868d6a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:36.736112  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ae74c702234728abca428ef7868d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.743701  2428 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:36.753927  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 1c273a3ff30d4d62834d75d88cd4a1f3 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:36.755245  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c273a3ff30d4d62834d75d88cd4a1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.754501  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 1c273a3ff30d4d62834d75d88cd4a1f3 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:36.756721  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c273a3ff30d4d62834d75d88cd4a1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.756875  2430 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:36.719100  2437 raft_consensus.cc:697] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:36.758872  2430 ts_tablet_manager.cc:1403] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.144s	user 0.021s	sys 0.010s
I20260709 13:10:36.784721  2430 raft_consensus.cc:359] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.767840  2221 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad318e5e24a45798f5fb6553649cf1b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:36.791812  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad318e5e24a45798f5fb6553649cf1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.760221  2428 ts_tablet_manager.cc:1403] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.408s	user 0.018s	sys 0.001s
I20260709 13:10:36.768535  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad318e5e24a45798f5fb6553649cf1b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:36.800482  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad318e5e24a45798f5fb6553649cf1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.802946  2431 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:36.781483  2429 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:36.804220  2429 ts_tablet_manager.cc:1403] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.279s	user 0.018s	sys 0.057s
I20260709 13:10:36.766347  2437 consensus_queue.cc:237] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.792899  2430 raft_consensus.cc:385] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.808226  2430 raft_consensus.cc:740] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.803507  2431 ts_tablet_manager.cc:1403] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.341s	user 0.017s	sys 0.000s
I20260709 13:10:36.809124  2430 consensus_queue.cc:260] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.814240  2428 raft_consensus.cc:359] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:36.815231  2428 raft_consensus.cc:385] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.815421  2373 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e1edc577347899d4aaf8332c28496 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:36.811913  2431 raft_consensus.cc:359] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.807511  2429 raft_consensus.cc:359] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:36.816823  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e1edc577347899d4aaf8332c28496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.815645  2428 raft_consensus.cc:740] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.818233  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad318e5e24a45798f5fb6553649cf1b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:36.824492  2428 consensus_queue.cc:260] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:36.825284  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad318e5e24a45798f5fb6553649cf1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.811857  2430 ts_tablet_manager.cc:1434] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:10:36.819341  2146 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e1edc577347899d4aaf8332c28496 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:36.833106  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e1edc577347899d4aaf8332c28496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.833138  2430 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:36.820528  2429 raft_consensus.cc:385] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:36.833721  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:36.833988  2219 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e1edc577347899d4aaf8332c28496 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:36.836436  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e1edc577347899d4aaf8332c28496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.840967  2430 tablet_bootstrap.cc:654] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.835417  2429 raft_consensus.cc:740] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.844619  2429 consensus_queue.cc:260] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:36.861718  2438 raft_consensus.cc:493] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.819883  2431 raft_consensus.cc:385] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.862571  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 180bf6c8966b4ff5893bcb6546af5b36 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:36.863037  2431 raft_consensus.cc:740] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.862305  2438 raft_consensus.cc:515] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:36.864017  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180bf6c8966b4ff5893bcb6546af5b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.863719  2367 tablet_service.cc:1511] Processing CreateTablet for tablet 180bf6c8966b4ff5893bcb6546af5b36 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:36.864125  2431 consensus_queue.cc:260] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.865037  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180bf6c8966b4ff5893bcb6546af5b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.859709  2429 ts_tablet_manager.cc:1434] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:10:36.873324  2430 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:36.873526  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:36.873903  2430 ts_tablet_manager.cc:1403] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.010s
I20260709 13:10:36.865535  2438 leader_election.cc:290] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:36.882280  2468 raft_consensus.cc:493] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.882982  2468 raft_consensus.cc:515] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:36.883827  2429 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:36.885717  2468 leader_election.cc:290] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:36.885627  2292 tablet_service.cc:1511] Processing CreateTablet for tablet c66d9240adb241b7a06f6b87f810a07d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:36.887135  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d9240adb241b7a06f6b87f810a07d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:36.888057  2272 leader_election.cc:343] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.890203  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:36.890823  2429 tablet_bootstrap.cc:654] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.900142  2146 tablet_service.cc:1511] Processing CreateTablet for tablet 180bf6c8966b4ff5893bcb6546af5b36 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:36.904441  2150 tablet_service.cc:1511] Processing CreateTablet for tablet 70e196c60e9b45efa369f89f86c94fba (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:10:36.906203  2199 leader_election.cc:343] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.907341  2428 ts_tablet_manager.cc:1434] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.002s
I20260709 13:10:36.908452  2428 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:36.908927  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e196c60e9b45efa369f89f86c94fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.915987  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180bf6c8966b4ff5893bcb6546af5b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.919991  2370 tablet_service.cc:1511] Processing CreateTablet for tablet c66d9240adb241b7a06f6b87f810a07d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:36.875224  2221 tablet_service.cc:1511] Processing CreateTablet for tablet c66d9240adb241b7a06f6b87f810a07d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:36.925427  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d9240adb241b7a06f6b87f810a07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.921849  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d9240adb241b7a06f6b87f810a07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.934093  2438 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.934684  2438 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:36.937774  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:36.939422  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:36.940249  2234 raft_consensus.cc:2393] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:36.937681  2219 tablet_service.cc:1511] Processing CreateTablet for tablet 70e196c60e9b45efa369f89f86c94fba (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:36.941603  2275 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:36.942054  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e196c60e9b45efa369f89f86c94fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.942451  2438 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.943523  2438 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.946782  2428 tablet_bootstrap.cc:654] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.956820  2431 ts_tablet_manager.cc:1434] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.148s	user 0.040s	sys 0.036s
I20260709 13:10:36.958011  2431 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:36.958140  2056 catalog_manager.cc:5697] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.960732  2293 tablet_service.cc:1511] Processing CreateTablet for tablet 70e196c60e9b45efa369f89f86c94fba (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:36.962154  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e196c60e9b45efa369f89f86c94fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.972477  2436 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.973050  2436 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.975171  2436 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:36.950440  2430 raft_consensus.cc:359] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:36.983182  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:36.984061  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
W20260709 13:10:36.984766  2126 leader_election.cc:343] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:36.985555  2123 leader_election.cc:343] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.985991  2123 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:36.987098  2436 raft_consensus.cc:2749] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.988838  2373 tablet_service.cc:1511] Processing CreateTablet for tablet ebfdf679af35482aae92603bd8daea67 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:36.997329  2438 raft_consensus.cc:2749] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.998018  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfdf679af35482aae92603bd8daea67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.002708  2431 tablet_bootstrap.cc:654] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.004001  2142 tablet_service.cc:1511] Processing CreateTablet for tablet ebfdf679af35482aae92603bd8daea67 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:36.979887  2430 raft_consensus.cc:385] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.010865  2221 tablet_service.cc:1511] Processing CreateTablet for tablet ebfdf679af35482aae92603bd8daea67 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:37.013008  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfdf679af35482aae92603bd8daea67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.019318  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfdf679af35482aae92603bd8daea67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.019881  2369 tablet_service.cc:1511] Processing CreateTablet for tablet acf0b0e9a47d459fbfb6ddbe46c0775d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:37.019985  2291 tablet_service.cc:1511] Processing CreateTablet for tablet acf0b0e9a47d459fbfb6ddbe46c0775d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:37.022608  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf0b0e9a47d459fbfb6ddbe46c0775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.023707  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf0b0e9a47d459fbfb6ddbe46c0775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.032022  2145 tablet_service.cc:1511] Processing CreateTablet for tablet acf0b0e9a47d459fbfb6ddbe46c0775d (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:37.033421  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf0b0e9a47d459fbfb6ddbe46c0775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.033586  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1947b4022a46aab1955bb0dce5dd55 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:37.034878  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1947b4022a46aab1955bb0dce5dd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.012177  2430 raft_consensus.cc:740] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.038551  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.039093  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1947b4022a46aab1955bb0dce5dd55 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:37.055423  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1947b4022a46aab1955bb0dce5dd55. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.055599  2198 leader_election.cc:343] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.055138  2430 consensus_queue.cc:260] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.056110  2198 leader_election.cc:304] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:37.044478  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.057236  2437 raft_consensus.cc:2749] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:37.058691  2272 leader_election.cc:343] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.059391  2428 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:37.059357  2272 leader_election.cc:304] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:37.060228  2428 ts_tablet_manager.cc:1403] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.152s	user 0.007s	sys 0.010s
I20260709 13:10:37.060889  2438 raft_consensus.cc:2749] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.095897  2429 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:37.096470  2429 ts_tablet_manager.cc:1403] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.025s
I20260709 13:10:37.099472  2429 raft_consensus.cc:359] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.100188  2429 raft_consensus.cc:385] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.100469  2429 raft_consensus.cc:740] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.101274  2429 consensus_queue.cc:260] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.103149  2430 ts_tablet_manager.cc:1434] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.229s	user 0.011s	sys 0.002s
I20260709 13:10:37.104249  2430 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:37.103461  2429 ts_tablet_manager.cc:1434] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:37.108541  2429 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:37.114706  2429 tablet_bootstrap.cc:654] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.121762  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d31cd8714661a570f28b72be8656 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:37.123127  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d31cd8714661a570f28b72be8656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.122979  2150 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d31cd8714661a570f28b72be8656 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:37.124764  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d31cd8714661a570f28b72be8656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.121803  2428 raft_consensus.cc:359] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.127223  2428 raft_consensus.cc:385] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.127549  2428 raft_consensus.cc:740] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.128569  2428 consensus_queue.cc:260] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.131189  2428 ts_tablet_manager.cc:1434] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:10:37.136772  2436 consensus_queue.cc:1048] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.143465  2293 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d31cd8714661a570f28b72be8656 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:37.144881  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d31cd8714661a570f28b72be8656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.147307  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8e58e88e0d4361b02e63a537424cfc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:37.148716  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8e58e88e0d4361b02e63a537424cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.148813  2430 tablet_bootstrap.cc:654] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.151472  2436 raft_consensus.cc:493] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.152336  2428 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:37.152070  2436 raft_consensus.cc:515] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.155153  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:37.158532  2436 leader_election.cc:290] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:37.159827  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.160660  2308 raft_consensus.cc:2393] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:37.167680  2124 leader_election.cc:304] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.182575  2440 raft_consensus.cc:493] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.183128  2440 raft_consensus.cc:515] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.185367  2440 leader_election.cc:290] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:37.169693  2436 raft_consensus.cc:3060] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.187861  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:37.188743  2428 tablet_bootstrap.cc:654] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.189062  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:37.199033  2349 leader_election.cc:343] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:37.202919  2347 leader_election.cc:343] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.203469  2347 leader_election.cc:304] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.204363  2440 raft_consensus.cc:2749] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.205524  2431 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:37.206101  2431 ts_tablet_manager.cc:1403] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.248s	user 0.005s	sys 0.011s
I20260709 13:10:37.207230  2436 raft_consensus.cc:2749] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.209443  2429 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:37.212240  2429 ts_tablet_manager.cc:1403] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.005s
I20260709 13:10:37.215498  2429 raft_consensus.cc:359] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.216313  2429 raft_consensus.cc:385] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.216665  2429 raft_consensus.cc:740] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.217135  2431 raft_consensus.cc:359] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.217895  2431 raft_consensus.cc:385] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.217545  2429 consensus_queue.cc:260] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.218219  2431 raft_consensus.cc:740] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.224125  2370 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1947b4022a46aab1955bb0dce5dd55 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:37.224514  2429 ts_tablet_manager.cc:1434] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:37.224545  2430 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:37.225471  2430 ts_tablet_manager.cc:1403] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.121s	user 0.008s	sys 0.014s
I20260709 13:10:37.225600  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1947b4022a46aab1955bb0dce5dd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.226074  2429 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:37.229750  2430 raft_consensus.cc:359] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.230786  2430 raft_consensus.cc:385] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.231173  2430 raft_consensus.cc:740] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.231791  2431 consensus_queue.cc:260] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.232811  2429 tablet_bootstrap.cc:654] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.232084  2430 consensus_queue.cc:260] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.234616  2431 ts_tablet_manager.cc:1434] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:10:37.235749  2431 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:37.235945  2430 ts_tablet_manager.cc:1434] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:10:37.237630  2430 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:37.286701  2054 catalog_manager.cc:5697] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.290102  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8e58e88e0d4361b02e63a537424cfc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:37.296250  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8e58e88e0d4361b02e63a537424cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.305413  2373 tablet_service.cc:1511] Processing CreateTablet for tablet 6081d30467784ede9c3e7fb12625e0f1 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:37.302424  2430 tablet_bootstrap.cc:654] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.282192  2146 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8e58e88e0d4361b02e63a537424cfc (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:37.314117  2437 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.314931  2428 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:37.315315  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8e58e88e0d4361b02e63a537424cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.315227  2437 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.316581  2428 ts_tablet_manager.cc:1403] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.164s	user 0.022s	sys 0.020s
I20260709 13:10:37.318775  2437 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.323522  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.294023  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 6081d30467784ede9c3e7fb12625e0f1 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:37.322014  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:37.321883  2464 consensus_queue.cc:1048] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.332795  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081d30467784ede9c3e7fb12625e0f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.338151  2198 leader_election.cc:343] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.325337  2438 raft_consensus.cc:493] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.340024  2438 raft_consensus.cc:515] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.345108  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:37.345520  2159 raft_consensus.cc:2468] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:37.358389  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.359606  2382 raft_consensus.cc:2468] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:37.362795  2272 leader_election.cc:304] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:37.365887  2198 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:37.367269  2437 raft_consensus.cc:2804] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.367756  2437 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.368137  2437 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:37.388345  2126 consensus_peers.cc:597] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.392376  2272 leader_election.cc:343] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.393759  2474 raft_consensus.cc:2804] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.394333  2474 raft_consensus.cc:493] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.394730  2474 raft_consensus.cc:3060] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.396030  2468 consensus_queue.cc:1048] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.399176  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccaafad28af45a6b734656bd19362b5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:37.401759  2468 consensus_queue.cc:1048] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.402067  2367 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccaafad28af45a6b734656bd19362b5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:37.403609  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccaafad28af45a6b734656bd19362b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.342695  2438 leader_election.cc:290] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.408638  2429 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:37.409502  2429 ts_tablet_manager.cc:1403] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.008s
I20260709 13:10:37.408179  2219 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccaafad28af45a6b734656bd19362b5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:37.416836  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccaafad28af45a6b734656bd19362b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.389698  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081d30467784ede9c3e7fb12625e0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.440985  2429 raft_consensus.cc:359] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.442046  2429 raft_consensus.cc:385] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.442417  2429 raft_consensus.cc:740] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.442809  2428 raft_consensus.cc:359] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.443138  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccaafad28af45a6b734656bd19362b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.446774  2428 raft_consensus.cc:385] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.450850  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 6081d30467784ede9c3e7fb12625e0f1 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:37.449100  2464 raft_consensus.cc:493] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.470528  2440 raft_consensus.cc:493] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.485956  2440 raft_consensus.cc:515] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.487497  2430 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:37.473407  2224 tablet_service.cc:1511] Processing CreateTablet for tablet f71948f18aa040a99d9fc9af3f14820a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:37.452685  2142 tablet_service.cc:1511] Processing CreateTablet for tablet f71948f18aa040a99d9fc9af3f14820a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:37.485172  2431 tablet_bootstrap.cc:654] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.484930  2464 raft_consensus.cc:515] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.488459  2430 ts_tablet_manager.cc:1403] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.008s
I20260709 13:10:37.494920  2436 raft_consensus.cc:493] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.495141  2498 consensus_queue.cc:1048] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.479156  2428 raft_consensus.cc:740] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.505064  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081d30467784ede9c3e7fb12625e0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.504943  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.506307  2292 tablet_service.cc:1511] Processing CreateTablet for tablet f71948f18aa040a99d9fc9af3f14820a (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:37.516317  2436 raft_consensus.cc:515] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.508316  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71948f18aa040a99d9fc9af3f14820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.509045  2440 leader_election.cc:290] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.509294  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.510757  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:37.521796  2347 leader_election.cc:343] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.517614  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71948f18aa040a99d9fc9af3f14820a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.523020  2124 leader_election.cc:343] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.523481  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9cb1963d1649f18a1c6256fd4810f0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:10:37.524004  2346 leader_election.cc:343] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.524609  2346 leader_election.cc:304] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:37.524940  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9cb1963d1649f18a1c6256fd4810f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.527866  2440 raft_consensus.cc:2749] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.529233  2436 leader_election.cc:290] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:37.512677  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9cb1963d1649f18a1c6256fd4810f0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:37.532390  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9cb1963d1649f18a1c6256fd4810f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.443285  2429 consensus_queue.cc:260] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.507406  2464 leader_election.cc:290] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:37.533776  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9cb1963d1649f18a1c6256fd4810f0 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:37.546943  2428 consensus_queue.cc:260] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.556602  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:37.558385  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:37.559652  2429 ts_tablet_manager.cc:1434] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.150s	user 0.007s	sys 0.003s
I20260709 13:10:37.559911  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71948f18aa040a99d9fc9af3f14820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.560974  2429 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:37.560535  2437 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.558326  2474 raft_consensus.cc:515] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.562950  2437 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
W20260709 13:10:37.563696  2126 leader_election.cc:343] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.564044  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9cb1963d1649f18a1c6256fd4810f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.563750  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:37.566211  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:37.572556  2474 leader_election.cc:290] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.575536  2383 raft_consensus.cc:3060] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.571516  2430 raft_consensus.cc:359] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:37.584722  2198 leader_election.cc:343] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.586233  2293 tablet_service.cc:1511] Processing CreateTablet for tablet 9636aa4db950425481239f3d2214245b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:37.587064  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.588250  2431 tablet_bootstrap.cc:492] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:37.605448  2431 ts_tablet_manager.cc:1403] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.370s	user 0.014s	sys 0.016s
I20260709 13:10:37.599138  2383 raft_consensus.cc:2468] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:37.600488  2501 raft_consensus.cc:493] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.604209  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9636aa4db950425481239f3d2214245b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.613169  2370 tablet_service.cc:1511] Processing CreateTablet for tablet 9636aa4db950425481239f3d2214245b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:37.614192  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:37.615631  2272 leader_election.cc:304] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:37.619383  2474 raft_consensus.cc:2804] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:37.615722  2160 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.619827  2501 raft_consensus.cc:515] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.622123  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9636aa4db950425481239f3d2214245b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.622871  2501 leader_election.cc:290] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:37.627319  2474 raft_consensus.cc:697] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:37.601264  2430 raft_consensus.cc:385] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.631403  2148 tablet_service.cc:1511] Processing CreateTablet for tablet 9636aa4db950425481239f3d2214245b (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:37.631861  2430 raft_consensus.cc:740] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.632829  2148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9636aa4db950425481239f3d2214245b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.632761  2430 consensus_queue.cc:260] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.635205  2431 raft_consensus.cc:359] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.636171  2431 raft_consensus.cc:385] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.636477  2431 raft_consensus.cc:740] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.637408  2431 consensus_queue.cc:260] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.641943  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 76f4f333411941d4b67259070a4d9fd5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:37.643592  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f4f333411941d4b67259070a4d9fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.644877  2147 tablet_service.cc:1511] Processing CreateTablet for tablet 442d06e6435f447e80ad1a730f3cd755 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:37.646349  2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d06e6435f447e80ad1a730f3cd755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.646406  2160 raft_consensus.cc:2468] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:37.575778  2126 leader_election.cc:304] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.649251  2221 tablet_service.cc:1511] Processing CreateTablet for tablet 442d06e6435f447e80ad1a730f3cd755 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:37.649981  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.650748  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d06e6435f447e80ad1a730f3cd755. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.652484  2199 leader_election.cc:343] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.654742  2430 ts_tablet_manager.cc:1434] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 13:10:37.658319  2430 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:37.649109  2369 tablet_service.cc:1511] Processing CreateTablet for tablet 76f4f333411941d4b67259070a4d9fd5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:37.660512  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f4f333411941d4b67259070a4d9fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.660460  2499 raft_consensus.cc:2749] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.661471  2440 raft_consensus.cc:493] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.662184  2440 raft_consensus.cc:515] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.664371  2440 leader_election.cc:290] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:37.665316  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:37.666019  2233 raft_consensus.cc:2468] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:37.667867  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.668706  2383 raft_consensus.cc:2468] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:37.669972  2198 leader_election.cc:304] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.670966  2504 raft_consensus.cc:2804] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.671446  2504 raft_consensus.cc:493] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.667790  2349 leader_election.cc:304] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:37.671977  2504 raft_consensus.cc:3060] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.672495  2440 raft_consensus.cc:2804] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.672971  2440 raft_consensus.cc:493] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.673317  2440 raft_consensus.cc:3060] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.682117  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 76f4f333411941d4b67259070a4d9fd5 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:37.683583  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f4f333411941d4b67259070a4d9fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.643005  2474 consensus_queue.cc:237] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.688453  2429 tablet_bootstrap.cc:654] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.689153  2440 raft_consensus.cc:515] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.690431  2431 ts_tablet_manager.cc:1434] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.083s	user 0.002s	sys 0.006s
W20260709 13:10:37.680079  2126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 116440us
I20260709 13:10:37.698264  2428 ts_tablet_manager.cc:1434] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.374s	user 0.025s	sys 0.007s
I20260709 13:10:37.699525  2428 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
W20260709 13:10:37.703053  2123 leader_election.cc:343] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.705636  2198 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:37.707167  2503 raft_consensus.cc:2804] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:37.707831  2503 raft_consensus.cc:697] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:37.708899  2503 consensus_queue.cc:237] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:37.710357  2126 leader_election.cc:343] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.710657  2299 tablet_service.cc:1511] Processing CreateTablet for tablet 442d06e6435f447e80ad1a730f3cd755 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:37.692061  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.711943  2309 raft_consensus.cc:2468] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:37.712208  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d06e6435f447e80ad1a730f3cd755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.714653  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:37.720265  2126 leader_election.cc:304] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:37.721735  2498 raft_consensus.cc:2749] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.715217  2440 leader_election.cc:290] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:37.716887  2367 tablet_service.cc:1511] Processing CreateTablet for tablet 704c2648933e451e9a0ab0fcbdcc5d98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:37.742183  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704c2648933e451e9a0ab0fcbdcc5d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.715332  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d2543e217d4435ac6c5d4291853933" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:37.747995  2234 raft_consensus.cc:3060] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.724296  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:37.732771  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 704c2648933e451e9a0ab0fcbdcc5d98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:37.754494  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704c2648933e451e9a0ab0fcbdcc5d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.735555  2431 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:37.761895  2428 tablet_bootstrap.cc:654] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.763583  2234 raft_consensus.cc:2468] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
W20260709 13:10:37.768749  2272 leader_election.cc:343] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.768810  2349 leader_election.cc:304] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.769809  2440 raft_consensus.cc:2804] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:37.770423  2440 raft_consensus.cc:697] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:37.771919  2440 consensus_queue.cc:237] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.794049  2431 tablet_bootstrap.cc:654] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.776223  2504 raft_consensus.cc:515] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.812496  2509 raft_consensus.cc:493] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.813185  2509 raft_consensus.cc:515] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.818655  2428 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:37.819249  2428 ts_tablet_manager.cc:1403] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.008s
I20260709 13:10:37.820677  2429 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:37.823975  2504 leader_election.cc:290] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:37.824399  2429 ts_tablet_manager.cc:1403] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.264s	user 0.027s	sys 0.019s
I20260709 13:10:37.824731  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:37.825605  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:37.827396  2382 raft_consensus.cc:3060] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.827919  2430 tablet_bootstrap.cc:654] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.832124  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 704c2648933e451e9a0ab0fcbdcc5d98 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:37.829644  2428 raft_consensus.cc:359] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.836835  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704c2648933e451e9a0ab0fcbdcc5d98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.839324  2199 leader_election.cc:343] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:37.846707  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:37.847296  2056 catalog_manager.cc:5697] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.850332  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 1726a2fe283241b4a1435cf7f96f4bf7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:37.852090  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1726a2fe283241b4a1435cf7f96f4bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.856684  2429 raft_consensus.cc:359] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.857414  2429 raft_consensus.cc:385] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.857501  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:37.857739  2429 raft_consensus.cc:740] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.858215  2160 raft_consensus.cc:2468] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:37.858526  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.859225  2309 raft_consensus.cc:2468] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:37.859701  2346 leader_election.cc:304] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:37.860709  2506 raft_consensus.cc:2804] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.857761  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 1726a2fe283241b4a1435cf7f96f4bf7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:37.861117  2506 raft_consensus.cc:493] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.861481  2506 raft_consensus.cc:3060] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.861961  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1726a2fe283241b4a1435cf7f96f4bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.836714  2428 raft_consensus.cc:385] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.863835  2428 raft_consensus.cc:740] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.854295  2054 catalog_manager.cc:5697] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.864634  2428 consensus_queue.cc:260] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:37.867041  2428 ts_tablet_manager.cc:1434] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:10:37.869282  2506 raft_consensus.cc:515] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.880774  2428 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:37.878876  2509 leader_election.cc:290] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.881886  2506 leader_election.cc:290] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:37.883037  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:37.881253  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8715de42fd7d4b2b825e082594d4a654" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:37.887988  2160 raft_consensus.cc:3060] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.888095  2309 raft_consensus.cc:3060] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.888913  2382 raft_consensus.cc:2468] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:37.892045  2198 leader_election.cc:304] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:37.892912  2504 raft_consensus.cc:2804] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:37.893369  2504 raft_consensus.cc:697] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:37.894162  2504 consensus_queue.cc:237] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:37.894733  2057 catalog_manager.cc:5697] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.907078  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 1726a2fe283241b4a1435cf7f96f4bf7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:37.908455  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1726a2fe283241b4a1435cf7f96f4bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.912793  2160 raft_consensus.cc:2468] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:37.915503  2309 raft_consensus.cc:2468] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:37.916729  2347 leader_election.cc:304] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:37.916898  2430 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:37.918828  2430 ts_tablet_manager.cc:1403] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.261s	user 0.006s	sys 0.008s
I20260709 13:10:37.903124  2429 consensus_queue.cc:260] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:37.923862  2430 raft_consensus.cc:359] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.924777  2430 raft_consensus.cc:385] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.925038  2430 raft_consensus.cc:740] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.925719  2430 consensus_queue.cc:260] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.927203  2299 tablet_service.cc:1511] Processing CreateTablet for tablet 322c5581771740d3b4fcf69409b0bef2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:37.927708  2429 ts_tablet_manager.cc:1434] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 13:10:37.928130  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 322c5581771740d3b4fcf69409b0bef2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:37.928669  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322c5581771740d3b4fcf69409b0bef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.929035  2429 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:37.929566  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322c5581771740d3b4fcf69409b0bef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.922817  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 322c5581771740d3b4fcf69409b0bef2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:37.932544  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322c5581771740d3b4fcf69409b0bef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.935925  2431 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:37.944132  2430 ts_tablet_manager.cc:1434] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:10:37.944715  2429 tablet_bootstrap.cc:654] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.943698  2431 ts_tablet_manager.cc:1403] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.000s
I20260709 13:10:37.944887  2506 raft_consensus.cc:2804] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:37.948336  2506 raft_consensus.cc:697] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:37.952371  2499 raft_consensus.cc:493] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.952855  2499 raft_consensus.cc:515] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.954054  2431 raft_consensus.cc:359] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.954794  2431 raft_consensus.cc:385] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.954979  2499 leader_election.cc:290] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:37.955096  2431 raft_consensus.cc:740] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.958060  2428 tablet_bootstrap.cc:654] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.960354  2506 consensus_queue.cc:237] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.966007  2430 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:37.965682  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:37.972265  2382 raft_consensus.cc:2393] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:37.966553  2431 consensus_queue.cc:260] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:37.978498  2431 ts_tablet_manager.cc:1434] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:10:37.967624  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:37.967971  2054 catalog_manager.cc:5697] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.983464  2431 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:37.988901  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 8204b768587944178ca101e068d964e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:37.990411  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204b768587944178ca101e068d964e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.000509  2124 leader_election.cc:304] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:38.001219  2428 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.001457  2500 raft_consensus.cc:3060] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.003269  2428 ts_tablet_manager.cc:1403] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.008s
I20260709 13:10:38.004793  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 8204b768587944178ca101e068d964e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:38.006006  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204b768587944178ca101e068d964e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.006614  2428 raft_consensus.cc:359] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.007540  2428 raft_consensus.cc:385] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.007897  2428 raft_consensus.cc:740] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.009320  2500 raft_consensus.cc:2749] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.009441  2428 consensus_queue.cc:260] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.016283  2430 tablet_bootstrap.cc:654] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.015887  2299 tablet_service.cc:1511] Processing CreateTablet for tablet 8204b768587944178ca101e068d964e2 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:38.020179  2428 ts_tablet_manager.cc:1434] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:10:38.020195  2429 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.020537  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204b768587944178ca101e068d964e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.020969  2429 ts_tablet_manager.cc:1403] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.005s
I20260709 13:10:38.021577  2428 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:38.024478  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 735fe428615d4151ba9722c729b057c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:38.025805  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735fe428615d4151ba9722c729b057c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.029700  2428 tablet_bootstrap.cc:654] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.030452  2429 raft_consensus.cc:359] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.031294  2429 raft_consensus.cc:385] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.031720  2429 raft_consensus.cc:740] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.032579  2429 consensus_queue.cc:260] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.033892  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 735fe428615d4151ba9722c729b057c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:38.040797  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735fe428615d4151ba9722c729b057c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.040854  2428 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.041404  2428 ts_tablet_manager.cc:1403] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:10:38.043754  2429 ts_tablet_manager.cc:1434] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:38.044744  2428 raft_consensus.cc:359] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.045552  2428 raft_consensus.cc:385] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.045884  2428 raft_consensus.cc:740] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.046867  2428 consensus_queue.cc:260] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.049763  2428 ts_tablet_manager.cc:1434] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:38.049809  2506 raft_consensus.cc:493] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.050875  2428 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:38.050711  2506 raft_consensus.cc:515] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.052778  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 735fe428615d4151ba9722c729b057c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:38.053848  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.054533  2160 raft_consensus.cc:2468] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:38.055925  2346 leader_election.cc:304] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:38.056751  2509 raft_consensus.cc:2804] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.057106  2509 raft_consensus.cc:493] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.057415  2509 raft_consensus.cc:3060] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.039270  2431 tablet_bootstrap.cc:654] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.057708  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfb558f11c34f60a165af99c68f3702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:38.059108  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfb558f11c34f60a165af99c68f3702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.060130  2504 raft_consensus.cc:493] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.060606  2504 raft_consensus.cc:515] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.061650  2372 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfb558f11c34f60a165af99c68f3702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:38.062925  2372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfb558f11c34f60a165af99c68f3702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.063382  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.064486  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.065155  2430 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:38.065107  2160 raft_consensus.cc:2468] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:38.065738  2430 ts_tablet_manager.cc:1403] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.002s
I20260709 13:10:38.062822  2504 leader_election.cc:290] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:38.066531  2198 leader_election.cc:304] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:38.054086  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735fe428615d4151ba9722c729b057c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.067292  2504 raft_consensus.cc:2804] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.067704  2504 raft_consensus.cc:493] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.068013  2504 raft_consensus.cc:3060] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.073172  2430 raft_consensus.cc:359] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.073894  2430 raft_consensus.cc:385] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.074167  2430 raft_consensus.cc:740] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.074895  2430 consensus_queue.cc:260] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.075114  2504 raft_consensus.cc:515] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.044955  2429 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.075982  2509 raft_consensus.cc:515] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.079484  2506 leader_election.cc:290] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.081972  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.112478  2234 raft_consensus.cc:2393] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:38.112648  2504 leader_election.cc:290] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:38.113310  2509 leader_election.cc:290] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.114506  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:38.114801  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:38.115123  2160 raft_consensus.cc:3060] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.082847  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfb558f11c34f60a165af99c68f3702 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:38.083639  2057 catalog_manager.cc:5697] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.116309  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfb558f11c34f60a165af99c68f3702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.116926  2383 raft_consensus.cc:2393] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:38.090478  2369 tablet_service.cc:1511] Processing CreateTablet for tablet d37f7d5b1467469b8122fa8393d571c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:38.118342  2369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37f7d5b1467469b8122fa8393d571c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.118856  2429 tablet_bootstrap.cc:654] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.121780  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:38.122575  2234 raft_consensus.cc:2393] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:38.090826  2474 consensus_queue.cc:1048] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.092787  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 3764b04f0489440686b563e22556a4f7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:38.093487  2428 tablet_bootstrap.cc:654] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.125355  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3764b04f0489440686b563e22556a4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.094991  2367 tablet_service.cc:1511] Processing CreateTablet for tablet e28571b869534957b019639a477450f6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:38.140877  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28571b869534957b019639a477450f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.095242  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 3764b04f0489440686b563e22556a4f7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:38.096840  2431 tablet_bootstrap.cc:492] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:38.143332  2431 ts_tablet_manager.cc:1403] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.005s
I20260709 13:10:38.096629  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 3764b04f0489440686b563e22556a4f7 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:38.096948  2148 tablet_service.cc:1511] Processing CreateTablet for tablet e28571b869534957b019639a477450f6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:38.149098  2148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28571b869534957b019639a477450f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.149158  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3764b04f0489440686b563e22556a4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.156252  2504 consensus_queue.cc:1048] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.092723  2224 tablet_service.cc:1511] Processing CreateTablet for tablet d37f7d5b1467469b8122fa8393d571c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:38.099596  2221 tablet_service.cc:1511] Processing CreateTablet for tablet e28571b869534957b019639a477450f6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:38.162122  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28571b869534957b019639a477450f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.100759  2292 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbd1c2f69bb4a878a64daf5789d9019 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:38.101470  2430 ts_tablet_manager.cc:1434] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:10:38.168138  2430 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:38.168218  2382 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.102533  2370 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbd1c2f69bb4a878a64daf5789d9019 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:38.172078  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbd1c2f69bb4a878a64daf5789d9019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.103210  2147 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbd1c2f69bb4a878a64daf5789d9019 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:38.180652  2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbd1c2f69bb4a878a64daf5789d9019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.116133  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e6f3e3a23c4711bd7d8c6f2a624e99" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:38.089294  2293 tablet_service.cc:1511] Processing CreateTablet for tablet d37f7d5b1467469b8122fa8393d571c6 (DEFAULT_TABLE table=test-workload [id=2ff6ace039264a35b778d32b180a5da9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:38.143499  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3764b04f0489440686b563e22556a4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.147418  2431 raft_consensus.cc:359] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.191433  2431 raft_consensus.cc:385] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.191576  2160 raft_consensus.cc:2468] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:38.191836  2431 raft_consensus.cc:740] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.192616  2431 consensus_queue.cc:260] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.193030  2346 leader_election.cc:304] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:38.194185  2509 raft_consensus.cc:2804] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.194671  2509 raft_consensus.cc:697] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:38.194947  2431 ts_tablet_manager.cc:1434] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:10:38.196017  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37f7d5b1467469b8122fa8393d571c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.195488  2509 consensus_queue.cc:237] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.201004  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbd1c2f69bb4a878a64daf5789d9019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.203594  2504 raft_consensus.cc:493] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.204233  2504 raft_consensus.cc:515] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.207026  2198 leader_election.cc:304] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:38.208001  2503 raft_consensus.cc:2749] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.212999  2504 leader_election.cc:290] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:38.213625  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:38.213657  2431 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:38.215991  2500 raft_consensus.cc:493] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.221305  2503 consensus_queue.cc:1048] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.232488  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37f7d5b1467469b8122fa8393d571c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.244226  2428 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.256860  2428 ts_tablet_manager.cc:1403] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.206s	user 0.027s	sys 0.039s
I20260709 13:10:38.255396  2500 raft_consensus.cc:515] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.263578  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.264194  2500 leader_election.cc:290] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:38.264309  2160 raft_consensus.cc:2468] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:38.265447  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:38.265940  2431 tablet_bootstrap.cc:654] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:38.266975  2124 leader_election.cc:343] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.269717  2430 tablet_bootstrap.cc:654] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.275031  2428 raft_consensus.cc:359] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.275943  2428 raft_consensus.cc:385] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.276269  2428 raft_consensus.cc:740] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.277098  2428 consensus_queue.cc:260] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.281524  2429 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.282157  2429 ts_tablet_manager.cc:1403] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.237s	user 0.042s	sys 0.040s
I20260709 13:10:38.265764  2198 leader_election.cc:304] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:38.283398  2504 raft_consensus.cc:2804] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.283815  2504 raft_consensus.cc:493] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.284147  2504 raft_consensus.cc:3060] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.285270  2233 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:38.288627  2199 leader_election.cc:343] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.289149  2429 raft_consensus.cc:359] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.290162  2429 raft_consensus.cc:385] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.290485  2429 raft_consensus.cc:740] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.291319  2429 consensus_queue.cc:260] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.292434  2509 consensus_queue.cc:1048] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.292434  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.299933  2429 ts_tablet_manager.cc:1434] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:10:38.300411  2428 ts_tablet_manager.cc:1434] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 13:10:38.301630  2428 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
W20260709 13:10:38.309302  2126 leader_election.cc:343] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.310021  2126 leader_election.cc:304] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:38.311033  2499 raft_consensus.cc:2749] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.312206  2429 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.314885  2509 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.315415  2509 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.318063  2509 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.318254  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.318639  2429 tablet_bootstrap.cc:654] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.309273  2428 tablet_bootstrap.cc:654] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.321450  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.323087  2349 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:38.332818  2428 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.333539  2428 ts_tablet_manager.cc:1403] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:10:38.336907  2428 raft_consensus.cc:359] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.337568  2428 raft_consensus.cc:385] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.337853  2428 raft_consensus.cc:740] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.341063  2429 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.340482  2054 catalog_manager.cc:5697] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.341701  2429 ts_tablet_manager.cc:1403] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:10:38.345330  2429 raft_consensus.cc:359] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.346134  2429 raft_consensus.cc:385] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.346436  2429 raft_consensus.cc:740] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.338989  2428 consensus_queue.cc:260] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.348363  2429 consensus_queue.cc:260] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.350948  2429 ts_tablet_manager.cc:1434] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:38.352267  2429 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.349834  2504 raft_consensus.cc:515] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.366370  2429 tablet_bootstrap.cc:654] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:38.373848  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 81076.3us
I20260709 13:10:38.388293  2531 consensus_queue.cc:1048] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.398315  2509 consensus_queue.cc:1048] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.366281  2504 leader_election.cc:290] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:38.399605  2506 raft_consensus.cc:2749] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.415961  2430 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:38.416357  2430 ts_tablet_manager.cc:1403] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.248s	user 0.037s	sys 0.047s
I20260709 13:10:38.419737  2428 ts_tablet_manager.cc:1434] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.086s	user 0.026s	sys 0.029s
I20260709 13:10:38.420799  2428 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:38.426100  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:38.426765  2158 raft_consensus.cc:3060] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.434226  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7611fef54f45fc86c75f42ba1d83cc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:38.438251  2308 raft_consensus.cc:3060] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.438464  2430 raft_consensus.cc:359] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.439206  2430 raft_consensus.cc:385] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.439493  2430 raft_consensus.cc:740] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.440225  2430 consensus_queue.cc:260] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.444810  2428 tablet_bootstrap.cc:654] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.446985  2431 tablet_bootstrap.cc:492] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:38.447525  2431 ts_tablet_manager.cc:1403] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.239s	user 0.040s	sys 0.021s
I20260709 13:10:38.461537  2430 ts_tablet_manager.cc:1434] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:10:38.458225  2506 raft_consensus.cc:493] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.472165  2531 raft_consensus.cc:493] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.474722  2430 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
W20260709 13:10:38.470275  2199 leader_election.cc:343] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.458467  2504 consensus_queue.cc:1048] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:10:38.476085  2309 raft_consensus.cc:3060] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.472930  2506 raft_consensus.cc:515] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.474944  2531 raft_consensus.cc:515] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.495820  2158 raft_consensus.cc:2468] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:38.497067  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.500805  2431 raft_consensus.cc:359] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.505105  2431 raft_consensus.cc:385] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.505340  2431 raft_consensus.cc:740] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.506044  2431 consensus_queue.cc:260] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.503466  2531 leader_election.cc:290] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:38.508636  2532 raft_consensus.cc:493] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.509014  2504 consensus_queue.cc:1048] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.509132  2532 raft_consensus.cc:515] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.504025  2506 leader_election.cc:290] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.513119  2500 raft_consensus.cc:493] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.513582  2500 raft_consensus.cc:515] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.515885  2500 leader_election.cc:290] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
W20260709 13:10:38.518746  2346 leader_election.cc:343] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.521389  2198 leader_election.cc:304] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:38.521840  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.522445  2382 raft_consensus.cc:2468] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:38.522537  2538 raft_consensus.cc:2804] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.523192  2538 raft_consensus.cc:697] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:38.524125  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:38.524335  2538 consensus_queue.cc:237] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.525671  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.529760  2429 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.539603  2429 ts_tablet_manager.cc:1403] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.188s	user 0.005s	sys 0.015s
I20260709 13:10:38.534598  2431 ts_tablet_manager.cc:1434] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:10:38.540954  2382 raft_consensus.cc:2468] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:38.535223  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.531381  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.542315  2123 leader_election.cc:304] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:38.542936  2159 raft_consensus.cc:2468] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:38.527789  2272 leader_election.cc:304] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:38.546947  2431 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:38.547302  2430 tablet_bootstrap.cc:654] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.549067  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.549888  2506 consensus_queue.cc:1048] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:38.551574  2349 leader_election.cc:343] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.556871  2504 raft_consensus.cc:493] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.558039  2504 raft_consensus.cc:515] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.560137  2504 leader_election.cc:290] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:38.557184  2349 leader_election.cc:304] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:38.534216  2532 leader_election.cc:290] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:38.545862  2500 raft_consensus.cc:2804] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.524782  2308 raft_consensus.cc:2468] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:38.565557  2428 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.566252  2428 ts_tablet_manager.cc:1403] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.146s	user 0.006s	sys 0.009s
I20260709 13:10:38.568572  2506 raft_consensus.cc:2749] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.571358  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.572306  2159 raft_consensus.cc:2468] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:38.564378  2500 raft_consensus.cc:493] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.573158  2500 raft_consensus.cc:3060] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.575599  2198 leader_election.cc:304] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:38.581806  2506 consensus_queue.cc:1048] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.579137  2429 raft_consensus.cc:359] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.586882  2429 raft_consensus.cc:385] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.587771  2429 raft_consensus.cc:740] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.581729  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:38.589519  2429 consensus_queue.cc:260] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.591239  2531 raft_consensus.cc:493] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.591899  2531 raft_consensus.cc:515] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
W20260709 13:10:38.601831  2199 leader_election.cc:343] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.603505  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.600841  2538 raft_consensus.cc:2804] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:38.622728  2551 log.cc:927] Time spent T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:38.623152  2538 raft_consensus.cc:493] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.623728  2538 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.626531  2431 tablet_bootstrap.cc:654] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.601213  2429 ts_tablet_manager.cc:1434] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:10:38.594998  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.568310  2547 raft_consensus.cc:2804] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.634922  2272 leader_election.cc:304] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:38.620646  2531 leader_election.cc:290] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:38.622272  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.604288  2233 raft_consensus.cc:2468] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:38.649554  2430 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:38.669720  2430 ts_tablet_manager.cc:1403] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.195s	user 0.042s	sys 0.046s
I20260709 13:10:38.670019  2429 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.668995  2383 raft_consensus.cc:2468] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:38.635511  2547 raft_consensus.cc:493] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.671115  2547 raft_consensus.cc:3060] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.635372  2428 raft_consensus.cc:359] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.671283  2272 leader_election.cc:304] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:38.671613  2428 raft_consensus.cc:385] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.672264  2428 raft_consensus.cc:740] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.672480  2474 raft_consensus.cc:2804] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.672940  2474 raft_consensus.cc:493] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.673345  2474 raft_consensus.cc:3060] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.642112  2054 catalog_manager.cc:5697] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.677703  2431 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:38.678197  2431 ts_tablet_manager.cc:1403] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.131s	user 0.005s	sys 0.007s
I20260709 13:10:38.680924  2428 consensus_queue.cc:260] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.685604  2538 raft_consensus.cc:515] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.682226  2474 raft_consensus.cc:515] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.689005  2431 raft_consensus.cc:359] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.683157  2430 raft_consensus.cc:359] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.690116  2430 raft_consensus.cc:385] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.691807  2430 raft_consensus.cc:740] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.692426  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:38.693048  2383 raft_consensus.cc:3060] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.689815  2431 raft_consensus.cc:385] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.695837  2431 raft_consensus.cc:740] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.698101  2538 leader_election.cc:290] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:38.700284  2383 raft_consensus.cc:2468] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:38.699992  2431 consensus_queue.cc:260] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.702208  2272 leader_election.cc:304] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:38.690522  2428 ts_tablet_manager.cc:1434] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.000s
I20260709 13:10:38.703059  2531 raft_consensus.cc:2804] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.703567  2531 raft_consensus.cc:697] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:38.703994  2474 leader_election.cc:290] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:38.705253  2429 tablet_bootstrap.cc:654] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.705104  2430 consensus_queue.cc:260] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.704799  2531 consensus_queue.cc:237] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.710361  2431 ts_tablet_manager.cc:1434] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.003s
I20260709 13:10:38.694543  2547 raft_consensus.cc:515] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.704084  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:38.705602  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:38.720172  2428 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
W20260709 13:10:38.726250  2199 leader_election.cc:343] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.721726  2160 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.721880  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:38.737222  2431 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:38.737401  2547 leader_election.cc:290] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:38.738858  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:38.739500  2383 raft_consensus.cc:3060] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.741881  2532 raft_consensus.cc:2749] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.733758  2233 raft_consensus.cc:3060] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.748972  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:38.731694  2500 raft_consensus.cc:515] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.765097  2159 raft_consensus.cc:2393] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:38.765183  2500 leader_election.cc:290] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:38.766801  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:38.770608  2431 tablet_bootstrap.cc:654] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.779139  2383 raft_consensus.cc:2468] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:38.780395  2233 raft_consensus.cc:2468] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:38.782503  2428 tablet_bootstrap.cc:654] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.782282  2160 raft_consensus.cc:2468] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:38.783056  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7f38d8faec46fdb1b78d7295af42a6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:38.804049  2307 raft_consensus.cc:2393] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:38.788285  2549 consensus_queue.cc:1048] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.805528  2124 leader_election.cc:304] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:38.806991  2562 raft_consensus.cc:2749] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.808841  2198 leader_election.cc:304] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:38.810499  2538 raft_consensus.cc:2804] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.811081  2538 raft_consensus.cc:697] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:38.812237  2538 consensus_queue.cc:237] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.829802  2549 consensus_queue.cc:1048] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.845645  2431 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:38.846271  2431 ts_tablet_manager.cc:1403] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.109s	user 0.033s	sys 0.032s
I20260709 13:10:38.847563  2429 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.848400  2429 ts_tablet_manager.cc:1403] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.179s	user 0.041s	sys 0.051s
I20260709 13:10:38.848939  2272 leader_election.cc:304] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:38.850478  2560 raft_consensus.cc:2804] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.850979  2560 raft_consensus.cc:697] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:38.851874  2560 consensus_queue.cc:237] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.852164  2429 raft_consensus.cc:359] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.853096  2429 raft_consensus.cc:385] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.853433  2429 raft_consensus.cc:740] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.854383  2429 consensus_queue.cc:260] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
W20260709 13:10:38.855329  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:38.856578  2562 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.856865  2429 ts_tablet_manager.cc:1434] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:38.857069  2562 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.857784  2431 raft_consensus.cc:359] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.858445  2431 raft_consensus.cc:385] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.858690  2431 raft_consensus.cc:740] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.859455  2431 consensus_queue.cc:260] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.861464  2431 ts_tablet_manager.cc:1434] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:10:38.862403  2431 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:38.859473  2429 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.860113  2562 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.869812  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.870410  2234 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:38.871811  2126 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:38.872776  2561 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.873126  2561 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.873425  2561 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.879402  2431 tablet_bootstrap.cc:654] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.880512  2429 tablet_bootstrap.cc:654] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.896458  2561 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.899614  2561 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.897418  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:38.900688  2383 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:38.901068  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:38.901839  2381 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.902632  2058 catalog_manager.cc:5697] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.904867  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:38.905635  2234 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.834527  2054 catalog_manager.cc:5697] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.925493  2430 ts_tablet_manager.cc:1434] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.255s	user 0.006s	sys 0.031s
I20260709 13:10:38.930686  2429 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:38.931262  2429 ts_tablet_manager.cc:1403] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.072s	user 0.004s	sys 0.013s
I20260709 13:10:38.932608  2560 raft_consensus.cc:493] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.933157  2560 raft_consensus.cc:515] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.935228  2560 leader_election.cc:290] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:38.934908  2429 raft_consensus.cc:359] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.935791  2429 raft_consensus.cc:385] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.935953  2428 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:38.936128  2429 raft_consensus.cc:740] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.936678  2428 ts_tablet_manager.cc:1403] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.224s	user 0.019s	sys 0.026s
I20260709 13:10:38.936657  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:38.937054  2429 consensus_queue.cc:260] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.927269  2430 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:38.936017  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:38.940982  2160 raft_consensus.cc:2393] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:38.941392  2428 raft_consensus.cc:359] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.942075  2428 raft_consensus.cc:385] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.942310  2428 raft_consensus.cc:740] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.942930  2428 consensus_queue.cc:260] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:38.947705  2272 leader_election.cc:304] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:38.950127  2560 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.953892  2234 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:38.955883  2126 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:38.955999  2381 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:38.955855  2430 tablet_bootstrap.cc:654] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.957244  2567 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.963047  2567 raft_consensus.cc:697] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:38.966351  2567 consensus_queue.cc:237] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:38.968663  2428 ts_tablet_manager.cc:1434] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:38.970197  2428 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:38.974268  2429 ts_tablet_manager.cc:1434] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 13:10:38.975095  2431 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:38.975584  2431 ts_tablet_manager.cc:1403] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.007s
I20260709 13:10:38.978859  2429 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:38.981467  2431 raft_consensus.cc:359] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.982178  2431 raft_consensus.cc:385] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.982468  2431 raft_consensus.cc:740] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.983174  2431 consensus_queue.cc:260] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:38.985265  2431 ts_tablet_manager.cc:1434] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:38.986151  2430 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:38.986318  2431 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:38.986760  2430 ts_tablet_manager.cc:1403] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.008s
I20260709 13:10:38.992293  2429 tablet_bootstrap.cc:654] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.995461  2560 raft_consensus.cc:2749] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.996055  2430 raft_consensus.cc:359] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.996827  2430 raft_consensus.cc:385] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.997143  2430 raft_consensus.cc:740] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.997538  2428 tablet_bootstrap.cc:654] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.998014  2430 consensus_queue.cc:260] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:38.999786  2431 tablet_bootstrap.cc:654] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.000458  2430 ts_tablet_manager.cc:1434] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:10:39.003502  2430 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.009780  2430 tablet_bootstrap.cc:654] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.014467  2058 catalog_manager.cc:5697] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.015810  2306 raft_consensus.cc:3060] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.009706  2057 catalog_manager.cc:5697] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.029106  2538 consensus_queue.cc:1048] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.039923  2538 consensus_queue.cc:1048] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.059938  2428 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.060531  2428 ts_tablet_manager.cc:1403] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.017s
I20260709 13:10:39.066686  2429 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.067211  2429 ts_tablet_manager.cc:1403] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.020s
I20260709 13:10:39.070190  2429 raft_consensus.cc:359] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.070883  2429 raft_consensus.cc:385] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.071154  2429 raft_consensus.cc:740] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.071810  2429 consensus_queue.cc:260] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.063946  2428 raft_consensus.cc:359] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.073086  2428 raft_consensus.cc:385] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.073376  2428 raft_consensus.cc:740] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.074138  2428 consensus_queue.cc:260] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.078302  2429 ts_tablet_manager.cc:1434] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:39.079809  2429 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.087215  2428 ts_tablet_manager.cc:1434] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:10:39.088788  2428 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.096259  2428 tablet_bootstrap.cc:654] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.100740  2429 tablet_bootstrap.cc:654] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.110481  2428 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.111195  2428 ts_tablet_manager.cc:1403] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.001s
I20260709 13:10:39.112548  2546 raft_consensus.cc:493] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.113284  2546 raft_consensus.cc:515] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.121698  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.122584  2307 raft_consensus.cc:2468] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:39.123780  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.125149  2347 leader_election.cc:304] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.126106  2509 raft_consensus.cc:2804] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.126467  2509 raft_consensus.cc:493] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.126816  2509 raft_consensus.cc:3060] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:39.128373  2346 leader_election.cc:343] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.129106  2560 consensus_queue.cc:1048] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.134461  2509 raft_consensus.cc:515] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.136194  2429 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.136919  2429 ts_tablet_manager.cc:1403] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.002s
I20260709 13:10:39.137679  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:39.138252  2307 raft_consensus.cc:3060] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.122606  2546 leader_election.cc:290] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.143270  2428 raft_consensus.cc:359] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.144272  2428 raft_consensus.cc:385] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.144635  2428 raft_consensus.cc:740] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.148881  2307 raft_consensus.cc:2468] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:39.150187  2347 leader_election.cc:304] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.147647  2429 raft_consensus.cc:359] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.151055  2546 raft_consensus.cc:2804] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.151288  2429 raft_consensus.cc:385] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.151746  2429 raft_consensus.cc:740] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.152448  2546 raft_consensus.cc:697] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:39.153442  2546 consensus_queue.cc:237] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.159350  2430 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.159893  2430 ts_tablet_manager.cc:1403] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.157s	user 0.029s	sys 0.032s
I20260709 13:10:39.160450  2506 raft_consensus.cc:493] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.160987  2506 raft_consensus.cc:515] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.162989  2506 leader_election.cc:290] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.163313  2474 consensus_queue.cc:1048] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.163477  2506 raft_consensus.cc:493] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.164433  2506 raft_consensus.cc:515] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.165832  2567 raft_consensus.cc:493] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.166103  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ff066c4d7042ddace1185779bcfc97" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.166369  2567 raft_consensus.cc:515] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:39.167930  2347 leader_election.cc:343] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.168541  2506 leader_election.cc:290] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.168613  2567 leader_election.cc:290] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.169942  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:39.170354  2509 leader_election.cc:290] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.170840  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:39.172463  2124 leader_election.cc:343] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:39.173247  2126 leader_election.cc:343] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.173405  2430 raft_consensus.cc:359] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.174093  2430 raft_consensus.cc:385] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.173859  2126 leader_election.cc:304] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.174352  2430 raft_consensus.cc:740] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.175055  2430 consensus_queue.cc:260] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.176131  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.176925  2430 ts_tablet_manager.cc:1434] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:39.177443  2561 raft_consensus.cc:2749] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.177937  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
W20260709 13:10:39.183029  2347 leader_election.cc:343] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:39.186028  2346 leader_election.cc:343] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.158130  2428 consensus_queue.cc:260] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.177920  2430 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.191115  2429 consensus_queue.cc:260] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.192605  2549 raft_consensus.cc:493] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.193168  2549 raft_consensus.cc:515] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.194675  2430 tablet_bootstrap.cc:654] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.196979  2549 leader_election.cc:290] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.197166  2431 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.200268  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:39.202553  2347 leader_election.cc:343] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.204638  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.205360  2160 raft_consensus.cc:2468] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:39.205855  2540 consensus_queue.cc:1048] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.206781  2346 leader_election.cc:304] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.208099  2509 raft_consensus.cc:2804] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.208554  2509 raft_consensus.cc:493] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.208954  2509 raft_consensus.cc:3060] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.223716  2539 consensus_queue.cc:1048] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.198189  2431 ts_tablet_manager.cc:1403] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.212s	user 0.054s	sys 0.052s
I20260709 13:10:39.227499  2430 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.228144  2430 ts_tablet_manager.cc:1403] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.008s
I20260709 13:10:39.232983  2509 raft_consensus.cc:515] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.248042  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:39.248464  2055 catalog_manager.cc:5697] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:39.249708  2347 leader_election.cc:343] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.253590  2429 ts_tablet_manager.cc:1434] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 13:10:39.254727  2429 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.235534  2431 raft_consensus.cc:359] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.240461  2428 ts_tablet_manager.cc:1434] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.129s	user 0.002s	sys 0.006s
I20260709 13:10:39.258198  2428 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.259315  2560 consensus_queue.cc:1048] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.261467  2538 raft_consensus.cc:493] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.262007  2538 raft_consensus.cc:515] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.263765  2431 raft_consensus.cc:385] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.264086  2431 raft_consensus.cc:740] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.264133  2538 leader_election.cc:290] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.264904  2431 consensus_queue.cc:260] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.243088  2430 raft_consensus.cc:359] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.243969  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:39.266084  2233 raft_consensus.cc:2468] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:39.244737  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ff066c4d7042ddace1185779bcfc97" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:39.267382  2234 raft_consensus.cc:2468] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:39.268126  2349 leader_election.cc:304] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.268574  2430 raft_consensus.cc:385] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.268875  2430 raft_consensus.cc:740] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.269449  2349 leader_election.cc:304] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.269567  2430 consensus_queue.cc:260] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.271255  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.271699  2430 ts_tablet_manager.cc:1434] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 13:10:39.271972  2157 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.272712  2430 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.274369  2549 raft_consensus.cc:2804] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.274792  2549 raft_consensus.cc:493] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.275127  2549 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.275949  2198 leader_election.cc:304] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:39.276253  2509 leader_election.cc:290] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.277130  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:39.277799  2383 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.281708  2428 tablet_bootstrap.cc:654] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.283631  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:39.284283  2157 raft_consensus.cc:3060] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.284614  2431 ts_tablet_manager.cc:1434] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:10:39.285727  2431 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.275130  2546 raft_consensus.cc:2804] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.288430  2546 raft_consensus.cc:493] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.288913  2546 raft_consensus.cc:3060] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.289255  2538 raft_consensus.cc:2804] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.289781  2538 raft_consensus.cc:493] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.290159  2538 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.299484  2560 consensus_queue.cc:1048] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.313735  2549 raft_consensus.cc:515] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.320262  2549 leader_election.cc:290] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.322948  2430 tablet_bootstrap.cc:654] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.323638  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:39.324949  2234 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.329327  2431 tablet_bootstrap.cc:654] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.330576  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:39.332226  2531 raft_consensus.cc:493] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.333014  2531 raft_consensus.cc:515] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.339026  2429 tablet_bootstrap.cc:654] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:39.345563  2347 leader_election.cc:343] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.317564  2538 raft_consensus.cc:515] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.355902  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:39.356849  2381 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.357400  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:39.358798  2272 leader_election.cc:343] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.360394  2531 leader_election.cc:290] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:39.360991  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:39.362553  2275 leader_election.cc:343] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.362972  2275 leader_election.cc:304] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:39.364202  2531 raft_consensus.cc:2749] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.369227  2567 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.374552  2381 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:39.372449  2157 raft_consensus.cc:2468] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:39.386301  2546 raft_consensus.cc:515] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.388163  2198 leader_election.cc:304] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.377565  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:39.389288  2160 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.389690  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ff066c4d7042ddace1185779bcfc97" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:39.389861  2346 leader_election.cc:304] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.390396  2233 raft_consensus.cc:3060] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.389122  2539 raft_consensus.cc:2804] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.391333  2539 raft_consensus.cc:697] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:39.392307  2539 consensus_queue.cc:237] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.394285  2428 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.394776  2428 ts_tablet_manager.cc:1403] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.035s
I20260709 13:10:39.396978  2549 raft_consensus.cc:2804] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.397368  2160 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:39.397575  2428 raft_consensus.cc:359] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.400004  2428 raft_consensus.cc:385] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.378630  2538 leader_election.cc:290] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.366429  2234 raft_consensus.cc:2468] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:39.397943  2549 raft_consensus.cc:697] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:39.400292  2233 raft_consensus.cc:2468] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:39.401662  2349 leader_election.cc:304] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.401466  2549 consensus_queue.cc:237] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.402722  2509 raft_consensus.cc:2804] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.403266  2509 raft_consensus.cc:697] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:39.404430  2429 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.404970  2429 ts_tablet_manager.cc:1403] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.000s
I20260709 13:10:39.404181  2509 consensus_queue.cc:237] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.400296  2428 raft_consensus.cc:740] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.409008  2546 leader_election.cc:290] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.410427  2428 consensus_queue.cc:260] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.410825  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ff066c4d7042ddace1185779bcfc97" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:39.415858  2347 leader_election.cc:343] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.419109  2430 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.421677  2349 leader_election.cc:304] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.421465  2429 raft_consensus.cc:359] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.421928  2428 ts_tablet_manager.cc:1434] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:10:39.422505  2429 raft_consensus.cc:385] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.422933  2429 raft_consensus.cc:740] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.423959  2429 consensus_queue.cc:260] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.426805  2546 raft_consensus.cc:2804] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.430842  2546 raft_consensus.cc:697] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:39.433053  2429 ts_tablet_manager.cc:1434] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:10:39.434420  2429 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.435792  2546 consensus_queue.cc:237] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.439419  2428 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.445482  2431 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.446025  2431 ts_tablet_manager.cc:1403] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.011s
I20260709 13:10:39.446978  2428 tablet_bootstrap.cc:654] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.419725  2430 ts_tablet_manager.cc:1403] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.147s	user 0.004s	sys 0.010s
I20260709 13:10:39.446573  2058 catalog_manager.cc:5697] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.452325  2430 raft_consensus.cc:359] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.453106  2430 raft_consensus.cc:385] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.453367  2430 raft_consensus.cc:740] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.454033  2430 consensus_queue.cc:260] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.472800  2430 ts_tablet_manager.cc:1434] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:10:39.476907  2429 tablet_bootstrap.cc:654] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.476446  2431 raft_consensus.cc:359] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.477774  2431 raft_consensus.cc:385] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.479811  2567 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.480897  2430 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.478072  2431 raft_consensus.cc:740] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.487978  2428 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.489322  2431 consensus_queue.cc:260] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.491889  2428 ts_tablet_manager.cc:1403] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.028s
I20260709 13:10:39.498489  2431 ts_tablet_manager.cc:1434] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 13:10:39.498755  2430 tablet_bootstrap.cc:654] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.500052  2431 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.497310  2428 raft_consensus.cc:359] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.502398  2428 raft_consensus.cc:385] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.502750  2428 raft_consensus.cc:740] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.503588  2428 consensus_queue.cc:260] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.505054  2429 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.505652  2429 ts_tablet_manager.cc:1403] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.000s
I20260709 13:10:39.506008  2428 ts_tablet_manager.cc:1434] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:10:39.507164  2428 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.508790  2429 raft_consensus.cc:359] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.509742  2429 raft_consensus.cc:385] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.510087  2429 raft_consensus.cc:740] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.511063  2429 consensus_queue.cc:260] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.513635  2429 ts_tablet_manager.cc:1434] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:39.514809  2429 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.517328  2431 tablet_bootstrap.cc:654] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.521711  2429 tablet_bootstrap.cc:654] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.522921  2428 tablet_bootstrap.cc:654] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.493938  2058 catalog_manager.cc:5697] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.531723  2431 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.532398  2431 ts_tablet_manager.cc:1403] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 13:10:39.530745  2058 catalog_manager.cc:5697] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.533602  2058 catalog_manager.cc:5697] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.534404  2429 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.534757  2430 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.535164  2429 ts_tablet_manager.cc:1403] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:10:39.535266  2430 ts_tablet_manager.cc:1403] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.026s
I20260709 13:10:39.535681  2431 raft_consensus.cc:359] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.536466  2431 raft_consensus.cc:385] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.536818  2431 raft_consensus.cc:740] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.538424  2430 raft_consensus.cc:359] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.539120  2430 raft_consensus.cc:385] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.539287  2428 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.538807  2429 raft_consensus.cc:359] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.539839  2429 raft_consensus.cc:385] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.539453  2430 raft_consensus.cc:740] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.540202  2429 raft_consensus.cc:740] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.540439  2431 consensus_queue.cc:260] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.540913  2430 consensus_queue.cc:260] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.541298  2429 consensus_queue.cc:260] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.546502  2546 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.547086  2546 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.547830  2428 ts_tablet_manager.cc:1403] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 13:10:39.549638  2546 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.551163  2428 raft_consensus.cc:359] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.551955  2428 raft_consensus.cc:385] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.552225  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.554086  2431 ts_tablet_manager.cc:1434] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:10:39.554674  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:39.554955  2347 leader_election.cc:343] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.555222  2431 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.552255  2428 raft_consensus.cc:740] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
W20260709 13:10:39.556304  2346 leader_election.cc:343] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.556470  2428 consensus_queue.cc:260] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.557109  2346 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:39.558758  2428 ts_tablet_manager.cc:1434] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:10:39.560930  2546 raft_consensus.cc:2749] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.561077  2429 ts_tablet_manager.cc:1434] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:10:39.564661  2429 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.561704  2428 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.571208  2429 tablet_bootstrap.cc:654] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.562506  2431 tablet_bootstrap.cc:654] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.577272  2428 tablet_bootstrap.cc:654] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.583254  2430 ts_tablet_manager.cc:1434] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.003s
I20260709 13:10:39.586045  2430 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.595556  2430 tablet_bootstrap.cc:654] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.603610  2428 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.606092  2431 tablet_bootstrap.cc:492] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.606596  2430 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.606715  2429 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.606734  2431 ts_tablet_manager.cc:1403] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.011s
I20260709 13:10:39.607113  2430 ts_tablet_manager.cc:1403] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:10:39.607375  2429 ts_tablet_manager.cc:1403] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.025s
I20260709 13:10:39.609647  2430 raft_consensus.cc:359] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.610248  2430 raft_consensus.cc:385] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.610529  2430 raft_consensus.cc:740] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.610291  2431 raft_consensus.cc:359] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.610560  2429 raft_consensus.cc:359] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.611390  2431 raft_consensus.cc:385] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.611469  2429 raft_consensus.cc:385] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.606774  2428 ts_tablet_manager.cc:1403] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 13:10:39.611230  2430 consensus_queue.cc:260] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.612092  2431 raft_consensus.cc:740] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.612161  2429 raft_consensus.cc:740] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.612951  2431 consensus_queue.cc:260] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.613121  2429 consensus_queue.cc:260] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.615312  2431 ts_tablet_manager.cc:1434] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:10:39.616971  2431 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.618732  2429 ts_tablet_manager.cc:1434] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:39.619907  2429 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.620805  2430 ts_tablet_manager.cc:1434] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:10:39.621811  2430 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.623624  2431 tablet_bootstrap.cc:654] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.633298  2430 tablet_bootstrap.cc:654] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.632690  2428 raft_consensus.cc:359] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.637017  2428 raft_consensus.cc:385] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.637317  2428 raft_consensus.cc:740] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.638144  2428 consensus_queue.cc:260] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.639760  2429 tablet_bootstrap.cc:654] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.640379  2428 ts_tablet_manager.cc:1434] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:39.642524  2428 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.657876  2160 raft_consensus.cc:3060] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.660532  2429 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.661208  2429 ts_tablet_manager.cc:1403] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.011s
I20260709 13:10:39.661922  2546 raft_consensus.cc:493] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.662451  2546 raft_consensus.cc:515] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.663102  2428 tablet_bootstrap.cc:654] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.664590  2546 leader_election.cc:290] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.664556  2429 raft_consensus.cc:359] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.665475  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:39.665876  2429 raft_consensus.cc:385] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.666224  2429 raft_consensus.cc:740] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.666182  2234 raft_consensus.cc:2468] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:39.666951  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.667968  2349 leader_election.cc:304] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
W20260709 13:10:39.668556  2347 leader_election.cc:343] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.668804  2546 raft_consensus.cc:2804] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.669298  2546 raft_consensus.cc:493] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.668354  2429 consensus_queue.cc:260] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.669780  2546 raft_consensus.cc:3060] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.671402  2429 ts_tablet_manager.cc:1434] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:39.673903  2429 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.677398  2430 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.677978  2430 ts_tablet_manager.cc:1403] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.015s
I20260709 13:10:39.671459  2509 consensus_queue.cc:1048] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.669294  2431 tablet_bootstrap.cc:492] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.680164  2431 ts_tablet_manager.cc:1403] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.012s
I20260709 13:10:39.680371  2429 tablet_bootstrap.cc:654] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.681082  2430 raft_consensus.cc:359] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.681816  2430 raft_consensus.cc:385] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.682188  2430 raft_consensus.cc:740] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.683001  2430 consensus_queue.cc:260] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.683251  2431 raft_consensus.cc:359] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.684125  2431 raft_consensus.cc:385] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.684443  2431 raft_consensus.cc:740] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.685201  2431 consensus_queue.cc:260] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.686018  2430 ts_tablet_manager.cc:1434] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:39.687089  2430 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.691565  2546 raft_consensus.cc:515] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.693296  2430 tablet_bootstrap.cc:654] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.693751  2538 raft_consensus.cc:493] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.694324  2538 raft_consensus.cc:515] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.694983  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:39.695658  2234 raft_consensus.cc:3060] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.696704  2538 leader_election.cc:290] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.699522  2429 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.700131  2429 ts_tablet_manager.cc:1403] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:10:39.701964  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:39.702665  2383 raft_consensus.cc:2468] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.703330  2429 raft_consensus.cc:359] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.704101  2429 raft_consensus.cc:385] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.704429  2429 raft_consensus.cc:740] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.704324  2198 leader_election.cc:304] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.705511  2234 raft_consensus.cc:2468] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:39.705698  2538 raft_consensus.cc:2804] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.706120  2538 raft_consensus.cc:493] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.706499  2538 raft_consensus.cc:3060] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.706854  2349 leader_election.cc:304] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:39.707836  2506 raft_consensus.cc:2804] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.708338  2506 raft_consensus.cc:697] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:39.709481  2506 consensus_queue.cc:237] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.714530  2538 raft_consensus.cc:515] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.716053  2531 raft_consensus.cc:493] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.716744  2531 raft_consensus.cc:515] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.717326  2431 ts_tablet_manager.cc:1434] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:10:39.717353  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:39.718180  2383 raft_consensus.cc:3060] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.718591  2431 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.721133  2531 leader_election.cc:290] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:39.722621  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.723094  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.709192  2429 consensus_queue.cc:260] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.723812  2160 raft_consensus.cc:2468] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.724727  2546 leader_election.cc:290] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.739198  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:39.723587  2157 raft_consensus.cc:2468] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:39.740195  2538 leader_election.cc:290] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.740798  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:39.741372  2272 leader_election.cc:304] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:39.743826  2428 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:39.741506  2157 raft_consensus.cc:3060] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.744649  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:39.746656  2531 raft_consensus.cc:2804] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.747550  2431 tablet_bootstrap.cc:654] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.744351  2428 ts_tablet_manager.cc:1403] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.005s
I20260709 13:10:39.744750  2234 raft_consensus.cc:2468] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:39.744488  2429 ts_tablet_manager.cc:1434] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:10:39.751798  2531 raft_consensus.cc:493] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.754289  2539 raft_consensus.cc:493] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.761693  2428 raft_consensus.cc:359] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.761951  2531 raft_consensus.cc:3060] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.762346  2428 raft_consensus.cc:385] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.762033  2539 raft_consensus.cc:515] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.762622  2428 raft_consensus.cc:740] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.763255  2428 consensus_queue.cc:260] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.764426  2539 leader_election.cc:290] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.764915  2506 consensus_queue.cc:1048] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:39.767187  2429 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
W20260709 13:10:39.768005  2347 leader_election.cc:343] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.768013  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.769132  2160 raft_consensus.cc:2468] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.769932  2531 raft_consensus.cc:515] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.770210  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.770920  2305 raft_consensus.cc:2468] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:39.771056  2198 leader_election.cc:304] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:39.772460  2531 leader_election.cc:290] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:39.772982  2157 raft_consensus.cc:2468] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:39.772996  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:39.773924  2160 raft_consensus.cc:3060] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.774364  2198 leader_election.cc:304] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:39.775154  2538 raft_consensus.cc:2804] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.775640  2538 raft_consensus.cc:697] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:39.776470  2538 consensus_queue.cc:237] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.778458  2429 tablet_bootstrap.cc:654] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.773217  2539 raft_consensus.cc:2804] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:39.780261  2539 raft_consensus.cc:493] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.782015  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfe584445644027a6adf14def8b44f9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:39.782419  2430 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.782744  2234 raft_consensus.cc:3060] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.782903  2430 ts_tablet_manager.cc:1403] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.011s
I20260709 13:10:39.785712  2430 raft_consensus.cc:359] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.786358  2430 raft_consensus.cc:385] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.786615  2430 raft_consensus.cc:740] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.786751  2428 ts_tablet_manager.cc:1434] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:10:39.787402  2430 consensus_queue.cc:260] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.788430  2058 catalog_manager.cc:5697] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.780591  2539 raft_consensus.cc:3060] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.794149  2428 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:39.796180  2430 ts_tablet_manager.cc:1434] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:10:39.798971  2430 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:39.808988  2431 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:39.809804  2431 ts_tablet_manager.cc:1403] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.001s
I20260709 13:10:39.811535  2430 tablet_bootstrap.cc:654] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.800578  2160 raft_consensus.cc:2468] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:39.833545  2506 consensus_queue.cc:1048] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.820853  2383 raft_consensus.cc:2468] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:39.846547  2272 leader_election.cc:304] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:39.848093  2474 raft_consensus.cc:2804] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:39.849818  2431 raft_consensus.cc:359] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.850586  2431 raft_consensus.cc:385] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.850821  2431 raft_consensus.cc:740] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.852170  2431 consensus_queue.cc:260] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.842221  2506 raft_consensus.cc:493] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.847579  2560 raft_consensus.cc:493] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.856889  2560 raft_consensus.cc:515] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.855355  2506 raft_consensus.cc:515] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:39.858933  2560 leader_election.cc:290] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.859823  2506 leader_election.cc:290] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.863494  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:39.865520  2349 leader_election.cc:343] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.866786  2429 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.867105  2234 raft_consensus.cc:2468] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:39.867287  2429 ts_tablet_manager.cc:1403] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.028s
I20260709 13:10:39.873288  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:39.874562  2429 raft_consensus.cc:359] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.875341  2429 raft_consensus.cc:385] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.874835  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a1f50d9d2d54028a40b1d72fb5a6bf0" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.875841  2429 raft_consensus.cc:740] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.876273  2160 raft_consensus.cc:2393] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:39.876580  2429 consensus_queue.cc:260] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:39.874812  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:39.878767  2429 ts_tablet_manager.cc:1434] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:39.879818  2429 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:39.891619  2055 catalog_manager.cc:5697] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.893229  2347 leader_election.cc:343] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.893844  2474 raft_consensus.cc:697] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:39.895684  2347 leader_election.cc:304] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:39.898854  2549 raft_consensus.cc:2749] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.909662  2588 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.910152  2588 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.915218  2430 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:39.915745  2430 ts_tablet_manager.cc:1403] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.004s
I20260709 13:10:39.898138  2474 consensus_queue.cc:237] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.918545  2588 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:39.919785  2428 tablet_bootstrap.cc:654] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.913878  2305 raft_consensus.cc:3060] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.921952  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:39.922468  2272 leader_election.cc:304] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:39.926481  2631 raft_consensus.cc:3060] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.928086  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:39.923560  2346 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:39.930684  2347 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.931317  2347 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:39.923481  2429 tablet_bootstrap.cc:654] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:39.932212  2307 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:39.934165  2431 ts_tablet_manager.cc:1434] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.124s	user 0.012s	sys 0.003s
I20260709 13:10:39.935310  2431 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:39.935828  2588 raft_consensus.cc:2749] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.935999  2549 consensus_queue.cc:1048] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.941980  2628 raft_consensus.cc:493] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.942762  2628 raft_consensus.cc:515] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.946250  2534 consensus_queue.cc:1048] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:39.964766  2539 raft_consensus.cc:515] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.970201  2631 raft_consensus.cc:2749] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:39.973825  2430 raft_consensus.cc:359] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:39.977190  2430 raft_consensus.cc:385] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.975541  2628 leader_election.cc:290] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.978533  2429 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:39.979048  2429 ts_tablet_manager.cc:1403] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.003s
W20260709 13:10:39.981927  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:39.982136  2539 leader_election.cc:290] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:39.983574  2588 consensus_queue.cc:1048] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.985067  2429 raft_consensus.cc:359] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.986964  2429 raft_consensus.cc:385] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:39.987236  2429 raft_consensus.cc:740] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.987910  2429 consensus_queue.cc:260] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:39.977731  2430 raft_consensus.cc:740] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.975800  2538 consensus_queue.cc:1048] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:40.001552  2549 raft_consensus.cc:493] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.007982  2549 raft_consensus.cc:515] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.011596  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.012164  2549 leader_election.cc:290] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.007167  2631 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.029847  2631 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.032649  2631 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:40.012313  2160 raft_consensus.cc:2468] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:40.012995  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:40.033699  2429 ts_tablet_manager.cc:1434] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 13:10:40.034989  2429 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:40.003513  2588 consensus_queue.cc:1048] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:10:40.002462  2430 consensus_queue.cc:260] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.016495  2546 consensus_queue.cc:1048] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.017573  2058 catalog_manager.cc:5697] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.036403  2567 raft_consensus.cc:493] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.036960  2567 raft_consensus.cc:515] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.037189  2506 consensus_queue.cc:1048] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.034755  2346 leader_election.cc:304] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
W20260709 13:10:40.041040  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 66965.5us
I20260709 13:10:40.043148  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.043983  2160 raft_consensus.cc:2468] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:40.045054  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:40.045682  2157 raft_consensus.cc:3060] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.051724  2641 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.051606  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.052912  2588 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.053117  2546 raft_consensus.cc:2804] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.064049  2431 tablet_bootstrap.cc:654] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:40.040328  2349 leader_election.cc:343] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.069335  2428 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.070093  2428 ts_tablet_manager.cc:1403] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.008s
I20260709 13:10:40.058254  2546 raft_consensus.cc:493] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.053664  2199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 123867us
I20260709 13:10:40.061885  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.052382  2641 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.057648  2588 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.074635  2546 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.082176  2383 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:40.090739  2567 leader_election.cc:290] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.090941  2588 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.088686  2159 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:40.102550  2428 raft_consensus.cc:359] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.103261  2428 raft_consensus.cc:385] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.104797  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:40.106607  2124 leader_election.cc:343] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.109122  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.110216  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.110318  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.111032  2306 raft_consensus.cc:3060] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.103531  2428 raft_consensus.cc:740] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.117090  2428 consensus_queue.cc:260] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.125905  2641 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
W20260709 13:10:40.126780  2346 leader_election.cc:343] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.131688  2428 ts_tablet_manager.cc:1434] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:10:40.094290  2198 leader_election.cc:304] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:40.111397  2272 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:40.136720  2428 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.137715  2628 raft_consensus.cc:2804] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.138132  2628 raft_consensus.cc:493] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.138247  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 50621.1us
I20260709 13:10:40.138497  2628 raft_consensus.cc:3060] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.134536  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.139621  2309 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.141252  2124 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:40.141793  2430 ts_tablet_manager.cc:1434] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.226s	user 0.012s	sys 0.006s
I20260709 13:10:40.142167  2644 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.142613  2644 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.142948  2644 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.143244  2430 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.158978  2429 tablet_bootstrap.cc:654] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:40.130625  2349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 94840.7us
I20260709 13:10:40.164122  2631 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.165596  2631 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.166245  2631 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.165529  2647 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.163343  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 52047.2us
I20260709 13:10:40.183833  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:40.184139  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:40.185865  2199 leader_election.cc:343] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.187108  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.187795  2383 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.179250  2647 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.193356  2306 raft_consensus.cc:2468] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.193790  2647 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:40.203967  2157 raft_consensus.cc:2468] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
W20260709 13:10:40.204725  2349 leader_election.cc:343] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.206895  2631 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.224944  2199 leader_election.cc:304] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:40.210551  2628 raft_consensus.cc:515] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.211265  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.212116  2546 raft_consensus.cc:515] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.227149  2644 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.229748  2644 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.231351  2234 raft_consensus.cc:2393] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:40.228624  2546 leader_election.cc:290] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.217638  2428 tablet_bootstrap.cc:654] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.220093  2430 tablet_bootstrap.cc:654] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.224578  2349 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:40.222646  2538 consensus_queue.cc:1048] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:40.226293  2638 raft_consensus.cc:2804] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:40.226698  2346 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.233412  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.234050  2628 leader_election.cc:290] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.237023  2638 raft_consensus.cc:697] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:40.238170  2546 raft_consensus.cc:2749] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.247552  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.252671  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:40.253350  2159 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.256765  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:40.256767  2506 consensus_queue.cc:1048] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:40.259944  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:40.250599  2306 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:40.257428  2383 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.264448  2156 raft_consensus.cc:3060] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.266026  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:40.261597  2631 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:40.248829  2126 leader_election.cc:304] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.283548  2431 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.284106  2431 ts_tablet_manager.cc:1403] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.349s	user 0.012s	sys 0.014s
I20260709 13:10:40.277103  2234 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.278964  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:40.286866  2431 raft_consensus.cc:359] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.287580  2431 raft_consensus.cc:385] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.293278  2431 raft_consensus.cc:740] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.294564  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ff2c9d85f64480be1ad48eba7c6c5f" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.295223  2638 consensus_queue.cc:237] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.300261  2431 consensus_queue.cc:260] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.306277  2159 raft_consensus.cc:2468] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:40.311774  2429 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:40.312322  2429 ts_tablet_manager.cc:1403] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.278s	user 0.010s	sys 0.007s
I20260709 13:10:40.302831  2308 raft_consensus.cc:3060] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.312038  2383 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:40.306699  2234 raft_consensus.cc:2468] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:40.315328  2429 raft_consensus.cc:359] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.317831  2429 raft_consensus.cc:385] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.318148  2429 raft_consensus.cc:740] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.320019  2429 consensus_queue.cc:260] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.320509  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:40.326165  2429 ts_tablet_manager.cc:1434] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:40.326059  2349 leader_election.cc:304] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:40.326725  2160 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:40.327035  2546 raft_consensus.cc:2804] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.327276  2429 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:40.327569  2546 raft_consensus.cc:697] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
W20260709 13:10:40.327901  2347 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.328258  2347 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:40.328424  2546 consensus_queue.cc:237] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.328977  2588 raft_consensus.cc:2749] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.327045  2123 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.333765  2644 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.333930  2156 raft_consensus.cc:2468] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.334481  2641 raft_consensus.cc:2749] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.334622  2644 raft_consensus.cc:697] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:40.335769  2644 consensus_queue.cc:237] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.379822  2272 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:40.378633  2058 catalog_manager.cc:5697] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.389604  2198 leader_election.cc:304] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:40.390736  2638 raft_consensus.cc:2804] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.391228  2638 raft_consensus.cc:697] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:40.392052  2638 consensus_queue.cc:237] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.393229  2429 tablet_bootstrap.cc:654] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.393748  2634 raft_consensus.cc:2749] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.397435  2430 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
W20260709 13:10:40.397634  2347 consensus_peers.cc:597] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.397962  2430 ts_tablet_manager.cc:1403] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.255s	user 0.027s	sys 0.006s
I20260709 13:10:40.403525  2056 catalog_manager.cc:5697] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.409430  2430 raft_consensus.cc:359] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.410377  2430 raft_consensus.cc:385] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.410723  2430 raft_consensus.cc:740] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.412355  2628 consensus_queue.cc:1048] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.417510  2430 consensus_queue.cc:260] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.420215  2430 ts_tablet_manager.cc:1434] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:10:40.421275  2430 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.403997  2308 raft_consensus.cc:2468] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.424403  2055 catalog_manager.cc:5697] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.427492  2430 tablet_bootstrap.cc:654] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.429265  2431 ts_tablet_manager.cc:1434] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.000s
I20260709 13:10:40.430298  2431 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:40.438233  2428 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.438753  2428 ts_tablet_manager.cc:1403] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.304s	user 0.008s	sys 0.015s
I20260709 13:10:40.453536  2429 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:40.454105  2429 ts_tablet_manager.cc:1403] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.010s
I20260709 13:10:40.460314  2429 raft_consensus.cc:359] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.461019  2429 raft_consensus.cc:385] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.461295  2429 raft_consensus.cc:740] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.462172  2429 consensus_queue.cc:260] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.462947  2546 raft_consensus.cc:493] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.463397  2546 raft_consensus.cc:515] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.470649  2429 ts_tablet_manager.cc:1434] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:10:40.472798  2429 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:40.481985  2428 raft_consensus.cc:359] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.482570  2428 raft_consensus.cc:385] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.482796  2428 raft_consensus.cc:740] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.486500  2546 leader_election.cc:290] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.487372  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:40.489570  2349 leader_election.cc:343] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.491907  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.475082  2631 consensus_queue.cc:1048] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:10:40.494068  2347 leader_election.cc:343] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.494539  2347 leader_election.cc:304] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.496394  2428 consensus_queue.cc:260] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.498256  2546 raft_consensus.cc:2749] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.498550  2428 ts_tablet_manager.cc:1434] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.000s
I20260709 13:10:40.500591  2430 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.501101  2430 ts_tablet_manager.cc:1403] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.018s
I20260709 13:10:40.503978  2430 raft_consensus.cc:359] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.504899  2430 raft_consensus.cc:385] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.505182  2430 raft_consensus.cc:740] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.505905  2430 consensus_queue.cc:260] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.507617  2430 ts_tablet_manager.cc:1434] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:40.508500  2430 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.508523  2431 tablet_bootstrap.cc:654] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.499568  2428 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.517174  2429 tablet_bootstrap.cc:654] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.521377  2430 tablet_bootstrap.cc:654] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.525472  2631 consensus_queue.cc:1048] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:40.530330  2428 tablet_bootstrap.cc:654] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.535837  2429 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:40.536489  2429 ts_tablet_manager.cc:1403] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.009s
I20260709 13:10:40.537037  2056 catalog_manager.cc:5697] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.539415  2429 raft_consensus.cc:359] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.540602  2429 raft_consensus.cc:385] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.540895  2429 raft_consensus.cc:740] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.543216  2430 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.543820  2430 ts_tablet_manager.cc:1403] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.000s
I20260709 13:10:40.543244  2429 consensus_queue.cc:260] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.546507  2430 raft_consensus.cc:359] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.547150  2430 raft_consensus.cc:385] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.547498  2430 raft_consensus.cc:740] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.548384  2430 consensus_queue.cc:260] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.550498  2430 ts_tablet_manager.cc:1434] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:40.550628  2546 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.551141  2546 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.554100  2430 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.555550  2546 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.556398  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.557626  2431 tablet_bootstrap.cc:492] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.557839  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:40.558370  2431 ts_tablet_manager.cc:1403] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.006s
W20260709 13:10:40.559247  2349 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:40.560142  2346 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.560575  2346 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:40.561694  2546 raft_consensus.cc:2749] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.562427  2644 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.562927  2644 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.566109  2429 ts_tablet_manager.cc:1434] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:10:40.567142  2429 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:40.568343  2431 raft_consensus.cc:359] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.569007  2431 raft_consensus.cc:385] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.569264  2431 raft_consensus.cc:740] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.571761  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:40.573649  2124 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.574191  2431 consensus_queue.cc:260] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.575891  2546 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.576416  2431 ts_tablet_manager.cc:1434] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:40.576373  2546 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.576602  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.577440  2431 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:40.577630  2380 raft_consensus.cc:2468] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.579068  2123 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.579375  2546 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:40.580072  2641 raft_consensus.cc:2804] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.580441  2641 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.580773  2641 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.581120  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:40.582640  2346 leader_election.cc:343] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.583384  2431 tablet_bootstrap.cc:654] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.583937  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:40.585417  2347 leader_election.cc:343] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.585884  2347 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:40.586632  2506 raft_consensus.cc:2749] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.587066  2644 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.587725  2430 tablet_bootstrap.cc:654] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.598517  2430 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.599067  2430 ts_tablet_manager.cc:1403] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.007s
I20260709 13:10:40.601898  2430 raft_consensus.cc:359] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.602298  2429 tablet_bootstrap.cc:654] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.602618  2430 raft_consensus.cc:385] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.602916  2430 raft_consensus.cc:740] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.604231  2430 consensus_queue.cc:260] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.604607  2641 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.608734  2430 ts_tablet_manager.cc:1434] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:10:40.610126  2430 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.610247  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:40.611764  2124 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.602375  2428 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.616181  2428 ts_tablet_manager.cc:1403] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.002s
I20260709 13:10:40.618501  2428 raft_consensus.cc:359] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.619006  2428 raft_consensus.cc:385] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.619246  2428 raft_consensus.cc:740] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.619886  2428 consensus_queue.cc:260] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.621714  2428 ts_tablet_manager.cc:1434] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:10:40.622434  2641 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.623531  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:40.624177  2380 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.627368  2430 tablet_bootstrap.cc:654] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.627483  2428 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.633632  2431 tablet_bootstrap.cc:492] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.634284  2431 ts_tablet_manager.cc:1403] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.007s
I20260709 13:10:40.636818  2428 tablet_bootstrap.cc:654] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.637975  2431 raft_consensus.cc:359] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.638933  2431 raft_consensus.cc:385] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.639278  2431 raft_consensus.cc:740] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.642508  2431 consensus_queue.cc:260] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.644663  2431 ts_tablet_manager.cc:1434] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:10:40.645581  2431 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:40.653570  2431 tablet_bootstrap.cc:654] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.659065  2428 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.659065  2430 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.660161  2430 ts_tablet_manager.cc:1403] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.001s
I20260709 13:10:40.660460  2429 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:40.660969  2429 ts_tablet_manager.cc:1403] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.038s
I20260709 13:10:40.662870  2430 raft_consensus.cc:359] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.659581  2428 ts_tablet_manager.cc:1403] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.032s	user 0.002s	sys 0.008s
I20260709 13:10:40.663537  2429 raft_consensus.cc:359] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.664352  2429 raft_consensus.cc:385] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.664606  2429 raft_consensus.cc:740] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.665228  2429 consensus_queue.cc:260] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.666409  2428 raft_consensus.cc:359] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.667060  2428 raft_consensus.cc:385] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.667301  2428 raft_consensus.cc:740] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.667339  2429 ts_tablet_manager.cc:1434] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:40.663581  2430 raft_consensus.cc:385] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.668838  2430 raft_consensus.cc:740] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.669016  2638 raft_consensus.cc:493] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.669517  2638 raft_consensus.cc:515] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.669653  2430 consensus_queue.cc:260] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.670761  2628 raft_consensus.cc:493] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.671240  2628 raft_consensus.cc:515] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.671904  2430 ts_tablet_manager.cc:1434] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:10:40.672888  2430 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.673300  2628 leader_election.cc:290] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.674242  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.674865  2156 raft_consensus.cc:2468] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:40.674945  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.675611  2309 raft_consensus.cc:2468] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:40.668141  2428 consensus_queue.cc:260] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.676616  2198 leader_election.cc:304] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:40.677356  2644 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.678009  2629 raft_consensus.cc:2804] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.677834  2644 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.678434  2629 raft_consensus.cc:493] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.678799  2629 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.680101  2644 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.681541  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.681738  2199 leader_election.cc:304] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:40.682909  2534 raft_consensus.cc:2804] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:40.683151  2124 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.683295  2534 raft_consensus.cc:493] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.683719  2534 raft_consensus.cc:3060] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.683842  2644 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.684340  2644 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.684615  2380 raft_consensus.cc:2468] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:40.686079  2123 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.687522  2641 raft_consensus.cc:2804] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.688026  2641 raft_consensus.cc:697] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:40.688194  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:40.688970  2644 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.688872  2641 consensus_queue.cc:237] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.677809  2428 ts_tablet_manager.cc:1434] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:40.690693  2428 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.688889  2235 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.692823  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.693645  2126 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
W20260709 13:10:40.694348  2199 leader_election.cc:343] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.694571  2567 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.694974  2567 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.695307  2567 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.696254  2431 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.696759  2431 ts_tablet_manager.cc:1403] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.008s
I20260709 13:10:40.697402  2430 tablet_bootstrap.cc:654] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.699442  2431 raft_consensus.cc:359] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.700171  2431 raft_consensus.cc:385] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.700434  2431 raft_consensus.cc:740] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.701368  2431 consensus_queue.cc:260] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.705982  2430 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.706509  2430 ts_tablet_manager.cc:1403] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.034s	user 0.003s	sys 0.006s
I20260709 13:10:40.706660  2567 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.703264  2428 tablet_bootstrap.cc:654] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.707520  2431 ts_tablet_manager.cc:1434] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:40.709539  2431 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:40.702445  2638 leader_election.cc:290] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.711700  2430 raft_consensus.cc:359] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.712443  2430 raft_consensus.cc:385] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.712703  2430 raft_consensus.cc:740] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.715503  2430 consensus_queue.cc:260] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.718624  2431 tablet_bootstrap.cc:654] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.718294  2534 raft_consensus.cc:515] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.718874  2430 ts_tablet_manager.cc:1434] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:40.719871  2430 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.721078  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.721673  2309 raft_consensus.cc:3060] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.724982  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:40.725791  2235 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.729692  2428 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.730232  2428 ts_tablet_manager.cc:1403] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.004s
I20260709 13:10:40.732162  2431 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.732689  2431 ts_tablet_manager.cc:1403] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:10:40.733115  2428 raft_consensus.cc:359] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.733969  2428 raft_consensus.cc:385] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.734264  2428 raft_consensus.cc:740] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.734321  2567 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:40.734964  2428 consensus_queue.cc:260] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.733188  2629 raft_consensus.cc:515] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.736227  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.736140  2431 raft_consensus.cc:359] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.736891  2431 raft_consensus.cc:385] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.736939  2383 raft_consensus.cc:2468] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:40.737238  2431 raft_consensus.cc:740] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.737398  2629 leader_election.cc:290] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.738142  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:40.738103  2431 consensus_queue.cc:260] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.738816  2156 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.739332  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.740358  2381 raft_consensus.cc:2468] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.741978  2428 ts_tablet_manager.cc:1434] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:40.742327  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.742959  2304 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.743088  2428 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.745329  2123 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.746199  2644 raft_consensus.cc:2804] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:40.746552  2644 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.746881  2644 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.739877  2430 tablet_bootstrap.cc:654] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.739818  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.748003  2382 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:40.748558  2631 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.749063  2631 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.751236  2631 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:40.753145  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:40.753443  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:40.754037  2382 raft_consensus.cc:2393] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:40.756083  2428 tablet_bootstrap.cc:654] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.756686  2644 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.757099  2304 raft_consensus.cc:2468] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.761981  2430 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:40.762172  2509 raft_consensus.cc:493] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.762506  2430 ts_tablet_manager.cc:1403] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.009s
I20260709 13:10:40.762713  2509 raft_consensus.cc:515] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.763777  2156 raft_consensus.cc:2468] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.764401  2644 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.763844  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:40.778627  2382 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.740720  2431 ts_tablet_manager.cc:1434] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:40.780277  2309 raft_consensus.cc:2468] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.780923  2629 consensus_queue.cc:1048] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.782167  2431 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:40.781997  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:40.782315  2644 consensus_queue.cc:1048] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.765650  2430 raft_consensus.cc:359] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.766712  2509 leader_election.cc:290] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:40.768807  2272 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:40.784474  2631 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.785076  2235 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:40.770210  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:40.771620  2199 leader_election.cc:304] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:40.794317  2199 leader_election.cc:304] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:40.776611  2429 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:40.795073  2638 raft_consensus.cc:2804] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:40.795543  2349 leader_election.cc:343] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.795771  2538 raft_consensus.cc:2804] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.796273  2538 raft_consensus.cc:697] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:40.797071  2538 consensus_queue.cc:237] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.797484  2509 consensus_queue.cc:1048] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.776989  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
W20260709 13:10:40.783432  2124 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.795596  2638 raft_consensus.cc:697] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:40.802565  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:40.803154  2381 raft_consensus.cc:3060] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.803313  2380 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.805750  2058 catalog_manager.cc:5697] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.803310  2638 consensus_queue.cc:237] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.785337  2534 leader_election.cc:290] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:40.769264  2428 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:40.812693  2428 ts_tablet_manager.cc:1403] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.003s
I20260709 13:10:40.815603  2428 raft_consensus.cc:359] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.816471  2428 raft_consensus.cc:385] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.816732  2428 raft_consensus.cc:740] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.817420  2428 consensus_queue.cc:260] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.821087  2631 raft_consensus.cc:2749] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.821774  2428 ts_tablet_manager.cc:1434] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:40.822335  2381 raft_consensus.cc:2468] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:40.822984  2428 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:40.785578  2430 raft_consensus.cc:385] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.788025  2382 raft_consensus.cc:2468] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:40.788735  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:40.824592  2430 raft_consensus.cc:740] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
W20260709 13:10:40.825119  2347 leader_election.cc:343] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:40.825608  2347 leader_election.cc:304] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.827018  2506 raft_consensus.cc:2749] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:40.825536  2430 consensus_queue.cc:260] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:40.827389  2123 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:40.831557  2429 tablet_bootstrap.cc:654] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.831614  2641 raft_consensus.cc:2804] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.832446  2641 raft_consensus.cc:697] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:40.833455  2641 consensus_queue.cc:237] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:40.835777  2430 ts_tablet_manager.cc:1434] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 13:10:40.836480  2126 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:40.838249  2567 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.840147  2430 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:40.838918  2567 raft_consensus.cc:697] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:40.850248  2567 consensus_queue.cc:237] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:40.842890  2380 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:40.843050  2534 consensus_queue.cc:1048] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:40.882500  2641 consensus_queue.cc:1048] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:40.893810  2431 tablet_bootstrap.cc:654] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.899155  2304 raft_consensus.cc:3060] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.907629  2629 consensus_queue.cc:1048] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:40.910773  2430 tablet_bootstrap.cc:654] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.895319  2428 tablet_bootstrap.cc:654] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.923484  2506 consensus_queue.cc:1048] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:40.942874  2431 tablet_bootstrap.cc:492] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:40.943471  2431 ts_tablet_manager.cc:1403] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.161s	user 0.019s	sys 0.000s
I20260709 13:10:40.953013  2429 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:40.953510  2429 ts_tablet_manager.cc:1403] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.017s
I20260709 13:10:40.962934  2058 catalog_manager.cc:5697] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.966164  2058 catalog_manager.cc:5697] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.968619  2431 raft_consensus.cc:359] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:40.969197  2431 raft_consensus.cc:385] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.969393  2431 raft_consensus.cc:740] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
W20260709 13:10:40.989056  2687 log.cc:927] Time spent T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:41.002899  2431 consensus_queue.cc:260] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.024717  2693 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.025439  2693 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.026780  2431 ts_tablet_manager.cc:1434] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 13:10:41.029114  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.029853  2693 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:41.029903  2234 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.032388  2126 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:41.033425  2693 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.033815  2693 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.033906  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:41.035722  2124 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.034236  2693 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.015304  2429 raft_consensus.cc:359] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.054961  2429 raft_consensus.cc:385] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.055392  2429 raft_consensus.cc:740] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.056867  2429 consensus_queue.cc:260] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.058512  2429 ts_tablet_manager.cc:1434] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.002s
I20260709 13:10:41.054126  2638 consensus_queue.cc:1048] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:41.066299  2057 catalog_manager.cc:5697] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.068064  2057 catalog_manager.cc:5697] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.028430  2431 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:41.093952  2430 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.094509  2430 ts_tablet_manager.cc:1403] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.255s	user 0.012s	sys 0.003s
I20260709 13:10:41.095922  2631 raft_consensus.cc:493] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.096634  2631 raft_consensus.cc:515] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.099263  2631 leader_election.cc:290] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.101951  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.102665  2234 raft_consensus.cc:2468] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:41.110504  2429 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:41.115574  2275 leader_election.cc:304] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
W20260709 13:10:41.115803  2692 log.cc:927] Time spent T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:41.124104  2428 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.124636  2428 ts_tablet_manager.cc:1403] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.302s	user 0.016s	sys 0.004s
I20260709 13:10:41.125895  2693 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.128822  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:41.128779  2428 raft_consensus.cc:359] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.129681  2235 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.129741  2428 raft_consensus.cc:385] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.130211  2428 raft_consensus.cc:740] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.130854  2428 consensus_queue.cc:260] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.135337  2631 raft_consensus.cc:2804] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.135792  2631 raft_consensus.cc:493] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.136152  2631 raft_consensus.cc:3060] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.137614  2235 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:41.140024  2126 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:41.140941  2644 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:41.141412  2644 raft_consensus.cc:697] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:41.142233  2644 consensus_queue.cc:237] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.142904  2567 consensus_queue.cc:1048] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.144980  2430 raft_consensus.cc:359] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.145640  2430 raft_consensus.cc:385] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.145884  2430 raft_consensus.cc:740] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.143620  2691 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.146919  2691 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.148134  2428 ts_tablet_manager.cc:1434] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:10:41.149181  2428 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.146620  2430 consensus_queue.cc:260] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.150570  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.150777  2691 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:41.151237  2381 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.152570  2123 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.152678  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.153438  2567 raft_consensus.cc:2804] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.153825  2567 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.154215  2567 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.154729  2430 ts_tablet_manager.cc:1434] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 13:10:41.154920  2428 tablet_bootstrap.cc:654] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.153321  2234 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.161945  2567 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.155767  2430 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.164812  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:41.178534  2381 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.188752  2634 raft_consensus.cc:493] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:41.199410  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:41.200093  2235 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.199983  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.201690  2382 raft_consensus.cc:2468] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:41.202220  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:41.203730  2124 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.189375  2634 raft_consensus.cc:515] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.195407  2691 raft_consensus.cc:493] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.192049  2567 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:41.195815  2693 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:41.191052  2631 raft_consensus.cc:515] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.211933  2691 raft_consensus.cc:515] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.217754  2631 leader_election.cc:290] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.218094  2691 leader_election.cc:290] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:41.218654  2691 consensus_queue.cc:1048] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.225932  2058 catalog_manager.cc:5697] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.229658  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:41.230628  2233 raft_consensus.cc:3060] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.232582  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.232831  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.230651  2634 leader_election.cc:290] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
W20260709 13:10:41.236714  2124 leader_election.cc:343] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.238245  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.242581  2538 consensus_queue.cc:1048] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:41.243985  2126 leader_election.cc:343] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.244519  2126 leader_election.cc:304] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:41.245795  2691 raft_consensus.cc:2749] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.247264  2235 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:41.257277  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c273a3ff30d4d62834d75d88cd4a1f3" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:41.257913  2383 raft_consensus.cc:3060] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.262015  2431 tablet_bootstrap.cc:654] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.264864  2126 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:41.277444  2383 raft_consensus.cc:2468] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:41.279831  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8f4ba6025b41a5b7acfa364c00c104" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.286922  2693 raft_consensus.cc:2804] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:41.306165  2124 consensus_peers.cc:597] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.306779  2428 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.307296  2428 ts_tablet_manager.cc:1403] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.017s
W20260709 13:10:41.309935  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:41.310719  2428 raft_consensus.cc:359] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.311431  2428 raft_consensus.cc:385] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.311722  2428 raft_consensus.cc:740] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.312956  2428 consensus_queue.cc:260] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.314857  2430 tablet_bootstrap.cc:654] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.315083  2428 ts_tablet_manager.cc:1434] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:41.316886  2428 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.301331  2381 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:41.322116  2428 tablet_bootstrap.cc:654] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.328431  2644 consensus_queue.cc:1048] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.329500  2272 leader_election.cc:304] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.330431  2634 raft_consensus.cc:2804] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:41.330930  2634 raft_consensus.cc:697] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:41.331765  2634 consensus_queue.cc:237] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.302426  2693 raft_consensus.cc:697] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:41.325219  2233 raft_consensus.cc:2468] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:41.336651  2429 tablet_bootstrap.cc:654] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.346779  2693 consensus_queue.cc:237] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.351214  2272 leader_election.cc:304] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:41.352330  2631 raft_consensus.cc:2749] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:41.359951  2639 consensus_queue.cc:1048] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.363071  2431 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:41.363832  2431 ts_tablet_manager.cc:1403] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.336s	user 0.012s	sys 0.002s
I20260709 13:10:41.366565  2431 raft_consensus.cc:359] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.376555  2431 raft_consensus.cc:385] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.376886  2431 raft_consensus.cc:740] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.382169  2431 consensus_queue.cc:260] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.382997  2638 raft_consensus.cc:493] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.383858  2431 ts_tablet_manager.cc:1434] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:10:41.383518  2638 raft_consensus.cc:515] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.371958  2428 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.385808  2428 ts_tablet_manager.cc:1403] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:10:41.386809  2638 leader_election.cc:290] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.388899  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.397302  2380 raft_consensus.cc:2468] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:41.390226  2644 raft_consensus.cc:493] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.398532  2644 raft_consensus.cc:515] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.400498  2198 leader_election.cc:304] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.393318  2053 catalog_manager.cc:5697] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.394748  2431 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:41.401690  2639 raft_consensus.cc:2804] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.402109  2639 raft_consensus.cc:493] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.402416  2639 raft_consensus.cc:3060] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.395802  2429 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:41.404441  2429 ts_tablet_manager.cc:1403] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.324s	user 0.008s	sys 0.007s
I20260709 13:10:41.407065  2429 raft_consensus.cc:359] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.407763  2429 raft_consensus.cc:385] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.408032  2429 raft_consensus.cc:740] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.408855  2644 leader_election.cc:290] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:41.408679  2429 consensus_queue.cc:260] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.410477  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.411147  2382 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.412716  2644 consensus_queue.cc:1048] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.414089  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.414788  2056 catalog_manager.cc:5697] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.415271  2639 raft_consensus.cc:515] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.417554  2639 leader_election.cc:290] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.419080  2123 leader_election.cc:304] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.419950  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:41.425624  2380 raft_consensus.cc:3060] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.426705  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:41.428365  2431 tablet_bootstrap.cc:654] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.379799  2430 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.400662  2428 raft_consensus.cc:359] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.432050  2428 raft_consensus.cc:385] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.432135  2430 ts_tablet_manager.cc:1403] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.000s
I20260709 13:10:41.432394  2428 raft_consensus.cc:740] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.433161  2428 consensus_queue.cc:260] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.434054  2233 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.420346  2644 raft_consensus.cc:2804] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.434675  2644 raft_consensus.cc:493] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.423697  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.434970  2430 raft_consensus.cc:359] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.425011  2429 ts_tablet_manager.cc:1434] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:10:41.435896  2430 raft_consensus.cc:385] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.436240  2430 raft_consensus.cc:740] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.436882  2430 consensus_queue.cc:260] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.439095  2430 ts_tablet_manager.cc:1434] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:10:41.439141  2199 leader_election.cc:343] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.439631  2534 consensus_queue.cc:1048] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.440114  2430 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.441023  2534 consensus_queue.cc:1048] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.442472  2429 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:41.435031  2644 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.447508  2430 tablet_bootstrap.cc:654] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.456480  2644 raft_consensus.cc:515] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.459482  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:41.460151  2381 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.461320  2428 ts_tablet_manager.cc:1434] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:10:41.463655  2428 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.473462  2381 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:41.475347  2691 consensus_queue.cc:1048] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:41.485849  2199 leader_election.cc:343] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.478542  2380 raft_consensus.cc:2468] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:41.479746  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:41.486861  2644 leader_election.cc:290] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:41.489012  2198 leader_election.cc:304] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:41.487202  2233 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.488293  2123 leader_election.cc:304] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.491904  2431 tablet_bootstrap.cc:492] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:41.492434  2431 ts_tablet_manager.cc:1403] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.003s
I20260709 13:10:41.483547  2428 tablet_bootstrap.cc:654] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.494050  2691 raft_consensus.cc:2804] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:41.494788  2691 raft_consensus.cc:697] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:41.495605  2691 consensus_queue.cc:237] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.498073  2639 raft_consensus.cc:2804] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:41.499634  2639 raft_consensus.cc:697] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:41.500804  2639 consensus_queue.cc:237] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.503425  2431 raft_consensus.cc:359] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.506397  2431 raft_consensus.cc:385] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.506675  2431 raft_consensus.cc:740] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.518333  2429 tablet_bootstrap.cc:654] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.508898  2431 consensus_queue.cc:260] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.521468  2431 ts_tablet_manager.cc:1434] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:10:41.522868  2431 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:41.528515  2509 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.529255  2509 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.539743  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:41.534261  2509 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:41.546509  2430 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.547011  2430 ts_tablet_manager.cc:1403] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.020s
I20260709 13:10:41.553568  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:41.544293  2346 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.565047  2430 raft_consensus.cc:359] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:41.561949  2347 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.571059  2347 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:41.550261  2233 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:41.573107  2546 raft_consensus.cc:2749] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.567078  2058 catalog_manager.cc:5697] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.577073  2431 tablet_bootstrap.cc:654] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.581671  2429 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:41.570768  2430 raft_consensus.cc:385] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.588963  2430 raft_consensus.cc:740] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.589669  2430 consensus_queue.cc:260] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.592410  2430 ts_tablet_manager.cc:1434] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:10:41.590723  2057 catalog_manager.cc:5697] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.593391  2430 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.595032  2429 ts_tablet_manager.cc:1403] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.011s
I20260709 13:10:41.603852  2428 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.603632  2429 raft_consensus.cc:359] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.604398  2428 ts_tablet_manager.cc:1403] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.028s
I20260709 13:10:41.604533  2429 raft_consensus.cc:385] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.604988  2429 raft_consensus.cc:740] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.605746  2430 tablet_bootstrap.cc:654] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.605826  2429 consensus_queue.cc:260] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.608182  2429 ts_tablet_manager.cc:1434] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.006s
I20260709 13:10:41.610021  2429 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:41.607132  2428 raft_consensus.cc:359] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.615330  2428 raft_consensus.cc:385] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.615617  2428 raft_consensus.cc:740] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.616422  2428 consensus_queue.cc:260] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.619773  2428 ts_tablet_manager.cc:1434] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:41.623047  2428 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.634124  2428 tablet_bootstrap.cc:654] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.634311  2430 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.634825  2430 ts_tablet_manager.cc:1403] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.015s
W20260709 13:10:41.635619  2124 consensus_peers.cc:597] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.637601  2430 raft_consensus.cc:359] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.638301  2430 raft_consensus.cc:385] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.638571  2430 raft_consensus.cc:740] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.639355  2430 consensus_queue.cc:260] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.641273  2430 ts_tablet_manager.cc:1434] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:41.642163  2430 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.648041  2430 tablet_bootstrap.cc:654] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.649942  2639 raft_consensus.cc:493] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.650471  2639 raft_consensus.cc:515] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.652631  2639 leader_election.cc:290] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.654495  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.654870  2431 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:41.655344  2431 ts_tablet_manager.cc:1403] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.007s
I20260709 13:10:41.655427  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
W20260709 13:10:41.656059  2199 leader_election.cc:343] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:41.657369  2198 leader_election.cc:343] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.657788  2198 leader_election.cc:304] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:41.657956  2431 raft_consensus.cc:359] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.658571  2639 raft_consensus.cc:2749] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.659121  2430 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.659585  2430 ts_tablet_manager.cc:1403] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:10:41.658643  2431 raft_consensus.cc:385] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.660248  2431 raft_consensus.cc:740] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.660983  2431 consensus_queue.cc:260] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.661381  2429 tablet_bootstrap.cc:654] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.663503  2431 ts_tablet_manager.cc:1434] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:41.664911  2431 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:41.677985  2431 tablet_bootstrap.cc:654] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.688050  2430 raft_consensus.cc:359] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.688741  2430 raft_consensus.cc:385] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.689005  2430 raft_consensus.cc:740] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.689815  2430 consensus_queue.cc:260] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.694607  2430 ts_tablet_manager.cc:1434] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:10:41.694916  2428 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.695732  2428 ts_tablet_manager.cc:1403] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.010s
I20260709 13:10:41.696472  2430 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.698951  2428 raft_consensus.cc:359] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.699657  2428 raft_consensus.cc:385] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.699946  2428 raft_consensus.cc:740] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.700176  2429 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:41.700713  2429 ts_tablet_manager.cc:1403] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.008s
I20260709 13:10:41.700644  2428 consensus_queue.cc:260] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.703840  2428 ts_tablet_manager.cc:1434] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:41.705338  2428 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.706423  2644 consensus_queue.cc:1048] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.708963  2430 tablet_bootstrap.cc:654] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.725364  2428 tablet_bootstrap.cc:654] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.725318  2634 consensus_queue.cc:1048] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:41.734702  2644 consensus_queue.cc:1048] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.739343  2429 raft_consensus.cc:359] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.743265  2429 raft_consensus.cc:385] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.744217  2429 raft_consensus.cc:740] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.745802  2429 consensus_queue.cc:260] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.754778  2634 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.755467  2634 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.757979  2634 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:41.761467  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.762959  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:41.768808  2272 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:41.770328  2634 raft_consensus.cc:2749] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.773132  2428 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.773614  2428 ts_tablet_manager.cc:1403] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.069s	user 0.034s	sys 0.028s
I20260709 13:10:41.765375  2431 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:41.774967  2431 ts_tablet_manager.cc:1403] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.016s
I20260709 13:10:41.776144  2428 raft_consensus.cc:359] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.776914  2428 raft_consensus.cc:385] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.777165  2428 raft_consensus.cc:740] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.777854  2428 consensus_queue.cc:260] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.779608  2428 ts_tablet_manager.cc:1434] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:41.780683  2428 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.781900  2429 ts_tablet_manager.cc:1434] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:10:41.784633  2431 raft_consensus.cc:359] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.785322  2431 raft_consensus.cc:385] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.785573  2431 raft_consensus.cc:740] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.786896  2428 tablet_bootstrap.cc:654] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.792798  2691 consensus_queue.cc:1048] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:41.799727  2634 raft_consensus.cc:493] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.800432  2634 raft_consensus.cc:515] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:41.813060  2430 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.817133  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.818015  2379 raft_consensus.cc:2393] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:41.818856  2430 ts_tablet_manager.cc:1403] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.008s
I20260709 13:10:41.819444  2634 leader_election.cc:290] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.821868  2430 raft_consensus.cc:359] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.822606  2430 raft_consensus.cc:385] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.822913  2430 raft_consensus.cc:740] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.824024  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.826153  2430 consensus_queue.cc:260] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.826817  2275 leader_election.cc:304] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:41.827791  2701 consensus_queue.cc:1048] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:41.829075  2701 raft_consensus.cc:3060] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.839286  2308 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.840488  2428 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.840998  2428 ts_tablet_manager.cc:1403] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.020s
I20260709 13:10:41.843632  2428 raft_consensus.cc:359] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.844349  2428 raft_consensus.cc:385] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.844671  2428 raft_consensus.cc:740] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.845420  2428 consensus_queue.cc:260] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.847277  2428 ts_tablet_manager.cc:1434] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:10:41.848345  2428 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.852869  2644 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.853500  2644 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.854061  2428 tablet_bootstrap.cc:654] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.857579  2639 raft_consensus.cc:493] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.858105  2639 raft_consensus.cc:515] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.859623  2701 raft_consensus.cc:2749] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:41.859719  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.885295  2382 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.861078  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:41.886449  2158 raft_consensus.cc:2468] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:41.886226  2429 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:41.862360  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.864209  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.864684  2639 leader_election.cc:290] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:41.865368  2644 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.888381  2123 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:41.888638  2691 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.889225  2199 leader_election.cc:343] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.889190  2691 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.890021  2644 raft_consensus.cc:2804] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.890421  2644 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.890751  2644 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.857103  2430 ts_tablet_manager.cc:1434] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:10:41.892513  2430 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:41.894047  2198 leader_election.cc:304] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:41.894490  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:41.894946  2639 raft_consensus.cc:2804] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.895366  2639 raft_consensus.cc:493] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.895714  2639 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:41.897353  2124 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.898272  2430 tablet_bootstrap.cc:654] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.898918  2429 tablet_bootstrap.cc:654] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.891479  2691 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.874756  2428 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.876257  2431 consensus_queue.cc:260] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.904222  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:41.904707  2428 ts_tablet_manager.cc:1403] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.016s
I20260709 13:10:41.904976  2382 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.906107  2431 ts_tablet_manager.cc:1434] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.001s
I20260709 13:10:41.906669  2123 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:41.907464  2428 raft_consensus.cc:359] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.908213  2428 raft_consensus.cc:385] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.908525  2428 raft_consensus.cc:740] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.908643  2691 raft_consensus.cc:2804] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.909094  2691 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.907099  2431 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:41.909497  2691 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.909221  2428 consensus_queue.cc:260] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.911425  2428 ts_tablet_manager.cc:1434] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:41.907955  2309 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.915849  2641 consensus_queue.cc:1048] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.918442  2431 tablet_bootstrap.cc:654] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.919289  2428 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:41.920187  2641 consensus_queue.cc:1048] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:41.925625  2428 tablet_bootstrap.cc:654] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.948354  2641 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.948947  2641 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:41.953558  2641 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:41.957147  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
W20260709 13:10:41.959944  2123 leader_election.cc:343] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.956903  2639 raft_consensus.cc:515] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.970609  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:41.971341  2235 raft_consensus.cc:2468] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:41.972518  2639 leader_election.cc:290] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:41.974009  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:41.977545  2199 leader_election.cc:343] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.980265  2644 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:41.982122  2428 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:41.993707  2701 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.986693  2430 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:41.994663  2430 ts_tablet_manager.cc:1403] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.026s
I20260709 13:10:41.994445  2701 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:41.995558  2644 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:41.995625  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:41.996160  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:41.996425  2309 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.996768  2382 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.999166  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:41.999790  2159 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.999948  2629 consensus_queue.cc:1048] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.002035  2126 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:42.003999  2567 raft_consensus.cc:2804] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.004367  2567 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.004674  2567 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.997489  2430 raft_consensus.cc:359] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.008046  2430 raft_consensus.cc:385] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.970656  2691 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.011729  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:42.014897  2124 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.016495  2159 raft_consensus.cc:2468] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:42.017349  2430 raft_consensus.cc:740] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.018507  2701 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:42.019310  2430 consensus_queue.cc:260] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.021080  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.021472  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:41.993834  2428 ts_tablet_manager.cc:1403] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.008s
I20260709 13:10:42.022846  2538 consensus_queue.cc:1048] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.023252  2691 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.021386  2567 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.028117  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:42.028750  2380 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.032750  2382 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:42.032960  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:42.037032  2123 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:42.033134  2430 ts_tablet_manager.cc:1434] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:10:42.035049  2567 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:42.023195  2309 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:42.027896  2428 raft_consensus.cc:359] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.038108  2691 raft_consensus.cc:2804] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.039988  2430 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:42.045022  2431 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:42.059237  2431 ts_tablet_manager.cc:1403] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.012s
I20260709 13:10:42.062603  2431 raft_consensus.cc:359] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.053434  2509 raft_consensus.cc:493] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.066941  2431 raft_consensus.cc:385] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.037868  2380 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:42.067342  2509 raft_consensus.cc:515] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.052016  2272 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:42.069726  2429 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:42.070297  2429 ts_tablet_manager.cc:1403] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.184s	user 0.027s	sys 0.025s
I20260709 13:10:42.051157  2308 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.073239  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccaafad28af45a6b734656bd19362b5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.068555  2567 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.074033  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccaafad28af45a6b734656bd19362b5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.074193  2567 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:42.075630  2347 leader_election.cc:343] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.076545  2567 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.065793  2430 tablet_bootstrap.cc:654] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:42.038450  2123 leader_election.cc:343] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:42.081911  2123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 43500.3us
W20260709 13:10:42.050024  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 51757.8us
I20260709 13:10:42.083863  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.054419  2644 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.074097  2509 leader_election.cc:290] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.086928  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:42.085297  2644 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.093247  2235 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.101984  2235 raft_consensus.cc:2468] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
W20260709 13:10:42.091291  2124 leader_election.cc:343] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.054904  2428 raft_consensus.cc:385] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.089661  2429 raft_consensus.cc:359] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.104172  2428 raft_consensus.cc:740] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.104894  2429 raft_consensus.cc:385] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.105315  2428 consensus_queue.cc:260] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.106191  2234 raft_consensus.cc:2468] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:42.101842  2644 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.105295  2429 raft_consensus.cc:740] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.107443  2428 ts_tablet_manager.cc:1434] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.000s
I20260709 13:10:42.109203  2428 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:42.109385  2349 leader_election.cc:304] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.107863  2429 consensus_queue.cc:260] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.109880  2691 raft_consensus.cc:697] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:42.111505  2506 raft_consensus.cc:2804] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.105260  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.112003  2506 raft_consensus.cc:493] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.112412  2506 raft_consensus.cc:3060] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:42.113397  2124 leader_election.cc:343] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.111049  2691 consensus_queue.cc:237] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.117653  2429 ts_tablet_manager.cc:1434] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:10:42.120329  2428 tablet_bootstrap.cc:654] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.120880  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:42.121625  2380 raft_consensus.cc:2468] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:42.120112  2123 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.122326  2429 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:42.123566  2123 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.124378  2693 raft_consensus.cc:2804] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.090926  2198 leader_election.cc:304] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.124886  2693 raft_consensus.cc:697] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:42.068207  2431 raft_consensus.cc:740] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.126695  2693 consensus_queue.cc:237] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.125487  2641 raft_consensus.cc:2804] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.129957  2641 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.128854  2431 consensus_queue.cc:260] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.130362  2641 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.150691  2056 catalog_manager.cc:5697] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.153872  2431 ts_tablet_manager.cc:1434] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
W20260709 13:10:42.158432  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 67592.2us
I20260709 13:10:42.161659  2538 raft_consensus.cc:2804] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.162241  2538 raft_consensus.cc:697] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:42.163340  2431 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:42.163115  2538 consensus_queue.cc:237] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.170557  2429 tablet_bootstrap.cc:654] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.172353  2638 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.172456  2641 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.181842  2431 tablet_bootstrap.cc:654] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.178732  2506 raft_consensus.cc:515] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.186043  2430 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:42.186586  2430 ts_tablet_manager.cc:1403] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.003s
I20260709 13:10:42.188208  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccaafad28af45a6b734656bd19362b5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:42.188921  2235 raft_consensus.cc:3060] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.197247  2639 raft_consensus.cc:493] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.197789  2639 raft_consensus.cc:515] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.191295  2430 raft_consensus.cc:359] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.199040  2430 raft_consensus.cc:385] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.199321  2430 raft_consensus.cc:740] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.199944  2430 consensus_queue.cc:260] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.202298  2430 ts_tablet_manager.cc:1434] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:10:42.202395  2126 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:42.203199  2430 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:42.204667  2644 raft_consensus.cc:2804] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.205363  2644 raft_consensus.cc:697] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:42.205416  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.206611  2644 consensus_queue.cc:237] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.208513  2639 leader_election.cc:290] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.182844  2638 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.216249  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.217221  2309 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:42.217572  2233 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:42.217916  2638 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.219440  2199 leader_election.cc:304] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:42.220475  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:42.221158  2158 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:42.224519  2641 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.231316  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.228595  2638 raft_consensus.cc:2804] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.233753  2638 raft_consensus.cc:493] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.234208  2638 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.220467  2506 leader_election.cc:290] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.237152  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:42.238631  2124 leader_election.cc:343] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:42.245819  2199 leader_election.cc:343] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.249282  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccaafad28af45a6b734656bd19362b5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:42.264297  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 49290us
I20260709 13:10:42.264204  2701 raft_consensus.cc:2749] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.267388  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:42.268110  2158 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:42.268288  2429 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:42.268874  2429 ts_tablet_manager.cc:1403] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.005s
I20260709 13:10:42.260056  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:42.273489  2428 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:42.274718  2428 ts_tablet_manager.cc:1403] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.166s	user 0.053s	sys 0.057s
W20260709 13:10:42.278064  2347 leader_election.cc:343] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.280514  2429 raft_consensus.cc:359] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.281339  2429 raft_consensus.cc:385] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.281644  2429 raft_consensus.cc:740] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.282052  2235 raft_consensus.cc:2468] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:42.285740  2349 leader_election.cc:304] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.287359  2430 tablet_bootstrap.cc:654] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.282361  2429 consensus_queue.cc:260] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.287855  2588 raft_consensus.cc:2804] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.276726  2380 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.285765  2057 catalog_manager.cc:5697] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.288941  2638 raft_consensus.cc:515] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.292052  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:42.292747  2309 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.293886  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:42.294494  2159 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.295509  2588 raft_consensus.cc:697] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:42.296334  2429 ts_tablet_manager.cc:1434] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:10:42.296442  2588 consensus_queue.cc:237] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.297363  2429 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:42.300302  2309 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:42.301779  2199 leader_election.cc:304] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:42.302428  2198 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.302670  2538 raft_consensus.cc:2804] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.303386  2534 raft_consensus.cc:2804] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.303795  2534 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.304100  2534 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.277603  2126 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.306602  2641 raft_consensus.cc:2804] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.306964  2641 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.307301  2641 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.307811  2538 raft_consensus.cc:697] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:42.315131  2380 raft_consensus.cc:2468] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:42.319033  2159 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:42.284250  2428 raft_consensus.cc:359] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.320536  2428 raft_consensus.cc:385] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.320845  2428 raft_consensus.cc:740] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.321501  2428 consensus_queue.cc:260] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.322047  2123 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.325838  2428 ts_tablet_manager.cc:1434] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.051s	user 0.002s	sys 0.003s
I20260709 13:10:42.291767  2638 leader_election.cc:290] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.326761  2693 raft_consensus.cc:2804] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.328662  2693 raft_consensus.cc:697] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:42.330240  2693 consensus_queue.cc:237] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.326773  2428 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:42.345296  2538 consensus_queue.cc:237] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.347520  2431 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:42.348167  2431 ts_tablet_manager.cc:1403] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.007s
I20260709 13:10:42.354645  2534 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.356065  2053 catalog_manager.cc:5697] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.387836  2428 tablet_bootstrap.cc:654] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.402310  2534 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.375983  2641 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.410557  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:42.411334  2158 raft_consensus.cc:2393] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:42.412431  2641 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.413887  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:42.415401  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:42.416261  2233 raft_consensus.cc:2393] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
W20260709 13:10:42.417258  2124 leader_election.cc:343] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.422092  2126 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.444061  2691 raft_consensus.cc:2749] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.461140  2429 tablet_bootstrap.cc:654] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.464962  2431 raft_consensus.cc:359] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.465705  2430 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:42.465901  2431 raft_consensus.cc:385] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.466375  2431 raft_consensus.cc:740] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.467449  2431 consensus_queue.cc:260] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.468811  2430 ts_tablet_manager.cc:1403] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.266s	user 0.017s	sys 0.013s
I20260709 13:10:42.484050  2431 ts_tablet_manager.cc:1434] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.001s
I20260709 13:10:42.490240  2431 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:42.489913  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:42.508204  2644 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.521451  2644 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:42.524785  2199 leader_election.cc:343] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.525458  2199 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:42.531445  2534 raft_consensus.cc:2749] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.542618  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.526659  2644 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
W20260709 13:10:42.544137  2124 leader_election.cc:343] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.548310  2430 raft_consensus.cc:359] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.549021  2430 raft_consensus.cc:385] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.549284  2430 raft_consensus.cc:740] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.560004  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.560714  2233 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:42.564422  2428 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:42.568686  2428 ts_tablet_manager.cc:1403] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.242s	user 0.015s	sys 0.021s
I20260709 13:10:42.549866  2430 consensus_queue.cc:260] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.569393  2431 tablet_bootstrap.cc:654] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.574348  2430 ts_tablet_manager.cc:1434] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.001s
I20260709 13:10:42.575189  2430 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:42.578310  2588 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.578809  2588 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.580914  2588 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:42.576215  2641 consensus_queue.cc:1048] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:42.587919  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.589013  2233 raft_consensus.cc:2393] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:42.590266  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:42.591059  2126 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.593022  2691 raft_consensus.cc:2804] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.593401  2691 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.593745  2691 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.598245  2429 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:42.598961  2429 ts_tablet_manager.cc:1403] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.302s	user 0.014s	sys 0.012s
I20260709 13:10:42.604310  2346 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
W20260709 13:10:42.605784  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:42.601850  2428 raft_consensus.cc:359] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.606366  2428 raft_consensus.cc:385] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.606611  2428 raft_consensus.cc:740] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.607407  2509 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.607213  2428 consensus_queue.cc:260] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.609270  2428 ts_tablet_manager.cc:1434] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:10:42.610191  2428 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:42.616544  2428 tablet_bootstrap.cc:654] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.624423  2691 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.626430  2429 raft_consensus.cc:359] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.628108  2429 raft_consensus.cc:385] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.628489  2429 raft_consensus.cc:740] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.636050  2429 consensus_queue.cc:260] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.638309  2429 ts_tablet_manager.cc:1434] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:10:42.638406  2691 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:42.639632  2429 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:42.640142  2509 raft_consensus.cc:2749] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.642612  2641 consensus_queue.cc:1048] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.643234  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:42.645541  2429 tablet_bootstrap.cc:654] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:42.652384  2124 leader_election.cc:343] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.655550  2428 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:42.656131  2428 ts_tablet_manager.cc:1403] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.009s
I20260709 13:10:42.658258  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:42.658918  2233 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.658931  2428 raft_consensus.cc:359] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.659965  2428 raft_consensus.cc:385] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.661962  2431 tablet_bootstrap.cc:492] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:42.662563  2431 ts_tablet_manager.cc:1403] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.010s
I20260709 13:10:42.664966  2430 tablet_bootstrap.cc:654] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.664592  2055 catalog_manager.cc:5697] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.676141  2233 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:42.677266  2126 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:42.678602  2641 raft_consensus.cc:2804] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.669167  2431 raft_consensus.cc:359] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.679080  2431 raft_consensus.cc:385] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.679111  2641 raft_consensus.cc:697] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:42.679469  2431 raft_consensus.cc:740] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.680238  2641 consensus_queue.cc:237] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:42.681020  2431 consensus_queue.cc:260] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.683481  2056 catalog_manager.cc:5697] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.685917  2431 ts_tablet_manager.cc:1434] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:10:42.686915  2431 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:42.686225  2056 catalog_manager.cc:5697] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.660255  2428 raft_consensus.cc:740] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.690284  2770 raft_consensus.cc:493] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.702517  2428 consensus_queue.cc:260] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.702654  2770 raft_consensus.cc:515] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.692698  2309 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.706269  2770 leader_election.cc:290] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.706298  2430 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:42.706998  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:42.707690  2233 raft_consensus.cc:2468] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:42.707741  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:42.708480  2383 raft_consensus.cc:2468] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 0.
I20260709 13:10:42.708680  2428 ts_tablet_manager.cc:1434] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:10:42.708968  2430 ts_tablet_manager.cc:1403] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.134s	user 0.006s	sys 0.006s
I20260709 13:10:42.709514  2538 raft_consensus.cc:493] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.710028  2538 raft_consensus.cc:515] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.709645  2428 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:42.711617  2430 raft_consensus.cc:359] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.712821  2431 tablet_bootstrap.cc:654] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.702806  2056 catalog_manager.cc:5697] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.715979  2275 leader_election.cc:304] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:42.716738  2644 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.712299  2430 raft_consensus.cc:385] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.721268  2770 raft_consensus.cc:2804] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.720960  2430 raft_consensus.cc:740] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.721753  2770 raft_consensus.cc:493] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.722222  2770 raft_consensus.cc:3060] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.722150  2430 consensus_queue.cc:260] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.728394  2430 ts_tablet_manager.cc:1434] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 13:10:42.728772  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:42.729373  2430 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
W20260709 13:10:42.729699  2199 consensus_peers.cc:597] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.729941  2752 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:42.730436  2198 leader_election.cc:343] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.732293  2538 leader_election.cc:290] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:42.734592  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:42.735428  2159 raft_consensus.cc:2468] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:42.738168  2198 leader_election.cc:304] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:42.739120  2629 raft_consensus.cc:2804] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.739652  2629 raft_consensus.cc:493] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.740088  2629 raft_consensus.cc:3060] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.750232  2534 consensus_queue.cc:1048] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.753859  2430 tablet_bootstrap.cc:654] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.758383  2770 raft_consensus.cc:515] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.761570  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:42.762398  2235 raft_consensus.cc:3060] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.767964  2430 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:42.765592  2752 consensus_queue.cc:1048] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:42.768551  2430 ts_tablet_manager.cc:1403] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.006s
I20260709 13:10:42.768086  2629 raft_consensus.cc:515] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.782415  2235 raft_consensus.cc:2468] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:42.784013  2275 leader_election.cc:304] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:42.784920  2634 raft_consensus.cc:2804] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.785030  2629 leader_election.cc:290] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:42.785451  2634 raft_consensus.cc:697] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:42.785609  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:42.786331  2634 consensus_queue.cc:237] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:42.786922  2429 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:42.787434  2429 ts_tablet_manager.cc:1403] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.148s	user 0.005s	sys 0.016s
W20260709 13:10:42.788157  2198 leader_election.cc:343] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.790139  2058 catalog_manager.cc:5697] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.795555  2430 raft_consensus.cc:359] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.796399  2430 raft_consensus.cc:385] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.796316  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:42.797081  2158 raft_consensus.cc:3060] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.799901  2429 raft_consensus.cc:359] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.800881  2429 raft_consensus.cc:385] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.801218  2429 raft_consensus.cc:740] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.801441  2430 raft_consensus.cc:740] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.802258  2430 consensus_queue.cc:260] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.802084  2429 consensus_queue.cc:260] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:42.815346  2429 ts_tablet_manager.cc:1434] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:42.817239  2429 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:42.821098  2538 consensus_queue.cc:1048] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.838824  2644 consensus_queue.cc:1048] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.841435  2641 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.841946  2641 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:42.845458  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:42.847421  2509 consensus_queue.cc:1048] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:42.848891  2124 leader_election.cc:343] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.849503  2158 raft_consensus.cc:2468] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:42.853057  2198 leader_election.cc:304] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:42.855579  2430 ts_tablet_manager.cc:1434] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 13:10:42.870764  2770 leader_election.cc:290] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.877801  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1947b4022a46aab1955bb0dce5dd55" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:42.867200  2629 raft_consensus.cc:2804] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.872604  2762 consensus_queue.cc:1048] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:10:42.886786  2381 raft_consensus.cc:3060] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.886582  2641 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:42.917213  2428 tablet_bootstrap.cc:654] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.928467  2430 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:42.906571  2629 raft_consensus.cc:697] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:42.944267  2431 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:42.945086  2431 ts_tablet_manager.cc:1403] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.022s
I20260709 13:10:42.994117  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:43.018286  2379 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:43.020593  2629 consensus_queue.cc:237] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.041931  2430 tablet_bootstrap.cc:654] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:43.027302  2347 consensus_peers.cc:597] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:43.050468  2431 raft_consensus.cc:359] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.051524  2431 raft_consensus.cc:385] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.051887  2431 raft_consensus.cc:740] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.053112  2431 consensus_queue.cc:260] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:43.054848  2124 consensus_peers.cc:597] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:43.055943  2431 ts_tablet_manager.cc:1434] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 13:10:43.057312  2431 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:43.059034  2752 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.059746  2752 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.059438  2429 tablet_bootstrap.cc:654] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.063238  2752 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:43.079186  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 56332.5us
W20260709 13:10:43.097108  2785 log.cc:927] Time spent T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.223s	user 0.006s	sys 0.000s
I20260709 13:10:43.123697  2123 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:43.124818  2799 raft_consensus.cc:493] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.125387  2799 raft_consensus.cc:515] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.127449  2644 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.128077  2644 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.128500  2644 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:43.112739  2791 log.cc:927] Time spent T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:10:43.141546  2431 tablet_bootstrap.cc:654] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.153930  2058 catalog_manager.cc:5697] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 0 to 1, leader changed from <none> to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:43.206300  2792 log.cc:927] Time spent T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: Append to log took a long time: real 0.290s	user 0.002s	sys 0.001s
I20260709 13:10:43.207784  2799 leader_election.cc:290] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:43.214449  2428 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:43.215096  2428 ts_tablet_manager.cc:1403] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.506s	user 0.021s	sys 0.029s
I20260709 13:10:43.218592  2428 raft_consensus.cc:359] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.219472  2428 raft_consensus.cc:385] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.219835  2428 raft_consensus.cc:740] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.220678  2428 consensus_queue.cc:260] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.223893  2428 ts_tablet_manager.cc:1434] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.005s
I20260709 13:10:43.224211  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:43.225121  2428 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:43.245882  2644 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.248925  2381 raft_consensus.cc:2468] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:43.264580  2509 raft_consensus.cc:493] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.265259  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:43.266034  2644 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
W20260709 13:10:43.267226  2124 leader_election.cc:343] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.161087  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:43.232674  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:43.274818  2233 raft_consensus.cc:2468] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:43.265300  2509 raft_consensus.cc:515] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.316082  2631 raft_consensus.cc:493] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.327387  2631 raft_consensus.cc:515] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.350531  2428 tablet_bootstrap.cc:654] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.355029  2429 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:43.356884  2429 ts_tablet_manager.cc:1403] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.540s	user 0.024s	sys 0.011s
W20260709 13:10:43.349522  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 53169.2us
W20260709 13:10:43.362084  2199 leader_election.cc:343] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.369837  2430 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:43.370636  2430 ts_tablet_manager.cc:1403] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.442s	user 0.016s	sys 0.046s
W20260709 13:10:43.376695  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 72946.1us
I20260709 13:10:43.398167  2309 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.420445  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:43.421305  2377 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.422809  2431 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:43.423347  2431 ts_tablet_manager.cc:1403] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.366s	user 0.024s	sys 0.041s
I20260709 13:10:43.422973  2430 raft_consensus.cc:359] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.424444  2430 raft_consensus.cc:385] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.424665  2430 raft_consensus.cc:740] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.425143  2430 consensus_queue.cc:260] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.434926  2430 ts_tablet_manager.cc:1434] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:10:43.436364  2430 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:43.438071  2827 consensus_queue.cc:1048] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.441045  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:43.424690  2631 leader_election.cc:290] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.442943  2429 raft_consensus.cc:359] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.443710  2429 raft_consensus.cc:385] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.444065  2429 raft_consensus.cc:740] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.451067  2429 consensus_queue.cc:260] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.460413  2429 ts_tablet_manager.cc:1434] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
W20260709 13:10:43.467350  2124 consensus_peers.cc:597] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:43.480082  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:43.481041  2631 consensus_queue.cc:1048] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.472661  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:43.482826  2159 raft_consensus.cc:2393] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:43.484905  2429 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
W20260709 13:10:43.487143  2198 leader_election.cc:343] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.487871  2198 leader_election.cc:304] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:43.491891  2509 leader_election.cc:290] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.493315  2799 raft_consensus.cc:2749] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.495935  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:43.501060  2431 raft_consensus.cc:359] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.502233  2431 raft_consensus.cc:385] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.502581  2431 raft_consensus.cc:740] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.506899  2431 consensus_queue.cc:260] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.509897  2431 ts_tablet_manager.cc:1434] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:10:43.520998  2431 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:43.527336  2377 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
W20260709 13:10:43.531953  2123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 128418us
I20260709 13:10:43.553001  2431 tablet_bootstrap.cc:654] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.562633  2430 tablet_bootstrap.cc:654] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:43.564010  2123 leader_election.cc:343] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.546175  2346 leader_election.cc:304] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:43.570395  2428 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:43.570891  2428 ts_tablet_manager.cc:1403] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.346s	user 0.015s	sys 0.013s
I20260709 13:10:43.572201  2830 raft_consensus.cc:3060] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.574786  2126 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:43.577555  2644 raft_consensus.cc:2804] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.577965  2644 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.578292  2644 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.580053  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:43.584410  2429 tablet_bootstrap.cc:654] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.588304  2428 raft_consensus.cc:359] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.590018  2428 raft_consensus.cc:385] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.590554  2428 raft_consensus.cc:740] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.591531  2428 consensus_queue.cc:260] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.592424  2272 leader_election.cc:304] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:43.624806  2428 ts_tablet_manager.cc:1434] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:10:43.588234  2817 consensus_queue.cc:1048] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:43.635614  2812 raft_consensus.cc:2749] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.640581  2428 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:43.641868  2123 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:43.660126  2827 consensus_queue.cc:1048] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.661346  2752 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.661899  2752 raft_consensus.cc:697] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:43.662793  2752 consensus_queue.cc:237] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.665236  2831 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.665831  2831 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.678951  2831 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.701977  2641 raft_consensus.cc:493] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.708232  2641 raft_consensus.cc:515] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.717623  2431 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:43.718169  2431 ts_tablet_manager.cc:1403] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.197s	user 0.009s	sys 0.008s
I20260709 13:10:43.722795  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:43.736064  2429 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:43.736917  2429 ts_tablet_manager.cc:1403] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.252s	user 0.034s	sys 0.013s
I20260709 13:10:43.734922  2431 raft_consensus.cc:359] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.723209  2641 leader_election.cc:290] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:43.739830  2431 raft_consensus.cc:385] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.738461  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:43.728036  2830 raft_consensus.cc:2749] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.746035  2431 raft_consensus.cc:740] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.743367  2233 raft_consensus.cc:2468] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:43.751585  2431 consensus_queue.cc:260] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:43.751586  2349 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:43.786681  2430 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:43.787382  2430 ts_tablet_manager.cc:1403] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.351s	user 0.019s	sys 0.014s
I20260709 13:10:43.764273  2818 raft_consensus.cc:2804] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.792196  2431 ts_tablet_manager.cc:1434] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:10:43.797505  2431 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:43.785447  2817 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.765260  2644 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.795926  2818 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.821480  2818 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.821439  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:43.825592  2644 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.826407  2430 raft_consensus.cc:359] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.827160  2430 raft_consensus.cc:385] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.827443  2430 raft_consensus.cc:740] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.831210  2430 consensus_queue.cc:260] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.833364  2428 tablet_bootstrap.cc:654] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.836549  2430 ts_tablet_manager.cc:1434] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:10:43.837791  2430 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:43.834793  2158 raft_consensus.cc:2393] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:43.840834  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:43.850630  2375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
W20260709 13:10:43.853101  2123 leader_election.cc:343] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.827006  2817 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:43.861208  2430 tablet_bootstrap.cc:654] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.867477  2429 raft_consensus.cc:359] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.868297  2429 raft_consensus.cc:385] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.868597  2429 raft_consensus.cc:740] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.869284  2429 consensus_queue.cc:260] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.870358  2817 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.870852  2429 ts_tablet_manager.cc:1434] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.134s	user 0.004s	sys 0.000s
I20260709 13:10:43.880517  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:43.881313  2234 raft_consensus.cc:2393] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
W20260709 13:10:43.883147  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 66382.9us
I20260709 13:10:43.894400  2154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:43.895270  2154 raft_consensus.cc:2393] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:43.904989  2431 tablet_bootstrap.cc:654] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:43.908247  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:43.903316  2057 catalog_manager.cc:5697] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.921401  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:43.922060  2232 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.937660  2428 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:43.938228  2428 ts_tablet_manager.cc:1403] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.304s	user 0.018s	sys 0.003s
I20260709 13:10:43.944357  2799 consensus_queue.cc:1048] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.923355  2275 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
W20260709 13:10:43.951189  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 43516.4us
I20260709 13:10:43.951839  2634 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.923990  2818 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:43.966768  2124 leader_election.cc:343] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:43.973784  2430 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:43.973711  2124 leader_election.cc:304] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:43.974700  2641 raft_consensus.cc:2749] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.976996  2430 ts_tablet_manager.cc:1403] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.139s	user 0.035s	sys 0.018s
I20260709 13:10:43.979292  2378 raft_consensus.cc:2393] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:43.980091  2430 raft_consensus.cc:359] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.980799  2430 raft_consensus.cc:385] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.981050  2430 raft_consensus.cc:740] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.981673  2430 consensus_queue.cc:260] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.982595  2818 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:43.985951  2430 ts_tablet_manager.cc:1434] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:43.987169  2430 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:43.989282  2428 raft_consensus.cc:359] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.989996  2428 raft_consensus.cc:385] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.990257  2428 raft_consensus.cc:740] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.990835  2428 consensus_queue.cc:260] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:43.992208  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:43.992857  2849 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.993347  2849 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:43.994432  2634 raft_consensus.cc:2749] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.995323  2849 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:43.996508  2430 tablet_bootstrap.cc:654] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.997054  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:43.997800  2428 ts_tablet_manager.cc:1434] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:10:43.998811  2428 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
W20260709 13:10:44.000404  2199 leader_election.cc:343] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.008124  2534 consensus_queue.cc:1048] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:44.013585  2429 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.016501  2232 raft_consensus.cc:2468] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:44.017766  2126 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.018565  2644 raft_consensus.cc:2804] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.019011  2644 raft_consensus.cc:697] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:44.019999  2644 consensus_queue.cc:237] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.022324  2058 catalog_manager.cc:5697] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.029066  2429 tablet_bootstrap.cc:654] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.030961  2154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:44.031461  2303 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.041591  2346 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:44.027938  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.055975  2855 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.056573  2855 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.060179  2855 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:44.060452  2824 raft_consensus.cc:2749] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.061666  2431 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:44.062203  2431 ts_tablet_manager.cc:1403] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.006s
W20260709 13:10:44.064265  2198 leader_election.cc:343] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.064918  2198 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:44.065071  2431 raft_consensus.cc:359] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.065860  2431 raft_consensus.cc:385] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.066149  2431 raft_consensus.cc:740] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.066741  2431 consensus_queue.cc:260] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.067071  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.068056  2232 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:44.075282  2431 ts_tablet_manager.cc:1434] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:10:44.083372  2126 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.084861  2641 raft_consensus.cc:2804] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.085270  2641 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.085579  2641 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.090471  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.091930  2428 tablet_bootstrap.cc:654] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.114091  2850 raft_consensus.cc:2749] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.094964  2855 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:10:44.134089  2641 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:44.144752  2123 leader_election.cc:343] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.145937  2430 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:44.146508  2430 ts_tablet_manager.cc:1403] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.160s	user 0.027s	sys 0.018s
I20260709 13:10:44.156510  2430 raft_consensus.cc:359] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.157232  2430 raft_consensus.cc:385] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.157498  2430 raft_consensus.cc:740] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.162061  2429 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.162600  2429 ts_tablet_manager.cc:1403] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.149s	user 0.028s	sys 0.035s
W20260709 13:10:44.162417  2123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 51033.8us
I20260709 13:10:44.165401  2641 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:44.165871  2428 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:44.174355  2428 ts_tablet_manager.cc:1403] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.011s
I20260709 13:10:44.177454  2428 raft_consensus.cc:359] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.178190  2428 raft_consensus.cc:385] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.178509  2428 raft_consensus.cc:740] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.166417  2430 consensus_queue.cc:260] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.167119  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:44.183996  2232 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.179225  2428 consensus_queue.cc:260] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.168829  2817 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:44.169795  2429 raft_consensus.cc:359] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.170374  2818 raft_consensus.cc:493] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.187855  2428 ts_tablet_manager.cc:1434] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:10:44.188141  2818 raft_consensus.cc:515] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.187968  2817 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.191238  2818 leader_election.cc:290] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.192291  2429 raft_consensus.cc:385] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.192605  2429 raft_consensus.cc:740] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.193167  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.193357  2429 consensus_queue.cc:260] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:44.194855  2347 leader_election.cc:343] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.195940  2429 ts_tablet_manager.cc:1434] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:10:44.196728  2817 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.196974  2429 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.185990  2430 ts_tablet_manager.cc:1434] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:10:44.200820  2430 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:44.169723  2431 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:44.204275  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.207110  2800 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.207358  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.207743  2800 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.210160  2800 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.210402  2430 tablet_bootstrap.cc:654] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.211246  2300 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.215989  2272 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:44.217144  2429 tablet_bootstrap.cc:654] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.219810  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.220584  2302 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:44.222008  2199 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:44.222355  2634 raft_consensus.cc:2749] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:44.223450  2800 raft_consensus.cc:2804] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:44.223953  2800 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.226212  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.227025  2231 raft_consensus.cc:2468] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:44.228201  2349 leader_election.cc:304] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.228832  2800 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.229483  2428 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:44.236352  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.237087  2157 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:44.230345  2430 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:44.238587  2430 ts_tablet_manager.cc:1403] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.002s
I20260709 13:10:44.245013  2430 raft_consensus.cc:359] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.245749  2430 raft_consensus.cc:385] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.246035  2430 raft_consensus.cc:740] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.246683  2430 consensus_queue.cc:260] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.231002  2818 raft_consensus.cc:2804] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.252646  2818 raft_consensus.cc:493] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.253417  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:44.252907  2058 catalog_manager.cc:5697] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.252812  2430 ts_tablet_manager.cc:1434] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:44.254647  2691 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.255487  2430 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:44.255612  2232 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:44.256877  2126 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.257715  2818 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.260012  2691 raft_consensus.cc:2804] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.260582  2691 raft_consensus.cc:697] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:44.261413  2691 consensus_queue.cc:237] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.272471  2430 tablet_bootstrap.cc:654] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.274145  2429 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.274690  2429 ts_tablet_manager.cc:1403] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:10:44.280216  2429 raft_consensus.cc:359] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.281248  2429 raft_consensus.cc:385] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.281668  2429 raft_consensus.cc:740] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.282620  2429 consensus_queue.cc:260] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.284756  2429 ts_tablet_manager.cc:1434] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:10:44.285231  2800 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.286154  2429 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.290424  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:44.291150  2157 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.272189  2818 raft_consensus.cc:515] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.298939  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:44.245620  2428 tablet_bootstrap.cc:654] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.299621  2232 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.299782  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:44.301252  2347 leader_election.cc:343] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.299033  2157 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:44.303993  2431 tablet_bootstrap.cc:654] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.310380  2818 leader_election.cc:290] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.339897  2232 raft_consensus.cc:2468] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:44.341439  2429 tablet_bootstrap.cc:654] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.342804  2349 leader_election.cc:304] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
W20260709 13:10:44.345309  2123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 55016.9us
W20260709 13:10:44.345912  2123 leader_election.cc:343] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.345068  2641 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.350294  2641 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.350665  2198 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.361737  2793 raft_consensus.cc:2804] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.362440  2793 raft_consensus.cc:697] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:44.364104  2793 consensus_queue.cc:237] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.364355  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.365293  2232 raft_consensus.cc:2468] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:44.366617  2126 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.351507  2831 raft_consensus.cc:2804] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.368062  2831 raft_consensus.cc:697] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:44.368096  2855 raft_consensus.cc:2804] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.368710  2855 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.369207  2855 raft_consensus.cc:3060] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.368976  2831 consensus_queue.cc:237] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.360497  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:44.372753  2300 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.394800  2820 raft_consensus.cc:493] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.395607  2820 raft_consensus.cc:515] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.364351  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.419024  2820 leader_election.cc:290] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
W20260709 13:10:44.421165  2124 leader_election.cc:343] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.422124  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.423607  2124 leader_election.cc:343] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.426846  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.435810  2800 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.439308  2641 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
W20260709 13:10:44.444535  2126 leader_election.cc:343] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.450385  2057 catalog_manager.cc:5697] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 2, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.441972  2058 catalog_manager.cc:5697] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.453409  2126 leader_election.cc:304] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.455693  2691 raft_consensus.cc:2749] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.456303  2820 raft_consensus.cc:493] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.449225  2300 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:44.461870  2429 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.463058  2429 ts_tablet_manager.cc:1403] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.177s	user 0.033s	sys 0.049s
I20260709 13:10:44.470263  2430 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:44.470690  2430 ts_tablet_manager.cc:1403] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.215s	user 0.021s	sys 0.033s
I20260709 13:10:44.456051  2855 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.464282  2820 raft_consensus.cc:515] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.479061  2820 leader_election.cc:290] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:44.480091  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.481376  2855 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
W20260709 13:10:44.481531  2123 leader_election.cc:343] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.473703  2430 raft_consensus.cc:359] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.482056  2430 raft_consensus.cc:385] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.482355  2430 raft_consensus.cc:740] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.482424  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:44.483100  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.484661  2124 leader_election.cc:343] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:44.485419  2124 leader_election.cc:343] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.485821  2124 leader_election.cc:304] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:44.485661  2430 consensus_queue.cc:260] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.486553  2828 raft_consensus.cc:2749] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.486820  2431 tablet_bootstrap.cc:492] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:44.487304  2431 ts_tablet_manager.cc:1403] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.325s	user 0.010s	sys 0.009s
I20260709 13:10:44.487967  2430 ts_tablet_manager.cc:1434] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:10:44.488729  2430 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:44.489413  2431 raft_consensus.cc:359] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.490005  2431 raft_consensus.cc:385] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.490199  2431 raft_consensus.cc:740] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.490757  2431 consensus_queue.cc:260] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.493139  2429 raft_consensus.cc:359] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.493801  2429 raft_consensus.cc:385] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.494040  2429 raft_consensus.cc:740] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.494659  2429 consensus_queue.cc:260] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.496654  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:44.497300  2232 raft_consensus.cc:3060] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.498904  2430 tablet_bootstrap.cc:654] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.498474  2055 catalog_manager.cc:5697] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.499743  2428 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:44.500244  2428 ts_tablet_manager.cc:1403] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.011s
I20260709 13:10:44.496882  2429 ts_tablet_manager.cc:1434] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.004s
I20260709 13:10:44.502185  2429 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.505323  2232 raft_consensus.cc:2468] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
I20260709 13:10:44.506542  2126 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.507332  2691 raft_consensus.cc:2804] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.505537  2431 ts_tablet_manager.cc:1434] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:44.507794  2429 tablet_bootstrap.cc:654] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.508003  2691 raft_consensus.cc:697] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:44.508667  2431 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:44.513098  2691 consensus_queue.cc:237] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.517494  2428 raft_consensus.cc:359] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.518342  2428 raft_consensus.cc:385] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.518616  2428 raft_consensus.cc:740] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.519546  2430 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: No bootstrap required, opened a new log
I20260709 13:10:44.519361  2428 consensus_queue.cc:260] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.520053  2430 ts_tablet_manager.cc:1403] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.004s
I20260709 13:10:44.522842  2430 raft_consensus.cc:359] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.523499  2430 raft_consensus.cc:385] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.523782  2430 raft_consensus.cc:740] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.524505  2430 consensus_queue.cc:260] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.526683  2430 ts_tablet_manager.cc:1434] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:44.530925  2431 tablet_bootstrap.cc:654] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.530774  2828 consensus_queue.cc:1048] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.537403  2824 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.537981  2824 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.540750  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.541399  2231 raft_consensus.cc:2468] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:44.542677  2349 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:44.543816  2818 raft_consensus.cc:2804] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.544204  2818 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.544554  2818 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.559136  2824 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.560751  2428 ts_tablet_manager.cc:1434] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:10:44.563753  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.566018  2428 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
W20260709 13:10:44.567564  2347 leader_election.cc:343] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.571080  2429 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.571612  2429 ts_tablet_manager.cc:1403] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.028s
I20260709 13:10:44.574342  2429 raft_consensus.cc:359] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.575026  2429 raft_consensus.cc:385] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.575331  2429 raft_consensus.cc:740] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.576092  2429 consensus_queue.cc:260] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.577209  2428 tablet_bootstrap.cc:654] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.577986  2429 ts_tablet_manager.cc:1434] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:44.579597  2429 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.583007  2431 tablet_bootstrap.cc:492] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:44.583499  2431 ts_tablet_manager.cc:1403] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.005s
I20260709 13:10:44.586458  2431 raft_consensus.cc:359] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.587162  2431 raft_consensus.cc:385] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.587430  2431 raft_consensus.cc:740] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.588281  2431 consensus_queue.cc:260] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.570287  2818 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.595443  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:44.597201  2828 raft_consensus.cc:493] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.591852  2058 catalog_manager.cc:5697] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.597724  2828 raft_consensus.cc:515] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.602911  2429 tablet_bootstrap.cc:654] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.604388  2828 leader_election.cc:290] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:44.608826  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
W20260709 13:10:44.613059  2123 leader_election.cc:343] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.613231  2428 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:44.613188  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.613946  2428 ts_tablet_manager.cc:1403] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.003s
I20260709 13:10:44.614128  2431 ts_tablet_manager.cc:1434] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:44.596146  2231 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:44.615067  2124 leader_election.cc:343] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.615545  2124 leader_election.cc:304] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:44.616568  2691 raft_consensus.cc:2749] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.616767  2428 raft_consensus.cc:359] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.617484  2428 raft_consensus.cc:385] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.617756  2428 raft_consensus.cc:740] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.618691  2428 consensus_queue.cc:260] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.621061  2428 ts_tablet_manager.cc:1434] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:44.622205  2428 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: Bootstrap starting.
I20260709 13:10:44.624645  2429 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.625187  2429 ts_tablet_manager.cc:1403] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.002s
I20260709 13:10:44.626381  2431 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:44.627983  2429 raft_consensus.cc:359] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.628702  2429 raft_consensus.cc:385] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.628971  2429 raft_consensus.cc:740] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.632380  2428 tablet_bootstrap.cc:654] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.637090  2300 raft_consensus.cc:3060] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.639078  2691 consensus_queue.cc:1048] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:44.647955  2231 raft_consensus.cc:2468] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:44.640571  2804 raft_consensus.cc:493] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.645056  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:44.649557  2431 tablet_bootstrap.cc:654] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:44.650906  2347 leader_election.cc:343] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.651654  2804 raft_consensus.cc:515] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.654742  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.656203  2347 leader_election.cc:343] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.656906  2349 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.657467  2431 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:44.657809  2824 raft_consensus.cc:2804] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.657963  2431 ts_tablet_manager.cc:1403] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:10:44.658670  2824 raft_consensus.cc:697] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:44.659034  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.661202  2431 raft_consensus.cc:359] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.659749  2160 raft_consensus.cc:2468] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:44.657024  2804 leader_election.cc:290] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.645715  2818 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.664145  2429 consensus_queue.cc:260] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.659775  2824 consensus_queue.cc:237] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.666582  2429 ts_tablet_manager.cc:1434] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:10:44.667614  2429 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
I20260709 13:10:44.668680  2431 raft_consensus.cc:385] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.669075  2431 raft_consensus.cc:740] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.669611  2346 leader_election.cc:304] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.669962  2431 consensus_queue.cc:260] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.672113  2818 raft_consensus.cc:2804] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.672514  2818 raft_consensus.cc:493] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.672864  2818 raft_consensus.cc:3060] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.693675  2820 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.694243  2820 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.696342  2820 leader_election.cc:290] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:44.698766  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.699491  2231 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 0.
I20260709 13:10:44.700825  2057 catalog_manager.cc:5697] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.704177  2428 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: No bootstrap required, opened a new log
I20260709 13:10:44.725006  2428 ts_tablet_manager.cc:1403] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.008s
I20260709 13:10:44.727702  2431 ts_tablet_manager.cc:1434] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:10:44.706723  2818 raft_consensus.cc:515] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.706367  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.714538  2429 tablet_bootstrap.cc:654] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.728888  2428 raft_consensus.cc:359] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.702287  2126 leader_election.cc:304] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:44.733666  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:44.733695  2828 raft_consensus.cc:2804] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.735050  2828 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.735401  2828 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:44.736123  2347 leader_election.cc:343] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.737226  2431 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
W20260709 13:10:44.733819  2123 leader_election.cc:343] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.732035  2428 raft_consensus.cc:385] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.743530  2428 raft_consensus.cc:740] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.745580  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:44.746284  2160 raft_consensus.cc:3060] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.747762  2818 leader_election.cc:290] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.748057  2431 tablet_bootstrap.cc:654] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.748795  2428 consensus_queue.cc:260] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.751375  2793 raft_consensus.cc:493] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.751914  2793 raft_consensus.cc:515] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.754853  2793 leader_election.cc:290] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:44.756898  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.757668  2380 raft_consensus.cc:2468] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:44.757159  2429 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:44.759601  2429 ts_tablet_manager.cc:1403] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.000s
I20260709 13:10:44.758102  2160 raft_consensus.cc:2468] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:44.785444  2346 leader_election.cc:304] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:44.786510  2824 raft_consensus.cc:2804] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.786788  2429 raft_consensus.cc:359] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.787556  2429 raft_consensus.cc:385] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.787853  2429 raft_consensus.cc:740] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.788499  2429 consensus_queue.cc:260] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.759934  2895 raft_consensus.cc:493] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.790050  2895 raft_consensus.cc:515] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.790850  2824 raft_consensus.cc:697] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:44.764722  2818 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.792313  2895 leader_election.cc:290] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.791970  2824 consensus_queue.cc:237] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.792544  2818 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.794037  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.795239  2347 leader_election.cc:343] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.795931  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.796689  2231 raft_consensus.cc:2393] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:44.796808  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.772768  2817 raft_consensus.cc:493] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.797955  2818 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:44.798249  2346 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:44.798281  2817 raft_consensus.cc:515] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.808319  2429 ts_tablet_manager.cc:1434] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:10:44.801723  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:44.800483  2817 leader_election.cc:290] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:44.758920  2198 leader_election.cc:304] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:44.774062  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.810880  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 52042us
I20260709 13:10:44.778219  2831 consensus_queue.cc:1048] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:10:44.811889  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:44.812697  2231 raft_consensus.cc:2393] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:44.812983  2800 raft_consensus.cc:2804] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.813438  2800 raft_consensus.cc:493] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.813807  2800 raft_consensus.cc:3060] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.816448  2158 raft_consensus.cc:1275] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:44.817768  2431 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:44.818277  2431 ts_tablet_manager.cc:1403] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.014s
I20260709 13:10:44.821681  2431 raft_consensus.cc:359] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.822379  2431 raft_consensus.cc:385] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:44.822650  2431 raft_consensus.cc:740] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:44.823263  2431 consensus_queue.cc:260] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.825376  2300 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.826395  2431 ts_tablet_manager.cc:1434] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:44.827564  2431 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:44.830492  2275 leader_election.cc:304] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:44.833289  2831 raft_consensus.cc:493] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.833958  2831 raft_consensus.cc:515] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.838245  2817 raft_consensus.cc:2749] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:44.770344  2428 ts_tablet_manager.cc:1434] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:10:44.840533  2831 leader_election.cc:290] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.840999  2431 tablet_bootstrap.cc:654] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.768052  2828 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:44.841661  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.842476  2158 raft_consensus.cc:2468] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:44.843757  2828 leader_election.cc:290] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:44.844175  2346 leader_election.cc:304] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:44.844276  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:44.844758  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:44.844949  2160 raft_consensus.cc:2468] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 0.
I20260709 13:10:44.845541  2831 raft_consensus.cc:2804] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.845959  2831 raft_consensus.cc:493] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.846002  2346 leader_election.cc:304] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
W20260709 13:10:44.846313  2123 leader_election.cc:343] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.846458  2831 raft_consensus.cc:3060] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.846915  2900 raft_consensus.cc:2804] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.847354  2900 raft_consensus.cc:493] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.847723  2900 raft_consensus.cc:3060] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.810474  2429 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: Bootstrap starting.
W20260709 13:10:44.848887  2199 leader_election.cc:343] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.848457  2800 raft_consensus.cc:515] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:44.857753  2796 consensus_queue.cc:1048] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.799964  2818 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.841071  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:44.900000  2800 leader_election.cc:290] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:44.900611  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:44.905640  2347 leader_election.cc:343] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:44.906747  2199 leader_election.cc:343] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.921108  2429 tablet_bootstrap.cc:654] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:44.888748  2895 consensus_queue.cc:1048] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:10:44.894925  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:44.928417  2235 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.942047  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:44.935871  2850 raft_consensus.cc:493] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.942755  2380 raft_consensus.cc:3060] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.942998  2850 raft_consensus.cc:515] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:44.919354  2900 raft_consensus.cc:515] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:44.945187  2850 leader_election.cc:290] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:44.946063  2900 leader_election.cc:290] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:44.947275  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:44.947929  2157 raft_consensus.cc:3060] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.950661  2302 raft_consensus.cc:1275] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:44.951797  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:44.960310  2199 leader_election.cc:343] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:44.961299  2793 consensus_queue.cc:1048] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:44.989147  2123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 80348.2us
I20260709 13:10:44.992738  2833 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.994292  2302 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.996253  2058 catalog_manager.cc:5697] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.965716  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfb558f11c34f60a165af99c68f3702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:45.003902  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:45.004622  2160 raft_consensus.cc:2468] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:45.007059  2198 leader_election.cc:304] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:45.013465  2157 raft_consensus.cc:2468] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:45.014204  2818 raft_consensus.cc:2749] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.016193  2346 leader_election.cc:304] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:44.990110  2831 raft_consensus.cc:515] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.023998  2431 tablet_bootstrap.cc:492] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.024688  2431 ts_tablet_manager.cc:1403] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.052s
W20260709 13:10:45.028666  2106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:45.010473  2800 raft_consensus.cc:2804] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:45.025070  2818 raft_consensus.cc:2804] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:45.041782  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 65598us
I20260709 13:10:45.034528  2800 raft_consensus.cc:493] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.045186  2800 raft_consensus.cc:3060] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.052170  2380 raft_consensus.cc:2468] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:45.054641  2429 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: No bootstrap required, opened a new log
I20260709 13:10:45.055177  2429 ts_tablet_manager.cc:1403] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.006s
I20260709 13:10:45.057472  2198 leader_election.cc:304] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:45.062085  2429 raft_consensus.cc:359] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:45.062841  2429 raft_consensus.cc:385] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.063149  2429 raft_consensus.cc:740] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.044889  2818 raft_consensus.cc:697] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
W20260709 13:10:45.065122  2347 leader_election.cc:343] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.066246  2644 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.064016  2429 consensus_queue.cc:260] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:45.076179  2429 ts_tablet_manager.cc:1434] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:10:45.067026  2793 raft_consensus.cc:2804] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:45.095515  2905 log.cc:927] Time spent T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:45.087934  2235 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 1.
W20260709 13:10:45.126211  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 56143.1us
I20260709 13:10:45.138087  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
W20260709 13:10:45.172739  2124 consensus_peers.cc:597] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.147574  2793 raft_consensus.cc:697] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
W20260709 13:10:45.170194  2901 log.cc:927] Time spent T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:10:45.112251  2818 consensus_queue.cc:237] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.179237  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:45.189321  2155 raft_consensus.cc:3060] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.161533  2831 leader_election.cc:290] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:45.170513  2817 raft_consensus.cc:493] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.189522  2913 log.cc:927] Time spent T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:10:45.196950  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 47680.5us
I20260709 13:10:45.204761  2431 raft_consensus.cc:359] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
W20260709 13:10:45.198822  2347 leader_election.cc:343] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.205507  2431 raft_consensus.cc:385] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.205905  2431 raft_consensus.cc:740] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
W20260709 13:10:45.213908  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 76557.4us
I20260709 13:10:45.214968  2126 leader_election.cc:304] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:45.220650  2833 raft_consensus.cc:2804] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.221247  2833 raft_consensus.cc:697] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:45.222100  2833 consensus_queue.cc:237] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:45.228351  2155 raft_consensus.cc:2468] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:45.219480  2793 consensus_queue.cc:237] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:45.204013  2817 raft_consensus.cc:515] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.237138  2346 leader_election.cc:304] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:45.253419  2431 consensus_queue.cc:260] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
W20260709 13:10:45.261304  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 54161.4us
I20260709 13:10:45.250837  2824 raft_consensus.cc:2804] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.235908  2800 raft_consensus.cc:515] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.259763  2910 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:45.280568  2824 raft_consensus.cc:697] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
W20260709 13:10:45.311887  2918 log.cc:927] Time spent T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.005s
I20260709 13:10:45.293548  2910 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.314350  2817 leader_election.cc:290] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
W20260709 13:10:45.322844  2199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 45780.5us
I20260709 13:10:45.338025  2817 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.346155  2300 raft_consensus.cc:3060] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.345988  2817 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
W20260709 13:10:45.360286  2347 consensus_peers.cc:597] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.355865  2800 leader_election.cc:290] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
W20260709 13:10:45.367250  2920 log.cc:927] Time spent T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:10:45.368115  2923 log.cc:927] Time spent T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:45.344120  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:45.340395  2824 consensus_queue.cc:237] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:45.383349  2124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 106338us
I20260709 13:10:45.414881  2910 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:45.422752  2817 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:45.434036  2820 consensus_queue.cc:1048] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.437027  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1726a2fe283241b4a1435cf7f96f4bf7" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:45.438234  2155 raft_consensus.cc:2393] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:45.448447  2057 catalog_manager.cc:5697] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:45.466290  2349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 44560.4us
I20260709 13:10:45.455057  2272 leader_election.cc:304] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:45.471226  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:45.481113  2922 consensus_queue.cc:1048] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.485934  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:45.489194  2922 consensus_queue.cc:1048] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.493790  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:45.494720  2157 raft_consensus.cc:3060] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.499213  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:45.512866  2431 ts_tablet_manager.cc:1434] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.488s	user 0.023s	sys 0.045s
I20260709 13:10:45.519011  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:45.523577  2231 raft_consensus.cc:2393] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 1: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:45.499176  2921 raft_consensus.cc:2749] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.533910  2431 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:45.535162  2831 consensus_queue.cc:1048] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.536968  2157 raft_consensus.cc:2468] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:45.527969  2895 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.538069  2895 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:45.540274  2895 leader_election.cc:290] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:45.541177  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:45.541311  2154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:45.542047  2235 raft_consensus.cc:2393] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 1: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:45.543358  2349 leader_election.cc:304] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:45.553668  2922 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.567915  2198 leader_election.cc:304] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:45.578083  2230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:45.579847  2199 leader_election.cc:343] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:45.592085  2431 tablet_bootstrap.cc:654] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.594676  2919 raft_consensus.cc:2804] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.595271  2919 raft_consensus.cc:697] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:45.596261  2919 consensus_queue.cc:237] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.602679  2922 raft_consensus.cc:2749] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.632606  2275 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:45.634145  2921 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.634557  2275 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:45.636806  2934 raft_consensus.cc:2749] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:45.658280  2921 raft_consensus.cc:2749] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:45.658772  2895 consensus_queue.cc:1048] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.662585  2055 catalog_manager.cc:5697] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.671314  2431 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.671959  2431 ts_tablet_manager.cc:1403] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.016s
I20260709 13:10:45.672989  2691 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:45.674505  2431 raft_consensus.cc:359] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.675210  2431 raft_consensus.cc:385] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.675469  2431 raft_consensus.cc:740] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.676148  2431 consensus_queue.cc:260] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.678534  2431 ts_tablet_manager.cc:1434] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:45.679370  2431 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:45.688733  2431 tablet_bootstrap.cc:654] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.692978  2306 raft_consensus.cc:3060] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.700340  2057 catalog_manager.cc:5697] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.702064  2927 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.707424  2895 consensus_queue.cc:1048] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:45.707472  2056 catalog_manager.cc:5697] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.717677  2057 catalog_manager.cc:5697] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 1 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.784368  2919 consensus_queue.cc:1048] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:45.791254  2347 consensus_peers.cc:597] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:45.797523  2199 consensus_peers.cc:597] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.805476  2431 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.806087  2431 ts_tablet_manager.cc:1403] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.055s
I20260709 13:10:45.808699  2431 raft_consensus.cc:359] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.809368  2431 raft_consensus.cc:385] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.809679  2431 raft_consensus.cc:740] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.810348  2431 consensus_queue.cc:260] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.816391  2431 ts_tablet_manager.cc:1434] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:45.817485  2431 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:45.823315  2431 tablet_bootstrap.cc:654] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.836150  2431 tablet_bootstrap.cc:492] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.836643  2431 ts_tablet_manager.cc:1403] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:10:45.839315  2431 raft_consensus.cc:359] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:45.840013  2431 raft_consensus.cc:385] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.840269  2431 raft_consensus.cc:740] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.840929  2431 consensus_queue.cc:260] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:45.842949  2431 ts_tablet_manager.cc:1434] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:45.843935  2431 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:45.850235  2431 tablet_bootstrap.cc:654] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.856220  2431 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.857175  2431 ts_tablet_manager.cc:1403] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:10:45.859755  2431 raft_consensus.cc:359] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.860416  2431 raft_consensus.cc:385] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.860718  2431 raft_consensus.cc:740] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.861320  2431 consensus_queue.cc:260] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.863304  2431 ts_tablet_manager.cc:1434] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:10:45.864310  2431 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: Bootstrap starting.
I20260709 13:10:45.869395  2431 tablet_bootstrap.cc:654] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.881206  2431 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: No bootstrap required, opened a new log
I20260709 13:10:45.881712  2431 ts_tablet_manager.cc:1403] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:10:45.884388  2431 raft_consensus.cc:359] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.885088  2431 raft_consensus.cc:385] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.885362  2431 raft_consensus.cc:740] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.885977  2431 consensus_queue.cc:260] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:45.887989  2431 ts_tablet_manager.cc:1434] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:45.898370 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
W20260709 13:10:45.918931  2198 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:10:45.921409  2921 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.922330  2921 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:45.926033  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:45.925763  2198 consensus_peers.cc:597] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.927342  2921 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:45.933799  2272 leader_election.cc:336] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:45.934217  2272 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:45.934854  2921 raft_consensus.cc:2749] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:45.949312  2346 consensus_peers.cc:597] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:45.951926  2346 consensus_peers.cc:597] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.952083 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.953117 25507 tablet_replica.cc:333] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.953984 25507 raft_consensus.cc:2243] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.954914 25507 raft_consensus.cc:2272] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.957777 25507 tablet_replica.cc:333] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.958390 25507 raft_consensus.cc:2243] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.958797 25507 raft_consensus.cc:2272] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.960510 25507 tablet_replica.cc:333] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.961071 25507 raft_consensus.cc:2243] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.961483 25507 raft_consensus.cc:2272] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.963563 25507 tablet_replica.cc:333] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.964236 25507 raft_consensus.cc:2243] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.964988 25507 raft_consensus.cc:2272] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.966953 25507 tablet_replica.cc:333] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.967658 25507 raft_consensus.cc:2243] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.968628 25507 raft_consensus.cc:2272] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:45.970052  2198 consensus_peers.cc:597] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.970829 25507 tablet_replica.cc:333] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.971527 25507 raft_consensus.cc:2243] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.972007 25507 raft_consensus.cc:2272] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.974040 25507 tablet_replica.cc:333] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.974757 25507 raft_consensus.cc:2243] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.975211 25507 raft_consensus.cc:2272] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.977845 25507 tablet_replica.cc:333] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.978400 25507 raft_consensus.cc:2243] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.979077 25507 raft_consensus.cc:2272] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.980873 25507 tablet_replica.cc:333] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.981653 25507 raft_consensus.cc:2243] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.982152 25507 raft_consensus.cc:2272] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.984470 25507 tablet_replica.cc:333] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
W20260709 13:10:45.985044  2272 consensus_peers.cc:597] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.985620 25507 raft_consensus.cc:2243] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.986423 25507 raft_consensus.cc:2272] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.988235 25507 tablet_replica.cc:333] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.988791 25507 raft_consensus.cc:2243] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.989204 25507 raft_consensus.cc:2272] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.990943 25507 tablet_replica.cc:333] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.991497 25507 raft_consensus.cc:2243] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.992214 25507 raft_consensus.cc:2272] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.993911 25507 tablet_replica.cc:333] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.994467 25507 raft_consensus.cc:2243] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.995177 25507 raft_consensus.cc:2272] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.996978 25507 tablet_replica.cc:333] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:45.997540 25507 raft_consensus.cc:2243] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.998265 25507 raft_consensus.cc:2272] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.999914 25507 tablet_replica.cc:333] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.000458 25507 raft_consensus.cc:2243] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.001183 25507 raft_consensus.cc:2272] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.002985 25507 tablet_replica.cc:333] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.003530 25507 raft_consensus.cc:2243] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.003957 25507 raft_consensus.cc:2272] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.005649 25507 tablet_replica.cc:333] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.006194 25507 raft_consensus.cc:2243] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.006608 25507 raft_consensus.cc:2272] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.008496 25507 tablet_replica.cc:333] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.009197 25507 raft_consensus.cc:2243] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.010149 25507 raft_consensus.cc:2272] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.012671 25507 tablet_replica.cc:333] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.013428 25507 raft_consensus.cc:2243] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.013862 25507 raft_consensus.cc:2272] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.016048 25507 tablet_replica.cc:333] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.016829 25507 raft_consensus.cc:2243] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.017798 25507 raft_consensus.cc:2272] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.020318 25507 tablet_replica.cc:333] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.021195 25507 raft_consensus.cc:2243] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.022001 25507 raft_consensus.cc:2272] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.024550 25507 tablet_replica.cc:333] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.025419 25507 raft_consensus.cc:2243] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.025929 25507 raft_consensus.cc:2272] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.028414 25507 tablet_replica.cc:333] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.031876 25507 raft_consensus.cc:2243] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.032968 25507 raft_consensus.cc:2272] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.034905 25507 tablet_replica.cc:333] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.035589 25507 raft_consensus.cc:2243] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.036095 25507 raft_consensus.cc:2272] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.037938 25507 tablet_replica.cc:333] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.038692 25507 raft_consensus.cc:2243] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.039187 25507 raft_consensus.cc:2272] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.041603 25507 tablet_replica.cc:333] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.042366 25507 raft_consensus.cc:2243] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.043732 25507 raft_consensus.cc:2272] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.046072 25507 tablet_replica.cc:333] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
W20260709 13:10:46.046569  2198 consensus_peers.cc:597] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.046903 25507 raft_consensus.cc:2243] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.047839 25507 raft_consensus.cc:2272] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.050276 25507 tablet_replica.cc:333] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.051061 25507 raft_consensus.cc:2243] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.051556 25507 raft_consensus.cc:2272] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:46.053544  2346 consensus_peers.cc:597] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.053884 25507 tablet_replica.cc:333] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.054790 25507 raft_consensus.cc:2243] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.055613 25507 raft_consensus.cc:2272] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.057590 25507 tablet_replica.cc:333] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.058066 25507 raft_consensus.cc:2243] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.058578 25507 raft_consensus.cc:2272] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.060549 25507 tablet_replica.cc:333] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.061132 25507 raft_consensus.cc:2243] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.061544 25507 raft_consensus.cc:2272] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.063508 25507 tablet_replica.cc:333] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.064100 25507 raft_consensus.cc:2243] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.064536 25507 raft_consensus.cc:2272] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.066311 25507 tablet_replica.cc:333] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.066835 25507 raft_consensus.cc:2243] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.067235 25507 raft_consensus.cc:2272] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.069103 25507 tablet_replica.cc:333] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.069811 25507 raft_consensus.cc:2243] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.070726 25507 raft_consensus.cc:2272] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.073030 25507 tablet_replica.cc:333] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.073740 25507 raft_consensus.cc:2243] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.074234 25507 raft_consensus.cc:2272] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:46.074735  2198 consensus_peers.cc:597] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.076344 25507 tablet_replica.cc:333] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.077198 25507 raft_consensus.cc:2243] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.077714 25507 raft_consensus.cc:2272] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.080497 25507 tablet_replica.cc:333] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.081218 25507 raft_consensus.cc:2243] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:46.081290  2346 consensus_peers.cc:597] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.082144 25507 raft_consensus.cc:2272] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.084108 25507 tablet_replica.cc:333] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.084805 25507 raft_consensus.cc:2243] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.085270 25507 raft_consensus.cc:2272] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.087585 25507 tablet_replica.cc:333] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.088413 25507 raft_consensus.cc:2243] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.088907 25507 raft_consensus.cc:2272] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.091374 25507 tablet_replica.cc:333] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.092065 25507 raft_consensus.cc:2243] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.092566 25507 raft_consensus.cc:2272] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.094848 25507 tablet_replica.cc:333] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.095502 25507 raft_consensus.cc:2243] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.095999 25507 raft_consensus.cc:2272] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.099253  2921 raft_consensus.cc:493] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.099464 25507 tablet_replica.cc:333] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.099864  2921 raft_consensus.cc:515] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.100315 25507 raft_consensus.cc:2243] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.101946 25507 raft_consensus.cc:2272] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.103619  2921 leader_election.cc:290] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:46.103849  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:46.105043 25507 tablet_replica.cc:333] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.105813 25507 raft_consensus.cc:2243] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:46.105958  2346 consensus_peers.cc:597] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.106338 25507 raft_consensus.cc:2272] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.108734 25507 tablet_replica.cc:333] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
W20260709 13:10:46.109026  2198 consensus_peers.cc:597] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.109455 25507 raft_consensus.cc:2243] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.110033 25507 raft_consensus.cc:2272] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:46.111047  2272 leader_election.cc:336] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:46.111470  2272 leader_election.cc:304] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:46.112272  2921 raft_consensus.cc:2749] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.112546 25507 tablet_replica.cc:333] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: stopping tablet replica
I20260709 13:10:46.113216 25507 raft_consensus.cc:2243] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:46.113502  2307 raft_consensus.cc:3060] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.114110 25507 raft_consensus.cc:2272] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.120240  2919 consensus_queue.cc:1048] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:46.127259  2198 consensus_peers.cc:597] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.135443  2198 consensus_peers.cc:597] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.137301  2198 consensus_peers.cc:597] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.156036  2198 consensus_peers.cc:597] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.164088  2272 consensus_peers.cc:597] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.174090  2346 consensus_peers.cc:597] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.186422  2307 raft_consensus.cc:3060] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.187530  2921 raft_consensus.cc:493] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.188145  2921 raft_consensus.cc:515] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:46.190321  2921 leader_election.cc:290] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:46.190945  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:46.194581  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:46.197507  2272 leader_election.cc:304] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:46.198338  2921 raft_consensus.cc:2749] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:46.199971  2272 consensus_peers.cc:597] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.201570 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
W20260709 13:10:46.231117  2346 consensus_peers.cc:597] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.271364 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:46.276211  2198 consensus_peers.cc:597] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.286633  2963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:46.289371  2962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:46.292004  2346 consensus_peers.cc:597] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.294447  2965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:46.294875 25507 server_base.cc:1061] running on GCE node
I20260709 13:10:46.297766 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:46.298055 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:46.298259 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602646298243 us; error 0 us; skew 500 ppm
I20260709 13:10:46.298827 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:46.301615 25507 webserver.cc:533] Webserver started at http://127.24.232.193:38703/ using document root <none> and password file <none>
I20260709 13:10:46.302095 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:46.302299 25507 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:46.309830 25507 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:10:46.311815  2198 consensus_peers.cc:597] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.322568  2970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:46.323760 25507 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:46.324100 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "e8b718068a784b5cabecfb16859665a4"
format_stamp: "Formatted at 2026-07-09 13:10:34 on dist-test-slave-sdg5"
I20260709 13:10:46.324466 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:46.344954 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:46.346514 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:46.349954 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:46.351855  2307 raft_consensus.cc:3060] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:46.360474  2198 consensus_peers.cc:597] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.362761  2977 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:10:46.403635  2198 consensus_peers.cc:597] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.445667  2198 consensus_peers.cc:597] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.613473 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:10:46.613842 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.259s	user 0.008s	sys 0.008s
I20260709 13:10:46.614166 25507 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:10:46.619549  2977 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.636706  2977 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.637683  2977 tablet_bootstrap.cc:492] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.638309  2977 ts_tablet_manager.cc:1403] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:10:46.640851  2977 raft_consensus.cc:359] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.641535  2977 raft_consensus.cc:740] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.642268  2977 consensus_queue.cc:260] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.664673  2977 ts_tablet_manager.cc:1434] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.016s
I20260709 13:10:46.665766  2977 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.697221  2977 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.698220  2977 tablet_bootstrap.cc:492] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.698889  2977 ts_tablet_manager.cc:1403] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.013s
I20260709 13:10:46.701520  2977 raft_consensus.cc:359] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.702292  2977 raft_consensus.cc:740] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.702986  2977 consensus_queue.cc:260] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.704687  2977 ts_tablet_manager.cc:1434] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:10:46.705462  2977 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.721937  2977 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.722868  2977 tablet_bootstrap.cc:492] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.723492  2977 ts_tablet_manager.cc:1403] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:10:46.726042  2977 raft_consensus.cc:359] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.726708  2977 raft_consensus.cc:740] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.727372  2977 consensus_queue.cc:260] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.729275  2977 ts_tablet_manager.cc:1434] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.730028  2977 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.743304  2977 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.744256  2977 tablet_bootstrap.cc:492] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.744887  2977 ts_tablet_manager.cc:1403] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:10:46.747049  2977 raft_consensus.cc:359] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.747741  2977 raft_consensus.cc:740] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.748366  2977 consensus_queue.cc:260] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.750222  2977 ts_tablet_manager.cc:1434] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.750972  2977 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.768129  2977 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.769042  2977 tablet_bootstrap.cc:492] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.769673  2977 ts_tablet_manager.cc:1403] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:10:46.771931  2977 raft_consensus.cc:359] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.772579  2977 raft_consensus.cc:740] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.773180  2977 consensus_queue.cc:260] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.774937  2977 ts_tablet_manager.cc:1434] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.775699  2977 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.789764  2977 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.790661  2977 tablet_bootstrap.cc:492] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.791289  2977 ts_tablet_manager.cc:1403] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:10:46.793700  2977 raft_consensus.cc:359] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.794339  2977 raft_consensus.cc:740] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.795010  2977 consensus_queue.cc:260] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.796906  2977 ts_tablet_manager.cc:1434] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:10:46.797657  2977 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.812413  2977 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.813563  2977 tablet_bootstrap.cc:492] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.815320  2977 ts_tablet_manager.cc:1403] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:10:46.817420  2977 raft_consensus.cc:359] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.817943  2977 raft_consensus.cc:740] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.818691  2977 consensus_queue.cc:260] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.820829  2977 ts_tablet_manager.cc:1434] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.821928  2977 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.836428  2977 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.837183  2977 tablet_bootstrap.cc:492] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.837793  2977 ts_tablet_manager.cc:1403] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:10:46.840049  2977 raft_consensus.cc:359] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.840528  2977 raft_consensus.cc:740] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.841140  2977 consensus_queue.cc:260] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.842552  2977 ts_tablet_manager.cc:1434] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:10:46.843539  2977 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.857285  2977 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.858206  2977 tablet_bootstrap.cc:492] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.858819  2977 ts_tablet_manager.cc:1403] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:10:46.861100  2977 raft_consensus.cc:359] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.861747  2977 raft_consensus.cc:740] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.862413  2977 consensus_queue.cc:260] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.864411  2977 ts_tablet_manager.cc:1434] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:10:46.865180  2977 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.872167 25507 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:10:46.872575 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.258s	user 0.245s	sys 0.004s
I20260709 13:10:46.878515  2977 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.879431  2977 tablet_bootstrap.cc:492] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.880219  2977 ts_tablet_manager.cc:1403] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:10:46.882871  2977 raft_consensus.cc:359] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.883543  2977 raft_consensus.cc:740] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.884249  2977 consensus_queue.cc:260] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:46.886149  2977 ts_tablet_manager.cc:1434] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:46.886937  2977 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.899617  2977 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.900449  2977 tablet_bootstrap.cc:492] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.900993  2977 ts_tablet_manager.cc:1403] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:10:46.903754  2977 raft_consensus.cc:359] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.904414  2977 raft_consensus.cc:740] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.905186  2977 consensus_queue.cc:260] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:46.907693  2977 ts_tablet_manager.cc:1434] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:46.908483  2977 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:46.991472  2977 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.992327  2977 tablet_bootstrap.cc:492] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:46.992863  2977 ts_tablet_manager.cc:1403] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.037s
I20260709 13:10:46.994589  2977 raft_consensus.cc:359] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.995146  2977 raft_consensus.cc:740] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.995896  2977 consensus_queue.cc:260] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:46.997696  2977 ts_tablet_manager.cc:1434] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:10:46.998476  2977 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.007540 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:34297
I20260709 13:10:47.007650  3049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:34297 every 8 connection(s)
I20260709 13:10:47.011973  2977 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.014082  2977 tablet_bootstrap.cc:492] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.014744  2977 ts_tablet_manager.cc:1403] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:10:47.017712  2977 raft_consensus.cc:359] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.018518  2977 raft_consensus.cc:740] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.019387  2977 consensus_queue.cc:260] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.021164  2922 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.022054  2977 ts_tablet_manager.cc:1434] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:47.021838  2922 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.023254  2977 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.026561  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.033671  2922 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.037348  2921 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.037774  2979 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.038038  2921 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.038406  2979 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.040335  2979 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.040422  2921 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.041854  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.044174  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.050777  2977 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.051587  2977 tablet_bootstrap.cc:492] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.052315  2977 ts_tablet_manager.cc:1403] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:10:47.054553  3051 heartbeater.cc:344] Connected to a master server at 127.24.232.254:39959
I20260709 13:10:47.054996  3051 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:47.054774  2977 raft_consensus.cc:359] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.055500  2977 raft_consensus.cc:740] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.055939  3051 heartbeater.cc:507] Master 127.24.232.254:39959 requested a full tablet report, sending...
I20260709 13:10:47.056241  2977 consensus_queue.cc:260] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.056792  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.058557  2977 ts_tablet_manager.cc:1434] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:47.059382  2977 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
W20260709 13:10:47.060824  2346 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.061283  2346 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.063239  2895 raft_consensus.cc:2749] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.067453  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.068234  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:47.070179  2272 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.070602  2272 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:47.071657  2921 raft_consensus.cc:2749] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:47.072796  2272 leader_election.cc:343] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.073254  2272 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.073951  2921 raft_consensus.cc:2749] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.079306  2057 ts_manager.cc:194] Re-registered known tserver with Master: e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.080607  2977 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.081573  2977 tablet_bootstrap.cc:492] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.082237  2977 ts_tablet_manager.cc:1403] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:10:47.084759  2977 raft_consensus.cc:359] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.085400  2977 raft_consensus.cc:740] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.086233  2977 consensus_queue.cc:260] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.088617  2977 ts_tablet_manager.cc:1434] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:47.089404  2977 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.090214  2922 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.090755  2922 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.091835  3022 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.092396  3022 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.094625  3022 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.101825  2921 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.102509  2921 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.104687  2921 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.105211  2921 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.105697  2921 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.109637  3022 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.110760  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.110926  2977 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.111475  2379 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.110867  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.112115  2977 tablet_bootstrap.cc:492] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.112874  2977 ts_tablet_manager.cc:1403] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:10:47.110189  3022 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.113580  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.113850  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.115170  2198 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.107611  2921 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.115262  2977 raft_consensus.cc:359] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.115353  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.116055  2919 raft_consensus.cc:2804] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.111116  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.117542  2919 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.118072  2919 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:47.122404  2272 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.122875  2272 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
W20260709 13:10:47.124928  2272 leader_election.cc:343] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.125370  2272 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:47.117116  2977 raft_consensus.cc:740] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.127127  2977 consensus_queue.cc:260] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.127915  2817 raft_consensus.cc:2749] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.128626  2817 raft_consensus.cc:2749] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.132701  2977 ts_tablet_manager.cc:1434] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:10:47.136248  2977 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.137346  2922 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.138320  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.139233  3020 raft_consensus.cc:2468] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.140625  2346 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.145355  2800 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.145944  2800 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.149216  2800 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.149891  2922 raft_consensus.cc:2804] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.150533  2922 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.150947  2922 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.151893  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:47.152733  2198 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.149966  2800 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.156299  2916 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.156890  2916 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.158452  3022 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.159049  2916 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.156337  2800 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.162283  2800 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.163265  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.163585  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.163937  2307 raft_consensus.cc:2468] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 0.
I20260709 13:10:47.164325  2308 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.165036  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.166342  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.171414  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.172346  3023 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.174904  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.175619  2382 raft_consensus.cc:2468] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.175957  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.179963  2922 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.182904  2199 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.183732  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.184090  2800 raft_consensus.cc:2804] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.184679  2800 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.184626  3023 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.185257  2800 raft_consensus.cc:3060] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.195861  2916 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.196689  2916 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.199790  2916 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.202862  2922 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.203533  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:47.204303  2199 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.205585  3023 raft_consensus.cc:2468] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.205869  3063 raft_consensus.cc:2804] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.206285  3063 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.206635  3063 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.206883  2346 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:47.210901  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.211656  3020 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.215045  3063 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.219826  3063 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.223619  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.223963  2922 raft_consensus.cc:2804] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.224414  2307 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.225392  2922 raft_consensus.cc:697] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:47.226392  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.226560  2922 consensus_queue.cc:237] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.227119  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.228442  3020 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.230151  2057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47212
I20260709 13:10:47.231598  2307 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.232141  3063 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.232724  3063 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.234706  3063 leader_election.cc:290] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.237504  3051 heartbeater.cc:499] Master 127.24.232.254:39959 was elected leader, sending a full tablet report...
I20260709 13:10:47.181341  2919 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.245561  2919 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.250034  2800 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.254247  3063 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.254987  3063 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.256717  2057 catalog_manager.cc:5697] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.257678  3063 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.258368  3063 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.258929  3063 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.261500  3063 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
W20260709 13:10:47.264252  2198 leader_election.cc:343] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.265769  2198 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:47.267719  2916 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:47.267904  2198 leader_election.cc:343] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.268200  2916 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.268818  2916 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.276028  2199 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.277601  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.278065  3063 raft_consensus.cc:2804] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.278297  2307 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.278807  3063 raft_consensus.cc:697] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.279799  3063 consensus_queue.cc:237] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.280378  2899 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.280948  2899 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.281970  2916 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.283883  2899 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.284147  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.284637  2899 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.284767  2199 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.285138  2899 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:47.286175  2346 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.287317  2899 leader_election.cc:290] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.288410  2899 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.289017  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.289070  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.289958  2232 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
W20260709 13:10:47.291245  2346 leader_election.cc:343] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.288983  2899 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.296181  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:47.298487  2346 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.299302  2899 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.306902  3062 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.308730  3022 raft_consensus.cc:2804] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.309212  3022 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.309608  3022 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.310612  2800 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.313248  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.269867  2198 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:47.313987  2307 raft_consensus.cc:2468] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
W20260709 13:10:47.314390  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 44606.5us
I20260709 13:10:47.315521  2977 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.316648  2977 tablet_bootstrap.cc:492] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.316841  2919 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.317348  2919 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.317739  2919 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.317817  2977 ts_tablet_manager.cc:1403] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.184s	user 0.044s	sys 0.043s
I20260709 13:10:47.307473  3062 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.320842  2977 raft_consensus.cc:359] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.321337  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.321606  2977 raft_consensus.cc:740] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.322041  2307 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.322552  2977 consensus_queue.cc:260] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.324828  2977 ts_tablet_manager.cc:1434] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:47.325170  2349 leader_election.cc:304] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.326085  2977 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.326296  2899 raft_consensus.cc:2804] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.326947  2899 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.327359  2899 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.325834  2919 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.330936  2347 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.332150  2922 raft_consensus.cc:2804] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.332540  2922 raft_consensus.cc:493] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.332911  2922 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.335307  2899 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.338099  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.338722  3024 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.342190  2922 raft_consensus.cc:515] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.345399  2347 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.345988  3024 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.346616  3061 raft_consensus.cc:2804] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.347055  3061 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.347196  2346 leader_election.cc:304] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.347481  3061 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.349649  2895 raft_consensus.cc:2804] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.351646  2895 raft_consensus.cc:697] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:47.352591  2895 consensus_queue.cc:237] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.353291  2977 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.354857  2977 tablet_bootstrap.cc:492] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.355700  2977 ts_tablet_manager.cc:1403] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.000s
I20260709 13:10:47.357211  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.357797  2307 raft_consensus.cc:3060] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.359516  2977 raft_consensus.cc:359] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.360646  2977 raft_consensus.cc:740] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.317770  2916 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.361809  2977 consensus_queue.cc:260] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.365175  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.366083  2916 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.366819  2916 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.372270  3062 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.373840  2977 ts_tablet_manager.cc:1434] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:47.375160  2977 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
W20260709 13:10:47.380128  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 63713us
I20260709 13:10:47.380947  2198 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.382647  3074 raft_consensus.cc:2804] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.383052  3074 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.383447  3074 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.384822  2307 raft_consensus.cc:2468] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.386770  3022 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.388827  3022 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.390983  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.391355  2922 leader_election.cc:290] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.391875  3023 raft_consensus.cc:2393] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:47.392601  3061 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.394551  2899 leader_election.cc:290] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.395816  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:47.396581  2232 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.399607  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.398079  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.401711  3024 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.403435  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.403484  2977 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.404182  3020 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.404740  2977 tablet_bootstrap.cc:492] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.405229  2817 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.405674  2977 ts_tablet_manager.cc:1403] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 13:10:47.405727  2817 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.406579  2916 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:47.397080  3074 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.408169  2817 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.409602  2922 raft_consensus.cc:493] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.409869  3074 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.410125  2922 raft_consensus.cc:515] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.411391  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.411630  2977 raft_consensus.cc:359] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.412266  2922 leader_election.cc:290] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.330950  2919 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.412565  2977 raft_consensus.cc:740] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.410322  3076 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.413856  2977 consensus_queue.cc:260] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.414319  3076 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.416114  2977 ts_tablet_manager.cc:1434] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:47.417800  3061 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.418305  3076 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.476579  2921 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.478776  2921 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.492050  2800 raft_consensus.cc:493] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.493319  2800 raft_consensus.cc:515] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.416992  2977 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.499883  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.500463  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:47.501678  2381 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.502465  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.502681  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:47.503716  2379 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.505250  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.505698  2921 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.499989  2817 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.507076  2817 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.507428  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.509671  2057 catalog_manager.cc:5697] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.511162  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.512032  2817 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.512698  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.503866  2380 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.518666  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.522055  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.521977  2376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:47.523391  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.524434  2377 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:47.526072  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ae74c702234728abca428ef7868d6a" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.526616  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.527037  2307 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.527602  3018 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.530212  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.530829  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.531198  3025 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.531827  2300 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 1.
I20260709 13:10:47.535405  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:47.536652  2378 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.537652  2381 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.542088  2899 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.542810  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.542937  2899 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.544087  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.544111  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.545138  2302 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.545571  3023 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.546234  2899 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.546537  2346 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.548055  3061 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.548914  2895 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.549829  2922 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.549809  2895 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.550789  2922 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.552287  2979 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.553187  2979 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.553984  2306 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.555277  2800 leader_election.cc:290] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.555467  2921 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.556340  2921 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.548976  3061 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.560339  2979 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.559360  2921 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.562505  3061 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.563021  2895 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.553978  2922 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.564838  3076 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.565409  3076 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.565935  3076 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.566203  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:47.580226  2346 leader_election.cc:343] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.593699  2346 leader_election.cc:343] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.593724  2232 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
W20260709 13:10:47.594887  2346 leader_election.cc:343] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.591060  2307 raft_consensus.cc:2468] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.598819  2346 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.603515  3076 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.606184  3076 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.606899  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.607779  2056 catalog_manager.cc:5697] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.611064  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.616058  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.615829  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.617584  2306 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.615535  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.628610  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.629818  3020 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.630141  3024 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.631281  2899 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.632107  2899 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.635763  2302 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
W20260709 13:10:47.629812  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 78601.3us
I20260709 13:10:47.623706  3076 raft_consensus.cc:2804] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.637588  2378 raft_consensus.cc:2468] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
W20260709 13:10:47.647634  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 114976us
W20260709 13:10:47.648878  2346 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.649919  2346 leader_election.cc:343] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.638266  3076 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
W20260709 13:10:47.652232  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 65726.5us
I20260709 13:10:47.652859  2380 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
W20260709 13:10:47.653657  2346 leader_election.cc:343] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.653836  3076 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.665843  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.676323  2380 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
W20260709 13:10:47.661592  2199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 128417us
I20260709 13:10:47.678710  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.679688  2382 raft_consensus.cc:2393] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:47.681713  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.682924  3018 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
W20260709 13:10:47.666990  2198 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.688257  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.688725  2272 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.689170  2378 raft_consensus.cc:2468] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:47.689862  2979 raft_consensus.cc:2804] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.690327  2979 raft_consensus.cc:493] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.690976  2979 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.699026  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.703038  3063 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.667183  3084 raft_consensus.cc:493] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.703919  3063 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.704566  3084 raft_consensus.cc:515] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.706660  3063 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.707242  3084 leader_election.cc:290] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
W20260709 13:10:47.707830  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 47932.3us
I20260709 13:10:47.708643  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.710464  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.712833  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.743397  2234 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.667912  2899 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.719837  2272 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.719940  3020 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.717118  2979 raft_consensus.cc:515] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.752527  2979 leader_election.cc:290] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.726259  3023 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.753612  3014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.753979  2817 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.754575  2817 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.755062  2817 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.740944  3076 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.745872  2232 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.746136  2231 raft_consensus.cc:2393] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:47.746484  2235 raft_consensus.cc:1275] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.729125  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.773414  2349 leader_election.cc:304] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.773965  3017 raft_consensus.cc:2393] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:47.727298  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.728127  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.775306  2349 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.749320  2272 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.732769  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:47.776319  2234 raft_consensus.cc:3060] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.776527  3019 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:47.763098  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:47.777681  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.778509  2306 raft_consensus.cc:2393] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:47.778769  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.779484  2307 raft_consensus.cc:2468] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 1.
I20260709 13:10:47.777681  2229 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 1.
I20260709 13:10:47.780520  2979 raft_consensus.cc:2804] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.780764  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:47.781052  2979 raft_consensus.cc:493] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.781292  3062 raft_consensus.cc:2804] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.781437  2308 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.781749  3062 raft_consensus.cc:493] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.782267  3062 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.783064  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.784219  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:47.781461  2979 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.787642  2234 raft_consensus.cc:1275] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.791960  3077 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.795303  3076 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.796142  2347 leader_election.cc:304] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.797713  2347 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.799201  2347 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.800050  2899 raft_consensus.cc:2804] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.800616  2899 raft_consensus.cc:697] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:47.801980  2899 consensus_queue.cc:237] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.772573  2977 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.806972  2977 tablet_bootstrap.cc:492] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:47.797968  3076 raft_consensus.cc:2804] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.807812  2977 ts_tablet_manager.cc:1403] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.391s	user 0.025s	sys 0.001s
I20260709 13:10:47.808851  2198 leader_election.cc:304] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:47.809221  3076 raft_consensus.cc:697] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:47.810452  2198 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.810386  3076 consensus_queue.cc:237] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.731940  3025 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
I20260709 13:10:47.813208  2347 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.814687  2922 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.815474  3078 raft_consensus.cc:2804] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.815958  3078 raft_consensus.cc:493] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.813074  2979 raft_consensus.cc:515] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.816326  3078 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.816901  2303 raft_consensus.cc:2393] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:47.818253  3062 raft_consensus.cc:515] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.812680  3085 raft_consensus.cc:2749] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.812553  3084 raft_consensus.cc:2804] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.822372  3084 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.822798  3084 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.824738  2895 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:47.825341  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:47.825979  2234 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.832803  2977 raft_consensus.cc:359] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.833307  2308 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.833546  2922 raft_consensus.cc:2749] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.833714  2977 raft_consensus.cc:740] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.835026  2199 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.843324  3085 raft_consensus.cc:2804] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:47.844023  2272 leader_election.cc:343] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.843883  2895 consensus_queue.cc:1048] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:47.844046  3085 raft_consensus.cc:697] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.845391  2272 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:47.845556  3085 consensus_queue.cc:237] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:47.846711  2272 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.847342  2272 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.843271  2977 consensus_queue.cc:260] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.841903  2979 leader_election.cc:290] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.842126  2198 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.848767  3062 leader_election.cc:290] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:47.852000  2916 raft_consensus.cc:2804] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.835428  2234 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:47.850828  2921 raft_consensus.cc:2749] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.852975  2198 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.852617  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:47.860412  2199 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.858264  2349 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.861475  2346 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.863570  2231 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.865062  2916 raft_consensus.cc:697] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.866544  2916 consensus_queue.cc:237] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.865015  2800 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.868170  2800 raft_consensus.cc:697] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.869201  2800 consensus_queue.cc:237] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.872124  2198 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.873014  3063 raft_consensus.cc:2804] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.874090  3022 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.874358  2346 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.874531  3022 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.874982  3022 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.865015  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:47.876408  2380 raft_consensus.cc:2393] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
W20260709 13:10:47.873775  2198 leader_election.cc:343] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.881428  3063 raft_consensus.cc:697] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.882501  3063 consensus_queue.cc:237] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.882961  3062 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.875869  2347 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:47.883492  3062 raft_consensus.cc:493] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:47.887650  3084 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:47.889082  3019 raft_consensus.cc:1275] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.845868  3078 raft_consensus.cc:515] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.864007  2899 raft_consensus.cc:2804] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.849611  2817 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:47.886381  2895 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.889772  3061 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.891630  3062 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:47.903101  2198 leader_election.cc:343] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.901803  2199 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:47.907979  2977 ts_tablet_manager.cc:1434] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.001s
I20260709 13:10:47.908962  2817 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:47.909307  2977 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:47.909837  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfdf679af35482aae92603bd8daea67" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.911212  2306 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:47.911422  2231 raft_consensus.cc:2468] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
W20260709 13:10:47.912262  2198 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.912835  2349 leader_election.cc:304] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:47.896549  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
W20260709 13:10:47.913640  2198 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.913969  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.919942  3018 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.930107  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.931017  3077 raft_consensus.cc:2749] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.927891  2919 raft_consensus.cc:2804] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.932060  3077 raft_consensus.cc:2804] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.932188  2919 raft_consensus.cc:697] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:47.932611  3077 raft_consensus.cc:697] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
W20260709 13:10:47.933211  2198 leader_election.cc:343] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.933384  2919 consensus_queue.cc:237] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:47.933571  3077 consensus_queue.cc:237] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:47.934623  2272 leader_election.cc:343] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.935503  2272 leader_election.cc:343] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.932083  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:47.936362  3019 raft_consensus.cc:3060] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:47.938022  2198 leader_election.cc:343] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.953490  2198 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:47.969226  3022 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:47.979262  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 65197us
W20260709 13:10:47.999730  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 46354.8us
W20260709 13:10:48.000452  2198 leader_election.cc:343] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.008992  3078 leader_election.cc:290] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:48.011061  3061 raft_consensus.cc:2749] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:48.007334  2349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 94583.3us
I20260709 13:10:48.015970  2275 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:48.017699  2817 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:48.018196  2817 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:10:48.018674  2817 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.006255  2899 raft_consensus.cc:697] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:47.999554  3022 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:48.029940  2899 consensus_queue.cc:237] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:48.031298  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:48.012663  3083 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.013940  2895 raft_consensus.cc:697] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:48.044109  3084 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:48.045059  3083 raft_consensus.cc:697] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:48.046916  3083 consensus_queue.cc:237] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:48.050662  3062 raft_consensus.cc:515] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:48.035506  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:48.066249  3018 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:48.071188  2302 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.075014  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:48.075984  3024 raft_consensus.cc:2393] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:48.077239  2817 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:48.099982  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:48.100477  2302 raft_consensus.cc:2468] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:48.101392  3017 raft_consensus.cc:2393] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
I20260709 13:10:48.102622  2308 raft_consensus.cc:2393] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 030f4f0790ed4737bfc5a454f29d1e67 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:48.107581  3019 raft_consensus.cc:2468] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:48.094830  2895 consensus_queue.cc:237] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:48.119921  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:48.130756  2380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180bf6c8966b4ff5893bcb6546af5b36" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:48.131595  3062 leader_election.cc:290] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:48.138595  2380 raft_consensus.cc:2468] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:48.141716  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:48.142756  2381 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 2: Already voted for candidate fd4fb5266da747deb5bece4024d936a7 in this term.
W20260709 13:10:48.158057  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 55295.4us
I20260709 13:10:48.159219  2198 leader_election.cc:304] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:48.159735  2347 leader_election.cc:304] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:48.165100  2919 raft_consensus.cc:2749] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:48.166744  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:48.167690  2302 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:48.167773  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d380792024fadb561b39a0e80f7e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:48.175428  3014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:48.176154  2899 raft_consensus.cc:2804] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.176769  2899 raft_consensus.cc:697] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Leader. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:48.177709  2899 consensus_queue.cc:237] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:48.178920  2272 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:48.179953  3015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:48.180631  2979 raft_consensus.cc:2804] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.182453  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081d30467784ede9c3e7fb12625e0f1" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:48.188329  2272 leader_election.cc:304] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:48.195017  2979 raft_consensus.cc:697] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:48.209970  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:48.210994  2231 raft_consensus.cc:2393] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 2: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:48.187471  2382 raft_consensus.cc:2468] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:48.215996  3017 raft_consensus.cc:1275] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.217236  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4827539b954a14b8ce1a0ca348a353" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:48.218272  3025 raft_consensus.cc:2393] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 2: Already voted for candidate d815906ba3ba41ef8887f7e5b261553f in this term.
I20260709 13:10:48.219125  2921 raft_consensus.cc:2804] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.219844  2921 raft_consensus.cc:697] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:48.220785  2921 consensus_queue.cc:237] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:48.223455  3098 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:48.222129  2346 leader_election.cc:343] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.225638  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:48.226243  2381 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:48.234606  2346 leader_election.cc:343] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.239228  2346 leader_election.cc:304] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:48.238305  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:48.248153  3077 raft_consensus.cc:2749] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:48.253602  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704c2648933e451e9a0ab0fcbdcc5d98" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:48.201553  2979 consensus_queue.cc:237] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:48.285121  3111 log.cc:927] Time spent T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:48.302131  3017 raft_consensus.cc:1275] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.332177  2381 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 2.
W20260709 13:10:48.341869  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 153600us
I20260709 13:10:48.347622  2272 leader_election.cc:304] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:48.349225  3117 raft_consensus.cc:2804] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:48.360057  2272 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:48.360543  2272 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:48.361159  2300 raft_consensus.cc:1275] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:48.361460  2272 consensus_peers.cc:597] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:48.364507  2979 raft_consensus.cc:2749] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:48.377076  3117 raft_consensus.cc:697] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:48.378593  3117 consensus_queue.cc:237] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:48.395788  2308 raft_consensus.cc:1275] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.397375  2899 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.405817  2306 raft_consensus.cc:1275] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.408854  3062 consensus_queue.cc:1048] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.419869  2055 catalog_manager.cc:5697] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.431257  2817 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:48.442389  2895 consensus_queue.cc:1048] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.443935  3025 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:48.450186  2346 consensus_peers.cc:597] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.457343  3025 raft_consensus.cc:1275] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.458832  2895 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.471737  2977 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:48.472545  2977 tablet_bootstrap.cc:492] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:48.473160  2977 ts_tablet_manager.cc:1403] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.564s	user 0.023s	sys 0.020s
I20260709 13:10:48.476979  2977 raft_consensus.cc:359] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:48.478297  2977 raft_consensus.cc:740] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.822352  3116 consensus_queue.cc:1048] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.479367  2977 consensus_queue.cc:260] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.174197  2977 ts_tablet_manager.cc:1434] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.701s	user 0.007s	sys 0.013s
W20260709 13:10:49.174510  2977 ts_tablet_manager.cc:1467] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4: Tablet startup took 701ms
I20260709 13:10:49.175530  2977 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:49.201169  2981 raft_consensus.cc:493] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.202147  2977 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.201824  2981 raft_consensus.cc:515] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.205329  2981 leader_election.cc:290] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.205972  2981 raft_consensus.cc:493] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:49.206578  2981 raft_consensus.cc:515] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:49.212399  3136 raft_consensus.cc:493] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.213094  3136 raft_consensus.cc:515] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.214417  2977 tablet_bootstrap.cc:492] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:49.215363  2977 ts_tablet_manager.cc:1403] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.011s
I20260709 13:10:49.215582  3136 leader_election.cc:290] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.217252  2981 leader_election.cc:290] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:49.217828  2981 raft_consensus.cc:493] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.218354  2981 raft_consensus.cc:515] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.225066  2229 raft_consensus.cc:1275] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.225948  3076 raft_consensus.cc:493] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.226737  2231 raft_consensus.cc:1275] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.226523  3076 raft_consensus.cc:515] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.228600  3076 leader_election.cc:290] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.230837  3076 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.231455  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.232151  3102 consensus_queue.cc:1048] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.245163  2303 raft_consensus.cc:1275] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.254756  2381 raft_consensus.cc:1275] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.256043  2378 raft_consensus.cc:1275] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.267745  3102 raft_consensus.cc:493] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.268415  3102 raft_consensus.cc:515] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.271008  3102 leader_election.cc:290] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.273106  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.274701  3063 consensus_queue.cc:1048] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.277209  3139 raft_consensus.cc:493] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.278295  3139 raft_consensus.cc:515] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.281966  3139 leader_election.cc:290] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.283504  3102 raft_consensus.cc:493] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.284178  2057 catalog_manager.cc:5697] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.290299  3096 raft_consensus.cc:493] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.308111  2981 leader_election.cc:290] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.308086  3096 raft_consensus.cc:515] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:49.299933  2921 consensus_queue.cc:1048] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.305078  3136 consensus_queue.cc:1048] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.305941  3102 raft_consensus.cc:515] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:49.306448  2057 catalog_manager.cc:5697] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.315850  3137 raft_consensus.cc:493] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.316499  3137 raft_consensus.cc:515] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:49.316114  2057 catalog_manager.cc:5697] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.316944  3096 leader_election.cc:290] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.317727  2057 catalog_manager.cc:5697] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.318629  3137 leader_election.cc:290] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.319154  2977 raft_consensus.cc:359] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.319932  2977 raft_consensus.cc:740] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.320875  2977 consensus_queue.cc:260] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.321475  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.323069  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.324784  3061 raft_consensus.cc:493] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.325465  3061 raft_consensus.cc:515] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:49.327083  3102 leader_election.cc:290] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.327292  3137 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.327808  3137 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.328022  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cf437aef6b4035aec14b3974a896ae" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.329923  3137 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.330408  3061 leader_election.cc:290] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.319381  2057 catalog_manager.cc:5697] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.335404  3017 raft_consensus.cc:1275] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.338660  3014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8e58e88e0d4361b02e63a537424cfc" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.323097  2977 ts_tablet_manager.cc:1434] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.102s	user 0.005s	sys 0.000s
I20260709 13:10:49.341818  2922 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.348179  3076 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.379007  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.379488  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.380604  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.409184  2977 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:49.409993  2307 raft_consensus.cc:1275] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.409026  3018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34120 (request call id 40) took 1105 ms. Trace:
I20260709 13:10:49.419359  3018 rpcz_store.cc:276] 0709 13:10:48.301501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.301694 (+   193us) service_pool.cc:224] Handling call
0709 13:10:48.302078 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.302486 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.302525 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.253414 (+950889us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b2c00046e88. stack: 00007f40f0171343 00007f40f0171240 00007f40efb001d4 00007f40f983e304 00007f40f983e299 00007f40f1b89a11 00007f40f1b99372 00007f40f32cba01 00007f40f329043a 00007f40f328f83e 00007f40f8254419 00007f40f17cbbd4 00007f40f17cbb62 00007f40f17cba91 00007f40f17cba0c 00007f40f17cacc2
0709 13:10:49.266917 (+ 13503us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.289053 (+ 22136us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:49.290406 (+  1353us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.343928 (+ 53522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.348368 (+  4440us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.349170 (+   802us) raft_consensus.cc:1685] finished
0709 13:10:49.358184 (+  9014us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.407109 (+ 48925us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23778,"prepare.queue_time_us":843,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":19172,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":1054,"spinlock_wait_cycles":76727552,"thread_start_us":73596,"threads_started":3,"wal-append.queue_time_us":14761}
I20260709 13:10:49.407579  2922 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.434094  2922 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.466040  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b477970d0584d3db6ce2eccbfc45617" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.411296  3076 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.468067  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.474416  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37f7d5b1467469b8122fa8393d571c6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.476279  3150 raft_consensus.cc:493] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d815906ba3ba41ef8887f7e5b261553f)
I20260709 13:10:49.476907  3150 raft_consensus.cc:515] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:49.479089  3150 leader_election.cc:290] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:49.480257  2922 raft_consensus.cc:493] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.482611  2922 raft_consensus.cc:515] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.482815  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c83b7c75f4271b2a7814b1cc83f25" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:49.484282  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 1.27727e+06us
I20260709 13:10:49.484905  2922 leader_election.cc:290] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:49.487854  2256 debug-util.cc:398] Leaking SignalData structure 0x7b0800142ec0 after lost signal to thread 25510
W20260709 13:10:49.489073  2256 debug-util.cc:398] Leaking SignalData structure 0x7b0800197440 after lost signal to thread 2092
I20260709 13:10:49.462390  3014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
W20260709 13:10:49.490379  2198 leader_election.cc:343] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.496927  3025 raft_consensus.cc:1275] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.498196  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.494815  2198 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4
W20260709 13:10:49.502326  2198 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.506348  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d9240adb241b7a06f6b87f810a07d" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.501202  3083 raft_consensus.cc:2749] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.522065  2380 raft_consensus.cc:1275] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:49.524868  2256 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1320 after lost signal to thread 2260
I20260709 13:10:49.526178  2379 raft_consensus.cc:1275] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.530377  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.531942  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.527060  3071 consensus_queue.cc:1048] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:10:49.535840  3025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.536827  3025 raft_consensus.cc:2410] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:10:49.545639  2346 consensus_peers.cc:597] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:49.548653  2346 consensus_peers.cc:597] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.549341  2346 consensus_peers.cc:597] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.551752  2346 leader_election.cc:343] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.552109  2346 leader_election.cc:304] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
W20260709 13:10:49.553297  2346 consensus_peers.cc:597] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:49.560057  2346 leader_election.cc:343] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.560628  2346 leader_election.cc:304] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:49.561685  3101 raft_consensus.cc:2749] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.563658  3090 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.566835  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204b768587944178ca101e068d964e2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.553989  2922 raft_consensus.cc:2749] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.595093  3076 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.598767  3150 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.599359  3150 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:49.600863  3019 raft_consensus.cc:1275] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.601418  3150 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:49.601989  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.602954  2899 consensus_queue.cc:1048] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.603799  3139 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.604290  3139 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.606307  2921 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:49.606463  2981 raft_consensus.cc:493] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.606920  2921 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:49.607112  2981 raft_consensus.cc:515] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.599376  2347 leader_election.cc:304] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:49.613224  2347 leader_election.cc:304] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:49.614617  2347 leader_election.cc:304] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
W20260709 13:10:49.615069  2346 leader_election.cc:343] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.615535  2346 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:49.616422  3078 raft_consensus.cc:2749] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.616705  3077 raft_consensus.cc:2749] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.619809  3137 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.622025  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.625593  2347 leader_election.cc:304] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:49.628537  2921 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:49.628870  3078 raft_consensus.cc:2749] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.624876  3101 raft_consensus.cc:2749] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.601959  3150 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.632134  3150 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.633106  2981 leader_election.cc:290] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.648554  2272 leader_election.cc:304] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:49.657971  2198 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:49.658831  3022 raft_consensus.cc:2749] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.637173  2379 raft_consensus.cc:1275] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.635464  2230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.652128  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.654870  3017 raft_consensus.cc:3060] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.651427  2376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.639739  3102 raft_consensus.cc:2749] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.636104  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
W20260709 13:10:49.657279  2346 leader_election.cc:343] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.606307  3139 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.660398  2198 leader_election.cc:304] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:49.638653  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.634653  3150 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.667470  2346 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:49.667896  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.670367  2198 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
W20260709 13:10:49.675786  2346 leader_election.cc:343] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:49.666018  2272 consensus_peers.cc:597] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.672523  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.676425  3137 raft_consensus.cc:2749] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.683111  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.688055  3024 raft_consensus.cc:1275] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.689188  2308 raft_consensus.cc:1275] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer fd4fb5266da747deb5bece4024d936a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.691574  2053 catalog_manager.cc:5697] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.709712  2977 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.709147  2053 catalog_manager.cc:5697] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.710669  2977 tablet_bootstrap.cc:492] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:49.711382  2977 ts_tablet_manager.cc:1403] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.354s	user 0.016s	sys 0.006s
I20260709 13:10:49.696153  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.710758  2053 catalog_manager.cc:5697] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.682235  2346 leader_election.cc:304] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
W20260709 13:10:49.714964  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 44719.4us
I20260709 13:10:49.719918  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbd1c2f69bb4a878a64daf5789d9019" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.721786  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.723999  2053 catalog_manager.cc:5697] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:49.725402  2346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 49663.2us
W20260709 13:10:49.726810  2346 consensus_peers.cc:597] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:49.745748  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9981aab8ad0c4366b6fb8bd99b57e6e6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.704238  3134 raft_consensus.cc:2749] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.736558  2053 catalog_manager.cc:5697] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.749398  2053 catalog_manager.cc:5697] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.742544  3101 raft_consensus.cc:2749] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.742741  2916 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:10:49.754213  2272 consensus_peers.cc:597] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:49.745059  3076 raft_consensus.cc:493] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
W20260709 13:10:49.757576  2272 consensus_peers.cc:597] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.750379  2921 raft_consensus.cc:493] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:49.771309  2977 raft_consensus.cc:359] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.772116  2977 raft_consensus.cc:740] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.768232  2979 raft_consensus.cc:2749] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.775071  2378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.753001  3085 consensus_queue.cc:1048] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:10:49.784118  2977 consensus_queue.cc:260] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.789750  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d3ef1464da4fef82b6b02de793694c" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.790541  3113 raft_consensus.cc:2804] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.791186  3113 raft_consensus.cc:697] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:49.792121  3113 consensus_queue.cc:237] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.799873  2977 ts_tablet_manager.cc:1434] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:10:49.801102  3017 raft_consensus.cc:1275] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:49.803208  3163 log.cc:927] Time spent T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:49.806110  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 62385us
I20260709 13:10:49.768896  3076 raft_consensus.cc:515] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.783272  2921 raft_consensus.cc:515] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:49.808831  3076 leader_election.cc:290] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.808969  2921 leader_election.cc:290] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:49.809839  2972 leader_election.cc:304] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
W20260709 13:10:49.810170  2198 consensus_peers.cc:597] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.810892  2198 consensus_peers.cc:597] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.811124  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.765805  3172 consensus_queue.cc:1048] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:10:49.806473  3150 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:49.873745  3115 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:10:49.874289  2256 debug-util.cc:398] Leaking SignalData structure 0x7b0800207060 after lost signal to thread 2408
W20260709 13:10:49.875958  2256 debug-util.cc:398] Leaking SignalData structure 0x7b0800231fa0 after lost signal to thread 3049
W20260709 13:10:49.876277  2256 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7840 after lost signal to thread 3051
I20260709 13:10:49.884873  3150 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.888511  3150 leader_election.cc:290] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:49.889076  3150 raft_consensus.cc:493] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:49.889616  3150 raft_consensus.cc:515] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:49.893181  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.845032  3139 raft_consensus.cc:2749] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.894505  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.901643  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f14baaa48c49a7af6015e316412405" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
W20260709 13:10:49.901916  2972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 95929.5us
I20260709 13:10:49.903335  2977 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:49.903535  3174 consensus_queue.cc:1048] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.904031  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:49.904706  2305 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:49.911922  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.916177  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.916456  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:49.917032  2381 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:49.919214  2971 leader_election.cc:304] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
W20260709 13:10:49.920130  2198 consensus_peers.cc:597] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.907332  3150 leader_election.cc:290] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:49.926190  3139 raft_consensus.cc:2749] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:49.940992  2198 consensus_peers.cc:597] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:49.959440  3150 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.960354  3150 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:49.960842  3172 consensus_queue.cc:1048] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.964918  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:49.967348  3150 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:49.971036  2346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:34297, user_credentials={real_user=slave}} blocked reactor thread for 166064us
I20260709 13:10:49.968154  3113 raft_consensus.cc:493] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d815906ba3ba41ef8887f7e5b261553f)
I20260709 13:10:49.976661  2972 leader_election.cc:304] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:49.978533  3180 raft_consensus.cc:2749] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.982096  3014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:49.989454  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3764b04f0489440686b563e22556a4f7" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:50.004798  2301 raft_consensus.cc:1275] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.010835  2972 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:49.973254  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:50.014473  2981 raft_consensus.cc:2749] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.016292  2972 leader_election.cc:304] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:50.017342  2981 raft_consensus.cc:2749] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.018831  3085 consensus_queue.cc:1048] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.018944  2972 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:50.021252  2981 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.021670  2981 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:50.022040  2981 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.991591  3113 raft_consensus.cc:515] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:50.022404  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:50.023077  3020 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4fb5266da747deb5bece4024d936a7 in term 2.
I20260709 13:10:50.025007  3113 leader_election.cc:290] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
W20260709 13:10:50.034689  2971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 115683us
I20260709 13:10:50.040817  2971 leader_election.cc:304] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.042028  3183 raft_consensus.cc:2749] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:50.131804  2349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 83012.6us
I20260709 13:10:50.123026  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:50.131923  2981 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
W20260709 13:10:50.126428  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 76733.6us
I20260709 13:10:50.144575  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2da80d88594f89a913a340eea355d9" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:50.131423  2971 leader_election.cc:304] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.143290  3096 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:50.035568  2972 leader_election.cc:304] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:50.151458  3180 raft_consensus.cc:2749] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.166911  2376 raft_consensus.cc:1275] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.166090  3183 raft_consensus.cc:2749] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.187608  2971 leader_election.cc:304] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.192619  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:50.193387  2379 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:50.193732  2971 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:50.195680  3183 raft_consensus.cc:2749] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.196579  3183 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.196991  3183 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:50.197443  3183 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:50.180449  2972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 144211us
W20260709 13:10:50.208506  3186 log.cc:927] Time spent T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:10:50.210834  2981 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:50.213943  2971 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:50.215116  2981 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.215628  2981 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.216112  2981 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.216747  2379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:50.221724  2057 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54006 (request call id 102) took 1759 ms. Trace:
I20260709 13:10:50.211856  2977 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:50.229627  2381 raft_consensus.cc:1275] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.235862  2376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e5799014e34cefa5db5e5147740a98" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:50.222163  2057 rpcz_store.cc:276] 0709 13:10:48.461931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.462078 (+   147us) service_pool.cc:224] Handling call
0709 13:10:50.221634 (+1759556us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:49.594764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:49.595324 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:49.595360 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:10:49.595380 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:49.596041 (+   661us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:49.596130 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:49.596155 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:49.596690 (+   535us) tablet.cc:701] Row locks acquired
0709 13:10:49.596709 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:49.596846 (+   137us) write_op.cc:270] Start()
0709 13:10:49.596965 (+   119us) write_op.cc:276] Timestamp: P: 1783602649596801 usec, L: 0
0709 13:10:49.596985 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:49.597621 (+   636us) log.cc:844] Serialized 2108 byte log entry
0709 13:10:49.939468 (+341847us) op_driver.cc:464] REPLICATION: finished
0709 13:10:50.185249 (+245781us) write_op.cc:301] APPLY: starting
0709 13:10:50.185338 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:50.185493 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:50.185619 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:50.186293 (+   674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:50.186473 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:10:50.186516 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:50.186757 (+   241us) log.cc:844] Serialized 46 byte log entry
0709 13:10:50.186918 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.187024 (+   106us) write_op.cc:454] Released schema lock
0709 13:10:50.187066 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:50.221520 (+ 34454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.221551 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":807772,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":245514,"apply.run_cpu_time_us":2243,"apply.run_wall_time_us":16086,"num_ops":5,"prepare.queue_time_us":144156,"prepare.run_cpu_time_us":54879,"prepare.run_wall_time_us":79137,"raft.queue_time_us":321885,"raft.run_cpu_time_us":77775,"raft.run_wall_time_us":236906,"replication_time_us":342271,"thread_start_us":513388,"threads_started":4,"wal-append.queue_time_us":114867}]]}
I20260709 13:10:50.238607  2977 tablet_bootstrap.cc:492] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:50.239427  2977 ts_tablet_manager.cc:1403] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.336s	user 0.022s	sys 0.006s
I20260709 13:10:50.247888  2346 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67
I20260709 13:10:50.255966  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:50.261502  2272 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.273947  2272 leader_election.cc:304] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f; no voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.274670  2198 leader_election.cc:304] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.285015  3063 raft_consensus.cc:2749] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.273162  3174 consensus_queue.cc:1048] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:10:50.297477  3074 consensus_queue.cc:1048] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:10:50.269340  2921 raft_consensus.cc:2749] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:50.319821  2272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 46006.4us
I20260709 13:10:50.272210  2981 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:50.326167  2979 raft_consensus.cc:2749] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.357621  2895 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.358383  2895 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:50.361303  2895 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:50.388185  2230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:50.375849  2922 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.392230  3015 raft_consensus.cc:1240] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Rejecting Update request from peer 030f4f0790ed4737bfc5a454f29d1e67 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.393477  2981 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:50.376504  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9cb1963d1649f18a1c6256fd4810f0" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:50.401980  2382 raft_consensus.cc:1275] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.403226  2977 raft_consensus.cc:359] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:50.404007  2977 raft_consensus.cc:740] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.404731  2977 consensus_queue.cc:260] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:50.406823  2977 ts_tablet_manager.cc:1434] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.165s	user 0.006s	sys 0.000s
I20260709 13:10:50.365635  3183 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:50.412992  3183 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:50.437536  3191 log.cc:927] Time spent T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
W20260709 13:10:50.443884  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 47811.5us
I20260709 13:10:50.446321  3063 consensus_queue.cc:1048] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.448603  2977 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:50.454743  2922 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:50.455269  2922 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:50.459946  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 63983.1us
I20260709 13:10:50.465358  2229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:50.466305  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:50.468221  2375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:50.472410  2053 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53990 (request call id 109) took 1982 ms. Trace:
W20260709 13:10:50.478013  2198 consensus_peers.cc:597] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.484349  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:50.490214  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:50.491787  2921 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.492425  2921 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:50.494493  2921 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:50.484486  3017 raft_consensus.cc:1240] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Rejecting Update request from peer fd4fb5266da747deb5bece4024d936a7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:50.496289  2198 consensus_peers.cc:597] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.519341  2055 catalog_manager.cc:5697] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.477240  2053 rpcz_store.cc:276] 0709 13:10:48.490122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.040459 (+550337us) service_pool.cc:224] Handling call
0709 13:10:50.472350 (+1431891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:49.799122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:49.799641 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:49.799695 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:10:49.799712 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:49.800420 (+   708us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:49.800467 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:49.800509 (+    42us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:49.801050 (+   541us) tablet.cc:701] Row locks acquired
0709 13:10:49.801068 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:49.801196 (+   128us) write_op.cc:270] Start()
0709 13:10:49.801304 (+   108us) write_op.cc:276] Timestamp: P: 1783602649801152 usec, L: 0
0709 13:10:49.801326 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:49.801946 (+   620us) log.cc:844] Serialized 2495 byte log entry
0709 13:10:50.197483 (+395537us) op_driver.cc:464] REPLICATION: finished
0709 13:10:50.221998 (+ 24515us) write_op.cc:301] APPLY: starting
0709 13:10:50.222215 (+   217us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:50.268426 (+ 46211us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:50.272787 (+  4361us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:50.336145 (+ 63358us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:50.336375 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:10:50.336426 (+    51us) write_op.cc:312] APPLY: finished
0709 13:10:50.336673 (+   247us) log.cc:844] Serialized 52 byte log entry
0709 13:10:50.336860 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.336978 (+   118us) write_op.cc:454] Released schema lock
0709 13:10:50.337025 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:50.337400 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.337430 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":222235,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":24274,"apply.run_cpu_time_us":2966,"apply.run_wall_time_us":115344,"num_ops":6,"prepare.queue_time_us":601,"prepare.run_cpu_time_us":3063,"prepare.run_wall_time_us":3063,"replication_time_us":382568,"thread_start_us":49020,"threads_started":1}]]}
I20260709 13:10:50.537308  2346 leader_election.cc:304] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:50.541618  3014 raft_consensus.cc:1240] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Rejecting Update request from peer 030f4f0790ed4737bfc5a454f29d1e67 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.542814  2971 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.524436  2055 catalog_manager.cc:5697] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.547712  3183 raft_consensus.cc:2749] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.548998  2971 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:50.535100  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:50.549800  3183 raft_consensus.cc:2749] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.550158  2232 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:50.551184  2056 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47212 (request call id 3) took 2376 ms. Trace:
I20260709 13:10:50.551767  3078 raft_consensus.cc:2749] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.551594  2056 rpcz_store.cc:276] 0709 13:10:48.174403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.189637 (+ 15234us) service_pool.cc:224] Handling call
0709 13:10:50.551102 (+2361465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314636,"reported_tablets":10}
W20260709 13:10:50.570099  2346 leader_election.cc:343] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.570799  2346 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:50.604461  2275 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:50.606686  3108 consensus_queue.cc:1059] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.607486  2979 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.566761  3183 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.607614  3108 raft_consensus.cc:3055] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.607965  2979 raft_consensus.cc:493] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.610975  2972 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
W20260709 13:10:50.679968  2972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 69065.4us
I20260709 13:10:50.611245  3183 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:50.676411  2979 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.668056  3108 raft_consensus.cc:740] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:50.704769  3108 consensus_queue.cc:260] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:50.706314  3108 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.715123  3183 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:50.726418  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:50.688648  2981 raft_consensus.cc:2749] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.752883  3090 raft_consensus.cc:2749] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.790767  2232 raft_consensus.cc:2393] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 in current term 2: Already voted for candidate 030f4f0790ed4737bfc5a454f29d1e67 in this term.
I20260709 13:10:50.810413  2922 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:50.814781  2375 raft_consensus.cc:1240] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Rejecting Update request from peer 030f4f0790ed4737bfc5a454f29d1e67 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.815405  2979 raft_consensus.cc:515] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:50.817662  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:50.818806  2300 raft_consensus.cc:2368] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 for earlier term 2. Current term is 3.
I20260709 13:10:50.826097  2232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:50.826941  2232 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.827092  2979 leader_election.cc:290] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:50.826664  2922 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 election: Requested vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:10:50.873054  2347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 130257us
I20260709 13:10:50.970570  2232 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 3.
I20260709 13:10:50.977977  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:50.978507  2977 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:50.980124  3016 raft_consensus.cc:2393] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 in current term 3: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:50.981016  2977 tablet_bootstrap.cc:492] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:50.983144  2977 ts_tablet_manager.cc:1403] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.535s	user 0.030s	sys 0.030s
I20260709 13:10:50.985929  2977 raft_consensus.cc:359] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:50.986661  2977 raft_consensus.cc:740] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.993192  2977 consensus_queue.cc:260] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.000479  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:51.004544  2275 leader_election.cc:304] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:51.006035  2921 raft_consensus.cc:2804] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:51.017246  2198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.196:36647, user_credentials={real_user=slave}} blocked reactor thread for 92008.6us
I20260709 13:10:51.024115  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:51.024854  3016 raft_consensus.cc:3060] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.025794  3217 consensus_queue.cc:1059] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.026985  2972 leader_election.cc:400] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011) with higher term. Message: Invalid argument: T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 for earlier term 2. Current term is 3.
I20260709 13:10:51.027469  2972 leader_election.cc:403] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.031531  2977 ts_tablet_manager.cc:1434] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:10:51.032635  3217 raft_consensus.cc:3055] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.033097  3217 raft_consensus.cc:740] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:51.033952  3217 consensus_queue.cc:260] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.019760  2921 raft_consensus.cc:697] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:51.035213  3217 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.036656  3023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad318e5e24a45798f5fb6553649cf1b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:51.041391  2921 consensus_queue.cc:237] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
W20260709 13:10:51.049196  2198 consensus_peers.cc:597] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:51.054797  2198 consensus_peers.cc:597] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.061271  2349 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:10:51.052385  3016 raft_consensus.cc:2468] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 3.
W20260709 13:10:51.062304  2198 consensus_peers.cc:597] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:51.075412  2198 consensus_peers.cc:597] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:51.069181  2981 raft_consensus.cc:2749] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011) with higher term. Message: Invalid argument: T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b718068a784b5cabecfb16859665a4 for earlier term 2. Current term is 3.
I20260709 13:10:51.098062  2977 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.080782  3063 consensus_queue.cc:1059] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:10:51.101449  2800 raft_consensus.cc:3055] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.101838  2800 raft_consensus.cc:740] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:51.102690  2800 consensus_queue.cc:260] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.103649  3141 raft_consensus.cc:2749] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.115478  2800 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.166383  2055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54000 (request call id 116) took 1275 ms. Trace:
I20260709 13:10:51.167315  2057 catalog_manager.cc:5697] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to fd4fb5266da747deb5bece4024d936a7 (127.24.232.196). New cstate: current_term: 2 leader_uuid: "fd4fb5266da747deb5bece4024d936a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.176561  2977 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.177681  2977 tablet_bootstrap.cc:492] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.179194  2977 ts_tablet_manager.cc:1403] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.004s
I20260709 13:10:51.182729  2977 raft_consensus.cc:359] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.183559  2977 raft_consensus.cc:740] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.168483  2055 rpcz_store.cc:276] 0709 13:10:49.890538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.890710 (+   172us) service_pool.cc:224] Handling call
0709 13:10:51.166321 (+1275611us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:50.836676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:50.837290 (+   614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:50.837327 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:50.837346 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:50.895394 (+ 58048us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:50.918813 (+ 23419us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:50.921281 (+  2468us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:50.979578 (+ 58297us) tablet.cc:701] Row locks acquired
0709 13:10:50.979608 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:10:50.979813 (+   205us) write_op.cc:270] Start()
0709 13:10:50.979963 (+   150us) write_op.cc:276] Timestamp: P: 1783602650979759 usec, L: 0
0709 13:10:50.979992 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:10:50.980847 (+   855us) log.cc:844] Serialized 934 byte log entry
0709 13:10:51.083692 (+102845us) op_driver.cc:464] REPLICATION: finished
0709 13:10:51.140367 (+ 56675us) write_op.cc:301] APPLY: starting
0709 13:10:51.140459 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:51.140582 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:51.140697 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:51.141073 (+   376us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:51.141268 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:51.141317 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:51.141511 (+   194us) log.cc:844] Serialized 28 byte log entry
0709 13:10:51.147837 (+  6326us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:51.147930 (+    93us) write_op.cc:454] Released schema lock
0709 13:10:51.147973 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":11355,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":51156,"apply.run_cpu_time_us":1911,"apply.run_wall_time_us":8044,"num_ops":2,"prepare.queue_time_us":289215,"prepare.run_cpu_time_us":3786,"prepare.run_wall_time_us":144504,"replication_time_us":98575,"thread_start_us":197800,"threads_started":2}]]}
I20260709 13:10:51.185555  2977 consensus_queue.cc:260] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.194119  2977 ts_tablet_manager.cc:1434] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:51.195116  2977 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.235832  2977 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.236781  2977 tablet_bootstrap.cc:492] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.237404  2977 ts_tablet_manager.cc:1403] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.007s
I20260709 13:10:51.247980  2977 raft_consensus.cc:359] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.248721  2977 raft_consensus.cc:740] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.249496  2977 consensus_queue.cc:260] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.251744  2977 ts_tablet_manager.cc:1434] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:10:51.252533  2977 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
W20260709 13:10:51.268779  2198 consensus_peers.cc:597] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:51.273236  2056 catalog_manager.cc:5697] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 1 to 2, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.317785  2977 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.318796  2977 tablet_bootstrap.cc:492] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.319424  2977 ts_tablet_manager.cc:1403] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.015s
I20260709 13:10:51.321875  2977 raft_consensus.cc:359] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.322508  2977 raft_consensus.cc:740] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.323297  2977 consensus_queue.cc:260] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.334728  2977 ts_tablet_manager.cc:1434] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:10:51.344347  2977 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.348354  2055 catalog_manager.cc:5697] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 3, leader changed from e8b718068a784b5cabecfb16859665a4 (127.24.232.193) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 3 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.379735  2977 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.383318  2977 tablet_bootstrap.cc:492] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.384063  2977 ts_tablet_manager.cc:1403] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.013s
I20260709 13:10:51.398069  2977 raft_consensus.cc:359] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.398782  2977 raft_consensus.cc:740] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.399492  2977 consensus_queue.cc:260] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.401784  2977 ts_tablet_manager.cc:1434] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:51.405695  2977 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.413220  3018 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.431361  2977 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.432551  2977 tablet_bootstrap.cc:492] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.433487  2977 ts_tablet_manager.cc:1403] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 13:10:51.436048  2977 raft_consensus.cc:359] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.436761  2977 raft_consensus.cc:740] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.437608  2977 consensus_queue.cc:260] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.440001  2977 ts_tablet_manager.cc:1434] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:10:51.440984  2977 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.464182  2977 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.465262  2977 tablet_bootstrap.cc:492] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.465984  2977 ts_tablet_manager.cc:1403] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:10:51.480769  2977 raft_consensus.cc:359] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.481484  2977 raft_consensus.cc:740] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.482633  2977 consensus_queue.cc:260] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.493160  2977 ts_tablet_manager.cc:1434] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:10:51.494068  2977 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.519025  3018 raft_consensus.cc:3060] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.530125  2977 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.531180  2977 tablet_bootstrap.cc:492] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.532100  2977 ts_tablet_manager.cc:1403] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.004s
I20260709 13:10:51.540257  2977 raft_consensus.cc:359] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.541086  2977 raft_consensus.cc:740] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.542299  2977 consensus_queue.cc:260] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.544606  2977 ts_tablet_manager.cc:1434] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:51.545562  2977 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.592221  2977 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.593204  2977 tablet_bootstrap.cc:492] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.595275  2977 ts_tablet_manager.cc:1403] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.024s
I20260709 13:10:51.598294  2977 raft_consensus.cc:359] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.599385  2977 raft_consensus.cc:740] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.596326  3018 raft_consensus.cc:1275] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:51.601411  2977 consensus_queue.cc:260] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.603472  2977 ts_tablet_manager.cc:1434] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:51.608103  2921 consensus_queue.cc:1048] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.610563  2977 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.624675  3020 raft_consensus.cc:3060] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.656698  2235 raft_consensus.cc:1275] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:51.658046  2921 consensus_queue.cc:1048] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.674750  2977 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.675882  2977 tablet_bootstrap.cc:492] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.676594  2977 ts_tablet_manager.cc:1403] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.018s
I20260709 13:10:51.679459  2977 raft_consensus.cc:359] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.680235  2977 raft_consensus.cc:740] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.685117  2977 consensus_queue.cc:260] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.690163  2977 ts_tablet_manager.cc:1434] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:10:51.691143  2977 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.744976  2977 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.746028  2977 tablet_bootstrap.cc:492] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.746754  2977 ts_tablet_manager.cc:1403] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.012s
I20260709 13:10:51.749250  3018 raft_consensus.cc:3060] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.749467  2977 raft_consensus.cc:359] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.755863  2977 raft_consensus.cc:740] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.760614  2977 consensus_queue.cc:260] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.764236  2977 ts_tablet_manager.cc:1434] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:10:51.765278  2977 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.822814  2977 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.826251  2977 tablet_bootstrap.cc:492] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.827033  2977 ts_tablet_manager.cc:1403] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.023s
I20260709 13:10:51.829700  2977 raft_consensus.cc:359] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.823769  3016 raft_consensus.cc:3060] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.830381  2977 raft_consensus.cc:740] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.832926  2977 consensus_queue.cc:260] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:51.834960  2977 ts_tablet_manager.cc:1434] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:10:51.835889  2977 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.866739  2977 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.869210  2977 tablet_bootstrap.cc:492] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.870316  2977 ts_tablet_manager.cc:1403] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.004s
I20260709 13:10:51.918040  2977 raft_consensus.cc:359] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.928045  2977 raft_consensus.cc:740] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.928762  2977 consensus_queue.cc:260] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.930311  2977 ts_tablet_manager.cc:1434] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.060s	user 0.000s	sys 0.005s
I20260709 13:10:51.931160  2977 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.980142  2977 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.981011  2977 tablet_bootstrap.cc:492] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:51.981482  2977 ts_tablet_manager.cc:1403] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 13:10:51.983352  3243 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:51.983351  2977 raft_consensus.cc:359] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.984093  2977 raft_consensus.cc:740] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.984035  3243 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:51.984972  2977 consensus_queue.cc:260] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:51.987726  2977 ts_tablet_manager.cc:1434] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:51.988755  2977 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:51.999524  3243 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.002065  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:52.002909  3024 raft_consensus.cc:2393] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 3: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:52.004558  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:52.017542  2377 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 3.
I20260709 13:10:52.021268  2272 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:52.025575  3243 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:52.025985  3243 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd4fb5266da747deb5bece4024d936a7)
I20260709 13:10:52.026367  3243 raft_consensus.cc:3060] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.032723  2977 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.033777  2977 tablet_bootstrap.cc:492] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.034773  2977 ts_tablet_manager.cc:1403] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.006s
I20260709 13:10:52.038516  2977 raft_consensus.cc:359] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.039211  2977 raft_consensus.cc:740] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.041097  2977 consensus_queue.cc:260] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.043254  2977 ts_tablet_manager.cc:1434] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:10:52.044139  2977 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.044175  3243 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.047606  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:52.048832  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:52.049638  3018 raft_consensus.cc:2393] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d815906ba3ba41ef8887f7e5b261553f in current term 3: Already voted for candidate e8b718068a784b5cabecfb16859665a4 in this term.
I20260709 13:10:52.061903  2377 raft_consensus.cc:2468] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 3.
I20260709 13:10:52.062427  3243 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.073673  2272 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7; no voters: e8b718068a784b5cabecfb16859665a4
I20260709 13:10:52.075009  3243 raft_consensus.cc:2804] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.075495  3243 raft_consensus.cc:697] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 3 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:52.076344  3243 consensus_queue.cc:237] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.077224  2977 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.078318  2977 tablet_bootstrap.cc:492] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.079120  2977 ts_tablet_manager.cc:1403] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.002s
I20260709 13:10:52.082031  2977 raft_consensus.cc:359] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.082811  2977 raft_consensus.cc:740] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.083590  2977 consensus_queue.cc:260] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.085928  2977 ts_tablet_manager.cc:1434] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:52.088218  2977 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.096910  2057 catalog_manager.cc:5697] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 2 to 3, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 3 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.112262  2977 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.113269  2977 tablet_bootstrap.cc:492] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.114082  2977 ts_tablet_manager.cc:1403] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.000s
I20260709 13:10:52.116937  2977 raft_consensus.cc:359] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.117574  2977 raft_consensus.cc:740] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.118244  2977 consensus_queue.cc:260] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
W20260709 13:10:52.120769  2346 consensus_peers.cc:597] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:52.124764  2977 ts_tablet_manager.cc:1434] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:52.125658  2977 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.130939  3018 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.133701  3016 raft_consensus.cc:3060] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:52.193125  2198 consensus_peers.cc:597] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:52.385056  2349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:46655, user_credentials={real_user=slave}} blocked reactor thread for 175358us
I20260709 13:10:52.391383  2977 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.392522  2977 tablet_bootstrap.cc:492] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.393219  2977 ts_tablet_manager.cc:1403] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.268s	user 0.061s	sys 0.055s
I20260709 13:10:52.393769  2800 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.394240  2800 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.396107  2800 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.398931  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:52.400054  3018 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 3.
I20260709 13:10:52.403249  2198 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:52.404103  3022 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.404506  3022 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.404855  3022 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.413516  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:52.425737  3022 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.426407  2977 raft_consensus.cc:359] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.427353  2977 raft_consensus.cc:740] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.428171  2977 consensus_queue.cc:260] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.428800  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:52.430682  2977 ts_tablet_manager.cc:1434] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.002s
I20260709 13:10:52.432294  3022 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.438311  2977 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.439281  3024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:52.439982  3024 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.451167  3024 raft_consensus.cc:2468] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 4.
I20260709 13:10:52.464845  3020 raft_consensus.cc:3060] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.484146  2800 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.484829  2800 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.490074  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:52.490731  2377 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 3.
I20260709 13:10:52.491880  2198 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:52.492575  3022 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.492954  3022 raft_consensus.cc:493] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.493321  3022 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.494650  2198 leader_election.cc:304] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:52.495941  3217 raft_consensus.cc:2804] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:52.496429  3217 raft_consensus.cc:697] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:52.496800  2977 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.497294  3217 consensus_queue.cc:237] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.497941  2977 tablet_bootstrap.cc:492] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.498785  2977 ts_tablet_manager.cc:1403] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.005s
I20260709 13:10:52.509567  3018 raft_consensus.cc:1275] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.511528  3243 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:52.513573  2800 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.515851  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:52.516721  3016 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 3.
I20260709 13:10:52.518303  3022 raft_consensus.cc:515] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.523908  2977 raft_consensus.cc:359] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:52.524766  2977 raft_consensus.cc:740] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.525509  2977 consensus_queue.cc:260] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:52.528268  2977 ts_tablet_manager.cc:1434] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:10:52.529261  2977 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.543387  2055 catalog_manager.cc:5697] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.546578  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:52.547971  2377 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.549168  3022 leader_election.cc:290] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297)
I20260709 13:10:52.552498  3016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816062140ff0488493bee4a5d1a50872" candidate_uuid: "030f4f0790ed4737bfc5a454f29d1e67" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4"
I20260709 13:10:52.553143  3016 raft_consensus.cc:3060] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.572983  2377 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 4.
I20260709 13:10:52.572971  3016 raft_consensus.cc:2468] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030f4f0790ed4737bfc5a454f29d1e67 in term 4.
I20260709 13:10:52.575392  2198 leader_election.cc:304] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:52.580152  2800 raft_consensus.cc:2804] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:52.582712  2800 raft_consensus.cc:697] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 LEADER]: Becoming Leader. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:52.583444  2800 consensus_queue.cc:237] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.605412  2977 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.606595  2977 tablet_bootstrap.cc:492] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.607326  2977 ts_tablet_manager.cc:1403] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.017s
I20260709 13:10:52.610345  2977 raft_consensus.cc:359] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:52.611159  2977 raft_consensus.cc:740] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.612998  2977 consensus_queue.cc:260] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:52.615939  2977 ts_tablet_manager.cc:1434] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 13:10:52.616896  2977 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Bootstrap starting.
I20260709 13:10:52.625371  2055 catalog_manager.cc:5697] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "030f4f0790ed4737bfc5a454f29d1e67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.629189  2377 raft_consensus.cc:1275] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.631760  3243 consensus_queue.cc:1048] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.642139  2981 raft_consensus.cc:493] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d815906ba3ba41ef8887f7e5b261553f)
I20260709 13:10:52.642817  2981 raft_consensus.cc:515] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:52.643882  3137 raft_consensus.cc:493] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 030f4f0790ed4737bfc5a454f29d1e67)
I20260709 13:10:52.644451  3137 raft_consensus.cc:515] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.648504  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67" is_pre_election: true
I20260709 13:10:52.650629  3137 leader_election.cc:290] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:52.661921  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035e31f9034b4c46beab764ce654d702" candidate_uuid: "fd4fb5266da747deb5bece4024d936a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8b718068a784b5cabecfb16859665a4" is_pre_election: true
I20260709 13:10:52.662819  3020 raft_consensus.cc:2368] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 for earlier term 3. Current term is 4.
I20260709 13:10:52.664199  2346 leader_election.cc:400] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297) with higher term. Message: Invalid argument: T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 for earlier term 3. Current term is 4.
I20260709 13:10:52.664561  2346 leader_election.cc:403] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.665730  3137 raft_consensus.cc:3060] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.671056  2381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd4fb5266da747deb5bece4024d936a7" is_pre_election: true
I20260709 13:10:52.686717  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9636aa4db950425481239f3d2214245b" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d815906ba3ba41ef8887f7e5b261553f" is_pre_election: true
I20260709 13:10:52.688582  2972 leader_election.cc:304] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b718068a784b5cabecfb16859665a4; no voters: d815906ba3ba41ef8887f7e5b261553f, fd4fb5266da747deb5bece4024d936a7
I20260709 13:10:52.690582  3267 raft_consensus.cc:2749] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.709553  2977 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.710855  2977 tablet_bootstrap.cc:492] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Bootstrap complete.
I20260709 13:10:52.711628  2977 ts_tablet_manager.cc:1403] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.024s
I20260709 13:10:52.713491  2981 leader_election.cc:290] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:52.715304  2977 raft_consensus.cc:359] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.740854  2977 raft_consensus.cc:740] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.742273  2977 consensus_queue.cc:260] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:52.753420  3020 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.756669  2977 ts_tablet_manager.cc:1434] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:10:52.767908  3137 raft_consensus.cc:2749] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297) with higher term. Message: Invalid argument: T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd4fb5266da747deb5bece4024d936a7 for earlier term 3. Current term is 4.
I20260709 13:10:53.035163  3020 raft_consensus.cc:1275] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:53.037550  3217 consensus_queue.cc:1048] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.067538  2381 raft_consensus.cc:1275] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:53.076228  3217 consensus_queue.cc:1048] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.092000  3020 raft_consensus.cc:1275] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:53.093485  3084 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.109434  2377 raft_consensus.cc:1275] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Refusing update from remote peer 030f4f0790ed4737bfc5a454f29d1e67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:53.112638  3084 consensus_queue.cc:1048] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.159188 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.219504  2377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:57.220330  2377 raft_consensus.cc:606] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Received request to transfer leadership to TS d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:57.240440  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:57.241045  2234 raft_consensus.cc:606] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:57.245733  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:57.246315  2234 raft_consensus.cc:606] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:57.251518  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:57.252099  2234 raft_consensus.cc:606] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:57.254607  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:57.255164  2234 raft_consensus.cc:606] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:57.261922  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:57.262444  2234 raft_consensus.cc:606] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:57.263793 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:57.265415 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:57.286809  3287 raft_consensus.cc:993] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.287429  3217 raft_consensus.cc:1081] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.289058  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:57.289721  3018 raft_consensus.cc:493] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.290083  3018 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.297968  3018 raft_consensus.cc:515] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:57.300107  3018 leader_election.cc:290] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:57.300892  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:57.301578  2377 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.306993  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6820d35ebf7d4653abe467f32fbfffb6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.307623  2234 raft_consensus.cc:3055] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.307932  2234 raft_consensus.cc:740] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:57.308933  2377 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.310415  2971 leader_election.cc:304] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:57.312779  3299 raft_consensus.cc:2804] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.315117  3299 raft_consensus.cc:697] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:57.316044  3299 consensus_queue.cc:237] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:57.308614  2234 consensus_queue.cc:260] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:57.321492  2234 raft_consensus.cc:3060] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.332204  2234 raft_consensus.cc:2468] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.335932  2055 catalog_manager.cc:5697] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.441454  3287 raft_consensus.cc:993] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.441975  3217 raft_consensus.cc:1081] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.443856  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:57.444312  3018 raft_consensus.cc:493] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.444639  3018 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.451110  3018 raft_consensus.cc:515] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.453132  3018 leader_election.cc:290] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:57.454378  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:57.455013  2302 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.453962  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d31cd8714661a570f28b72be8656" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.456158  2234 raft_consensus.cc:3055] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.456424  2234 raft_consensus.cc:740] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:57.457060  2234 consensus_queue.cc:260] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.457975  2234 raft_consensus.cc:3060] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.462167  2302 raft_consensus.cc:2468] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.462891  2234 raft_consensus.cc:2468] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.463424  2972 leader_election.cc:304] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:57.464310  3299 raft_consensus.cc:2804] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.464781  3299 raft_consensus.cc:697] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:57.465518  3299 consensus_queue.cc:237] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.471410  3291 raft_consensus.cc:993] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:57.472039  3285 raft_consensus.cc:1081] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Signalling peer d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:57.474133  2302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2"
dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:59810
I20260709 13:10:57.474812  2302 raft_consensus.cc:493] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.475158  2302 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.482653  2302 raft_consensus.cc:515] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:57.485728  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.485911  2302 leader_election.cc:290] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:57.485430  2055 catalog_manager.cc:5697] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.486299  2234 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.489281  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322c5581771740d3b4fcf69409b0bef2" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:57.489917  2377 raft_consensus.cc:3055] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.490211  2377 raft_consensus.cc:740] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:57.490976  2377 consensus_queue.cc:260] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:57.492252  2377 raft_consensus.cc:3060] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.498798  3287 raft_consensus.cc:993] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.499279  3287 raft_consensus.cc:1081] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.502936  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:57.503472  3020 raft_consensus.cc:493] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.503827  3020 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.506541  2234 raft_consensus.cc:2468] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:57.507694  2275 leader_election.cc:304] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:57.508520  3292 raft_consensus.cc:2804] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.508980  3292 raft_consensus.cc:697] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:57.509850  3292 consensus_queue.cc:237] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:57.513031  2377 raft_consensus.cc:2468] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:57.524013  3293 raft_consensus.cc:993] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.524458  3293 raft_consensus.cc:1081] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.525941  3020 raft_consensus.cc:515] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.528311  3020 leader_election.cc:290] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:57.529552  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.530140  2234 raft_consensus.cc:3055] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:57.530351  2058 catalog_manager.cc:5697] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.530397  2234 raft_consensus.cc:740] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:57.532142  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442d06e6435f447e80ad1a730f3cd755" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:57.532677  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:57.532699  2302 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.533274  3020 raft_consensus.cc:493] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.533659  3020 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.532582  2234 consensus_queue.cc:260] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.536406  2234 raft_consensus.cc:3060] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.540320  3020 raft_consensus.cc:515] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.542683  3020 leader_election.cc:290] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:57.543695  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.544292  2231 raft_consensus.cc:3055] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.544566  2231 raft_consensus.cc:740] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:57.545265  2231 consensus_queue.cc:260] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.546418  2231 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.548000  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae6d76be90254ddb84a418f4fd751562" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:57.548569  2308 raft_consensus.cc:3060] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.554803  2234 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:57.560632  2302 raft_consensus.cc:2468] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:57.562975  2972 leader_election.cc:304] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:57.563802  3299 raft_consensus.cc:2804] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.564539  3299 raft_consensus.cc:697] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:57.559497  2231 raft_consensus.cc:2468] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.565384  3299 consensus_queue.cc:237] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.563918  2308 raft_consensus.cc:2468] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.567071  2972 leader_election.cc:304] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:57.568578  3300 raft_consensus.cc:2804] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.569175  3300 raft_consensus.cc:697] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:57.570246  3300 consensus_queue.cc:237] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.595093  2058 catalog_manager.cc:5697] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.692040  3217 raft_consensus.cc:993] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.693260  3217 raft_consensus.cc:1081] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:57.700793  2058 catalog_manager.cc:5697] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.753640  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:57.756525  3020 raft_consensus.cc:493] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.757097  3020 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.811542  3020 raft_consensus.cc:515] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.827533  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:57.828480  2234 raft_consensus.cc:3055] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.828856  2234 raft_consensus.cc:740] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:57.831811  2234 consensus_queue.cc:260] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.833549  2234 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.841549  3020 leader_election.cc:290] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:57.843246  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e196c60e9b45efa369f89f86c94fba" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:57.844045  2302 raft_consensus.cc:3060] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.853682  2231 raft_consensus.cc:1275] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.855875  3300 consensus_queue.cc:1048] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:57.864604  2302 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.867108  2972 leader_election.cc:304] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:57.869606  3300 raft_consensus.cc:2804] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.870190  3300 raft_consensus.cc:697] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:57.870329  2377 raft_consensus.cc:1275] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.871549  3300 consensus_queue.cc:237] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:57.873076  3299 consensus_queue.cc:1048] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:57.887436  2234 raft_consensus.cc:2468] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:57.923492  2375 raft_consensus.cc:1275] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.927779  3292 consensus_queue.cc:1048] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:57.931252  2058 catalog_manager.cc:5697] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.956122  2235 raft_consensus.cc:1275] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.961604  3299 consensus_queue.cc:1048] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.967309  2300 raft_consensus.cc:1275] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:57.985188  3299 consensus_queue.cc:1048] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.988305  2231 raft_consensus.cc:1275] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.990693  3309 consensus_queue.cc:1048] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.003417  2302 raft_consensus.cc:1275] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.004897  3309 consensus_queue.cc:1048] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.008946  2235 raft_consensus.cc:1275] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.011040  3314 consensus_queue.cc:1048] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.043565  2308 raft_consensus.cc:1275] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.045814  3299 consensus_queue.cc:1048] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.082882  2234 raft_consensus.cc:1275] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.084120  3309 consensus_queue.cc:1048] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.266755 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.323565 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.365370  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791cf48580174beebd42190628c6d944"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:58.366051  2234 raft_consensus.cc:606] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.373750  2377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:58.374385  2377 raft_consensus.cc:606] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.378968  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:58.379613  2234 raft_consensus.cc:606] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.382187  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:58.382756  2234 raft_consensus.cc:606] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.385454  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e122c6caef20456896b39c5eef556a78"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:58.386011  2234 raft_consensus.cc:606] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.393788  2231 raft_consensus.cc:1275] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.395905  3309 consensus_queue.cc:1048] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.400506  3293 raft_consensus.cc:993] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.401036  3293 raft_consensus.cc:1081] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.404426  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:58.405004  3018 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.408135  3018 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.411885  2308 raft_consensus.cc:1275] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.416901  2231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:58.417523  2231 raft_consensus.cc:606] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:58.418989  3309 consensus_queue.cc:1048] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.423098 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:58.426939 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:58.446841  3018 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.450307  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:58.450941  2231 raft_consensus.cc:3055] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.451234  2231 raft_consensus.cc:740] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:58.452335  2231 consensus_queue.cc:260] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.453606  2231 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.454761  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8e1edc577347899d4aaf8332c28496" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:58.455367  2377 raft_consensus.cc:3060] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.460254  3018 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:58.462100  2231 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.463438  2974 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:58.464440  3331 raft_consensus.cc:2804] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.464907  3331 raft_consensus.cc:697] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.465833  3331 consensus_queue.cc:237] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.467162  2377 raft_consensus.cc:2468] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.480227  2056 catalog_manager.cc:5697] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.560899  3287 raft_consensus.cc:993] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.562137  3287 raft_consensus.cc:1081] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.565033  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791cf48580174beebd42190628c6d944"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:58.566666  3020 raft_consensus.cc:493] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.567010  3020 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.572099  3020 raft_consensus.cc:515] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.574673  3020 leader_election.cc:290] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:58.575501  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:58.576408  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791cf48580174beebd42190628c6d944" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:58.576455  2231 raft_consensus.cc:3055] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.577008  2377 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.577239  2231 raft_consensus.cc:740] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:58.578287  2231 consensus_queue.cc:260] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.580245  2231 raft_consensus.cc:3060] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.583657  2377 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.586954  2971 leader_election.cc:304] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:58.587998  3331 raft_consensus.cc:2804] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.588718  3331 raft_consensus.cc:697] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.589800  3331 consensus_queue.cc:237] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.591516  3291 raft_consensus.cc:993] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.592031  3291 raft_consensus.cc:1081] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.594239  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:10:58.595741  3020 raft_consensus.cc:493] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.596722  3020 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.605901  2231 raft_consensus.cc:2468] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.606639  3020 raft_consensus.cc:515] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:58.610229  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:58.610855  2300 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.612010  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf0b0e9a47d459fbfb6ddbe46c0775d" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:58.612604  2377 raft_consensus.cc:3055] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.612896  2377 raft_consensus.cc:740] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:58.613606  2377 consensus_queue.cc:260] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:58.614636  2377 raft_consensus.cc:3060] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.615411  3020 leader_election.cc:290] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:58.622041  2056 catalog_manager.cc:5697] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.645555  2300 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.664568  2972 leader_election.cc:304] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:58.665504  3331 raft_consensus.cc:2804] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.666003  3331 raft_consensus.cc:697] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.666887  3331 consensus_queue.cc:237] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } }
I20260709 13:10:58.675230  2377 raft_consensus.cc:2468] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.685194  2056 catalog_manager.cc:5697] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.713896  3287 raft_consensus.cc:993] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.714387  3287 raft_consensus.cc:1081] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.716842  3020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:58.717306  3020 raft_consensus.cc:493] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.717628  3020 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.722839  3020 raft_consensus.cc:515] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.724694  3020 leader_election.cc:290] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:58.725561  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:58.726132  2377 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.726061  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3eb1da29ee2465dbde39c0fbab92e02" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:58.726821  3293 raft_consensus.cc:993] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.726795  2231 raft_consensus.cc:3055] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.727356  3313 raft_consensus.cc:1081] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.727587  2231 raft_consensus.cc:740] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:58.728530  2231 consensus_queue.cc:260] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.729179  3024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e122c6caef20456896b39c5eef556a78"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:58.729736  3024 raft_consensus.cc:493] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.729784  2231 raft_consensus.cc:3060] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.730085  3024 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.733117  2377 raft_consensus.cc:2468] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:58.734345  2971 leader_election.cc:304] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8b718068a784b5cabecfb16859665a4, fd4fb5266da747deb5bece4024d936a7; no voters: 
I20260709 13:10:58.735143  3331 raft_consensus.cc:2804] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.735728  3331 raft_consensus.cc:697] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.736410  2231 raft_consensus.cc:2468] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:58.736366  3024 raft_consensus.cc:515] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.736649  3331 consensus_queue.cc:237] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:58.738708  3024 leader_election.cc:290] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:58.739243  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:58.739887  2231 raft_consensus.cc:3055] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.739773  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e122c6caef20456896b39c5eef556a78" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:58.740392  2231 raft_consensus.cc:740] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:58.740705  2300 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.741267  2231 consensus_queue.cc:260] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.742345  2231 raft_consensus.cc:3060] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.747280  2231 raft_consensus.cc:2468] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:58.748842  2974 leader_election.cc:304] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:58.749148  2300 raft_consensus.cc:2468] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:58.749874  3331 raft_consensus.cc:2804] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.750537  3331 raft_consensus.cc:697] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.751540  3331 consensus_queue.cc:237] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.754185  2056 catalog_manager.cc:5697] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.768625  2056 catalog_manager.cc:5697] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.862478  2231 raft_consensus.cc:1275] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.863740  3331 consensus_queue.cc:1048] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.872598  2377 raft_consensus.cc:1275] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.874078  3331 consensus_queue.cc:1048] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.893000  3293 raft_consensus.cc:993] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.893569  3293 raft_consensus.cc:1081] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:58.903012  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:10:58.903577  3018 raft_consensus.cc:493] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.903988  3018 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.910861  3018 raft_consensus.cc:515] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.912721  3018 leader_election.cc:290] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:10:58.913409  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:58.914006  2231 raft_consensus.cc:3055] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.914275  2231 raft_consensus.cc:740] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:10:58.914737  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71948f18aa040a99d9fc9af3f14820a" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:10:58.915345  2308 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.915058  2231 consensus_queue.cc:260] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.916395  2231 raft_consensus.cc:3060] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.922500  2308 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.924232  2972 leader_election.cc:304] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:58.924767  2231 raft_consensus.cc:2468] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:58.925549  3345 raft_consensus.cc:2804] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.926616  3345 raft_consensus.cc:697] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:58.927569  3345 consensus_queue.cc:237] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:10:58.944979  2056 catalog_manager.cc:5697] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.040874  2231 raft_consensus.cc:1275] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:59.042297  3345 consensus_queue.cc:1048] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:59.053365  2375 raft_consensus.cc:1275] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:59.056176  3309 consensus_queue.cc:1048] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:59.103251  2375 raft_consensus.cc:1275] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:59.103865  2308 raft_consensus.cc:1275] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:59.104638  3299 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:59.105412  3309 consensus_queue.cc:1048] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:59.145893  2375 raft_consensus.cc:1275] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.147118  3299 consensus_queue.cc:1048] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.157477  2231 raft_consensus.cc:1275] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.159198  3299 consensus_queue.cc:1048] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.183525  2231 raft_consensus.cc:1275] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.184894  3299 consensus_queue.cc:1048] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.196354  2300 raft_consensus.cc:1275] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.197594  3331 consensus_queue.cc:1048] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.410636  2308 raft_consensus.cc:1275] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.412032  3299 consensus_queue.cc:1048] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.427110  2234 raft_consensus.cc:1275] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.427927 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:59.431649  3299 consensus_queue.cc:1048] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.481959 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:59.523733  2375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "735fe428615d4151ba9722c729b057c6"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:59.524322  2375 raft_consensus.cc:606] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:59.526932  2377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:59.527382  2377 raft_consensus.cc:606] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Received request to transfer leadership to TS d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:59.529575  2231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef"
dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:37734
I20260709 13:10:59.530124  2231 raft_consensus.cc:606] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:59.532752  2375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:59.533309  2375 raft_consensus.cc:606] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:10:59.536670  2375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:10:59.537302  2375 raft_consensus.cc:606] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Received request to transfer leadership to TS d815906ba3ba41ef8887f7e5b261553f
I20260709 13:10:59.539261 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:59.540769 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:59.683231  3294 raft_consensus.cc:993] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:59.683876  3285 raft_consensus.cc:1081] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Signalling peer d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:59.685299  2308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5"
dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:59810
I20260709 13:10:59.685832  2308 raft_consensus.cc:493] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.686137  2308 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.693836  2308 raft_consensus.cc:515] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.695245  2308 leader_election.cc:290] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:59.695959  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:59.696161  2375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f4f333411941d4b67259070a4d9fd5" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:59.696591  2231 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.696756  2375 raft_consensus.cc:3055] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.697147  2375 raft_consensus.cc:740] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:59.697992  2375 consensus_queue.cc:260] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.699263  2375 raft_consensus.cc:3060] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.704054  2231 raft_consensus.cc:2468] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:59.705246  2275 leader_election.cc:304] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:59.706269  3314 raft_consensus.cc:2804] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.706996  3314 raft_consensus.cc:697] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:59.707710  2375 raft_consensus.cc:2468] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:59.707897  3314 consensus_queue.cc:237] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.719326  2055 catalog_manager.cc:5697] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.844522  3294 raft_consensus.cc:993] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:59.845027  3285 raft_consensus.cc:1081] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:59.846429  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "735fe428615d4151ba9722c729b057c6"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:10:59.846963  3018 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.847285  3018 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.852360  3018 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.853710  3018 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:59.854346  2375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:59.854658  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735fe428615d4151ba9722c729b057c6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:59.855007  2375 raft_consensus.cc:3055] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:59.855279  2231 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.855397  2375 raft_consensus.cc:740] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:59.856355  2375 consensus_queue.cc:260] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.857371  2375 raft_consensus.cc:3060] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.861024  2231 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:59.862133  2974 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:59.862819  3299 raft_consensus.cc:2804] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:59.863291  3299 raft_consensus.cc:697] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:59.864005  2375 raft_consensus.cc:2468] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:10:59.864238  3299 consensus_queue.cc:237] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.875725  2055 catalog_manager.cc:5697] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.910624  3294 raft_consensus.cc:993] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:59.911175  3294 raft_consensus.cc:1081] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Signalling peer d815906ba3ba41ef8887f7e5b261553f to start an election
I20260709 13:10:59.913897  2300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805"
dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
 from {username='slave'} at 127.0.0.1:59810
I20260709 13:10:59.914479  2300 raft_consensus.cc:493] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.914871  2300 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.921561  2300 raft_consensus.cc:515] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.923162  2300 leader_election.cc:290] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647)
I20260709 13:10:59.923946  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:59.924176  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b9d61ad9bc4e6dbfb3b264e1fc2805" candidate_uuid: "d815906ba3ba41ef8887f7e5b261553f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:59.924779  2231 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.924882  2377 raft_consensus.cc:3055] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.925402  2377 raft_consensus.cc:740] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:59.926290  2377 consensus_queue.cc:260] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.927704  2377 raft_consensus.cc:3060] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.931270  2231 raft_consensus.cc:2468] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:59.932322  2275 leader_election.cc:304] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, d815906ba3ba41ef8887f7e5b261553f; no voters: 
I20260709 13:10:59.933113  3314 raft_consensus.cc:2804] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.933553  3314 raft_consensus.cc:697] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Becoming Leader. State: Replica: d815906ba3ba41ef8887f7e5b261553f, State: Running, Role: LEADER
I20260709 13:10:59.933696  2377 raft_consensus.cc:2468] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d815906ba3ba41ef8887f7e5b261553f in term 2.
I20260709 13:10:59.934427  3314 consensus_queue.cc:237] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } }
I20260709 13:10:59.941591  3366 raft_consensus.cc:993] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:59.942409  3285 raft_consensus.cc:1081] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:10:59.944254  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:10:59.944732  3018 raft_consensus.cc:493] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.945081  3018 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.945791  2055 catalog_manager.cc:5697] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f reported cstate change: term changed from 1 to 2, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to d815906ba3ba41ef8887f7e5b261553f (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d815906ba3ba41ef8887f7e5b261553f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.951463  3018 raft_consensus.cc:515] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.954927  3018 leader_election.cc:290] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:10:59.955389  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:10:59.956072  2231 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.959887  2377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0fc298147e494fadd29bc6f429c1f8" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:10:59.960494  2377 raft_consensus.cc:3055] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.960801  2377 raft_consensus.cc:740] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:10:59.961524  2377 consensus_queue.cc:260] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.962587  2231 raft_consensus.cc:2468] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:59.962663  2377 raft_consensus.cc:3060] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.963977  2974 leader_election.cc:304] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:10:59.964810  3309 raft_consensus.cc:2804] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.965376  3309 raft_consensus.cc:697] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:10:59.966217  3309 consensus_queue.cc:237] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:10:59.969358  2377 raft_consensus.cc:2468] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 2.
I20260709 13:10:59.978058  2055 catalog_manager.cc:5697] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 1 to 2, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.026600  3293 raft_consensus.cc:993] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:11:00.027158  3313 raft_consensus.cc:1081] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:11:00.028855  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34138
I20260709 13:11:00.029443  3018 raft_consensus.cc:493] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.029840  3018 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.037041  3018 raft_consensus.cc:515] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:11:00.039083  3018 leader_election.cc:290] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655), d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011)
I20260709 13:11:00.039930  2231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:11:00.040737  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ec0fc46c1a4c17bfd2365bae887fef" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d815906ba3ba41ef8887f7e5b261553f"
I20260709 13:11:00.041270  2231 raft_consensus.cc:3055] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.042008  2231 raft_consensus.cc:740] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 030f4f0790ed4737bfc5a454f29d1e67, State: Running, Role: LEADER
I20260709 13:11:00.041427  2300 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.042829  2231 consensus_queue.cc:260] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:11:00.044312  2231 raft_consensus.cc:3060] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.049012  2300 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:11:00.049569  2231 raft_consensus.cc:2468] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:11:00.050226  2972 leader_election.cc:304] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d815906ba3ba41ef8887f7e5b261553f, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:11:00.051185  3299 raft_consensus.cc:2804] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.051738  3299 raft_consensus.cc:697] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:11:00.052536  3299 consensus_queue.cc:237] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } }
I20260709 13:11:00.062212  2055 catalog_manager.cc:5697] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.169064  2234 raft_consensus.cc:1275] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.170511  3314 consensus_queue.cc:1048] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.180709  2377 raft_consensus.cc:1275] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.182070  3314 consensus_queue.cc:1048] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.268502  2231 raft_consensus.cc:1275] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.269797  3299 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.286993  2375 raft_consensus.cc:1275] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.288594  3299 consensus_queue.cc:1048] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.321800  2375 raft_consensus.cc:1275] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.323948  3295 consensus_queue.cc:1048] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.335507  2231 raft_consensus.cc:1275] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer d815906ba3ba41ef8887f7e5b261553f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.337100  3295 consensus_queue.cc:1048] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.373624  2231 raft_consensus.cc:1275] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.374804  3299 consensus_queue.cc:1048] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.384563  2375 raft_consensus.cc:1275] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.386015  3309 consensus_queue.cc:1048] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.476217  2231 raft_consensus.cc:1275] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.477120  2302 raft_consensus.cc:1275] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.477664  3309 consensus_queue.cc:1048] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.479041  3309 consensus_queue.cc:1048] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d815906ba3ba41ef8887f7e5b261553f" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.541622 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.588829 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.625527  2375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e28571b869534957b019639a477450f6"
dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
mode: GRACEFUL
new_leader_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:45988
I20260709 13:11:00.626103  2375 raft_consensus.cc:606] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Received request to transfer leadership to TS e8b718068a784b5cabecfb16859665a4
I20260709 13:11:00.627305 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:00.628470 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.970849  3285 raft_consensus.cc:993] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: : Instructing follower e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:11:00.971271  3366 raft_consensus.cc:1081] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Signalling peer e8b718068a784b5cabecfb16859665a4 to start an election
I20260709 13:11:00.972553  3024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e28571b869534957b019639a477450f6"
dest_uuid: "e8b718068a784b5cabecfb16859665a4"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:11:00.973024  3024 raft_consensus.cc:493] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.973305  3024 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.978493  3024 raft_consensus.cc:515] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:00.980453  3024 leader_election.cc:290] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Requested vote from peers fd4fb5266da747deb5bece4024d936a7 (127.24.232.196:36647), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:11:00.980890  2375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4fb5266da747deb5bece4024d936a7"
I20260709 13:11:00.981324  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28571b869534957b019639a477450f6" candidate_uuid: "e8b718068a784b5cabecfb16859665a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "030f4f0790ed4737bfc5a454f29d1e67"
I20260709 13:11:00.981585  2375 raft_consensus.cc:3055] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.981856  2375 raft_consensus.cc:740] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4fb5266da747deb5bece4024d936a7, State: Running, Role: LEADER
I20260709 13:11:00.981859  2234 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.982501  2375 consensus_queue.cc:260] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:00.983354  2375 raft_consensus.cc:3060] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.987334  2234 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:11:00.988180  2375 raft_consensus.cc:2468] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b718068a784b5cabecfb16859665a4 in term 3.
I20260709 13:11:00.988837  2974 leader_election.cc:304] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4; no voters: 
I20260709 13:11:00.989735  3309 raft_consensus.cc:2804] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.990206  3309 raft_consensus.cc:697] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Becoming Leader. State: Replica: e8b718068a784b5cabecfb16859665a4, State: Running, Role: LEADER
I20260709 13:11:00.991115  3309 consensus_queue.cc:237] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:01.001856  2058 catalog_manager.cc:5697] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 reported cstate change: term changed from 2 to 3, leader changed from fd4fb5266da747deb5bece4024d936a7 (127.24.232.196) to e8b718068a784b5cabecfb16859665a4 (127.24.232.193). New cstate: current_term: 3 leader_uuid: "e8b718068a784b5cabecfb16859665a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.397866  2231 raft_consensus.cc:1275] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.399222  3299 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:01.428400  2375 raft_consensus.cc:1275] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Refusing update from remote peer e8b718068a784b5cabecfb16859665a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.429926  3299 consensus_queue.cc:1048] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:01.629326 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.667192 25507 tablet_server.cc:179] TabletServer@127.24.232.193:34297 shutting down...
W20260709 13:11:01.679282  2198 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 56 similar messages]
W20260709 13:11:01.684091  2198 consensus_peers.cc:597] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.703747  2272 consensus_peers.cc:597] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.705503 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:01.707216 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.708305 25507 raft_consensus.cc:2243] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.709286 25507 raft_consensus.cc:2272] T 6820d35ebf7d4653abe467f32fbfffb6 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.712086 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.713210 25507 raft_consensus.cc:2243] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.714184 25507 raft_consensus.cc:2272] T c5ec0fc46c1a4c17bfd2365bae887fef P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.716894 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.717801 25507 raft_consensus.cc:2243] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.718621 25507 raft_consensus.cc:2272] T e122c6caef20456896b39c5eef556a78 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.721351 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.722064 25507 raft_consensus.cc:2243] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.722646 25507 raft_consensus.cc:2272] T 3d8e58e88e0d4361b02e63a537424cfc P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.723635  2346 consensus_peers.cc:597] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.725214 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.725961 25507 raft_consensus.cc:2243] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.726589 25507 raft_consensus.cc:2272] T 180bf6c8966b4ff5893bcb6546af5b36 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.729595 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.730425 25507 raft_consensus.cc:2243] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.730888 25507 raft_consensus.cc:2272] T f9cf437aef6b4035aec14b3974a896ae P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.733071 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.733758 25507 raft_consensus.cc:2243] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.734720 25507 raft_consensus.cc:2272] T bd8e1edc577347899d4aaf8332c28496 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.737373 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.738125 25507 raft_consensus.cc:2243] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.738677 25507 raft_consensus.cc:2272] T 535d380792024fadb561b39a0e80f7e2 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.741478 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.742013 25507 raft_consensus.cc:2243] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.742411 25507 raft_consensus.cc:2272] T 1e7f38d8faec46fdb1b78d7295af42a6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.744472 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.745050 25507 raft_consensus.cc:2243] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.745462 25507 raft_consensus.cc:2272] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.747972 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.748723 25507 raft_consensus.cc:2243] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.749487 25507 raft_consensus.cc:2272] T f71948f18aa040a99d9fc9af3f14820a P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.751607 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.752279 25507 raft_consensus.cc:2243] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.753134 25507 raft_consensus.cc:2272] T ae6d76be90254ddb84a418f4fd751562 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.755290 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.755967 25507 raft_consensus.cc:2243] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.756374 25507 raft_consensus.cc:2272] T 78ff2c9d85f64480be1ad48eba7c6c5f P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.758466 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.759037 25507 raft_consensus.cc:2243] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.759802 25507 raft_consensus.cc:2272] T 791cf48580174beebd42190628c6d944 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.761765 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.762327 25507 raft_consensus.cc:2243] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.762758 25507 raft_consensus.cc:2272] T 3dbd1c2f69bb4a878a64daf5789d9019 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.765712 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.766535 25507 raft_consensus.cc:2243] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:01.767016  2198 consensus_peers.cc:597] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.767110 25507 raft_consensus.cc:2272] T 8204b768587944178ca101e068d964e2 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.768047  2346 consensus_peers.cc:597] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.770219 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.771106 25507 raft_consensus.cc:2243] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:01.771607  2198 consensus_peers.cc:597] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.771654 25507 raft_consensus.cc:2272] T 704c2648933e451e9a0ab0fcbdcc5d98 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.774070 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.774727 25507 raft_consensus.cc:2243] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.775211 25507 raft_consensus.cc:2272] T 9636aa4db950425481239f3d2214245b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.777308 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.777899 25507 raft_consensus.cc:2243] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.778321 25507 raft_consensus.cc:2272] T 81f14baaa48c49a7af6015e316412405 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.781247 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.781978 25507 raft_consensus.cc:2243] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.782526 25507 raft_consensus.cc:2272] T 3764b04f0489440686b563e22556a4f7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.785617 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.786209 25507 raft_consensus.cc:2243] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.786610 25507 raft_consensus.cc:2272] T 9c9cb1963d1649f18a1c6256fd4810f0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.789502 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.790431 25507 raft_consensus.cc:2243] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.790970 25507 raft_consensus.cc:2272] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.791558  2272 consensus_peers.cc:597] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.792371  2272 consensus_peers.cc:597] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.793644 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.794288 25507 raft_consensus.cc:2243] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.794675 25507 raft_consensus.cc:2272] T cd4827539b954a14b8ce1a0ca348a353 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.796981 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.797499 25507 raft_consensus.cc:2243] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.798230 25507 raft_consensus.cc:2272] T 5fc5d31cd8714661a570f28b72be8656 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.801028 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.801779 25507 raft_consensus.cc:2243] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.802740 25507 raft_consensus.cc:2272] T 442d06e6435f447e80ad1a730f3cd755 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.803741  2198 consensus_peers.cc:597] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.805049 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.805691 25507 raft_consensus.cc:2243] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.806155 25507 raft_consensus.cc:2272] T 5cfb558f11c34f60a165af99c68f3702 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.809000 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.809700 25507 raft_consensus.cc:2243] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.810213 25507 raft_consensus.cc:2272] T 6081d30467784ede9c3e7fb12625e0f1 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.813141 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.813889 25507 raft_consensus.cc:2243] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.814385 25507 raft_consensus.cc:2272] T 1c2da80d88594f89a913a340eea355d9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.817066 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.817826 25507 raft_consensus.cc:2243] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.818307 25507 raft_consensus.cc:2272] T 1726a2fe283241b4a1435cf7f96f4bf7 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.821173 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.821928 25507 raft_consensus.cc:2243] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.822469 25507 raft_consensus.cc:2272] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.823688  2346 consensus_peers.cc:597] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.825052 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.825713 25507 raft_consensus.cc:2243] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.826129 25507 raft_consensus.cc:2272] T ba7611fef54f45fc86c75f42ba1d83cc P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.828265 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.828848 25507 raft_consensus.cc:2243] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.829296 25507 raft_consensus.cc:2272] T 816062140ff0488493bee4a5d1a50872 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.831547 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.832126 25507 raft_consensus.cc:2243] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.832894 25507 raft_consensus.cc:2272] T 70e196c60e9b45efa369f89f86c94fba P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.834812 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.835358 25507 raft_consensus.cc:2243] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.835819 25507 raft_consensus.cc:2272] T 9bfe584445644027a6adf14def8b44f9 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.837972 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.838536 25507 raft_consensus.cc:2243] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.839035 25507 raft_consensus.cc:2272] T ebfdf679af35482aae92603bd8daea67 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.841426 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.841888 25507 raft_consensus.cc:2243] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.842257 25507 raft_consensus.cc:2272] T 035e31f9034b4c46beab764ce654d702 P e8b718068a784b5cabecfb16859665a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.844744 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.845471 25507 raft_consensus.cc:2243] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.845924 25507 raft_consensus.cc:2272] T 8715de42fd7d4b2b825e082594d4a654 P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.848877 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.849732 25507 raft_consensus.cc:2243] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.850339 25507 raft_consensus.cc:2272] T b7ae74c702234728abca428ef7868d6a P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.853173 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.853906 25507 raft_consensus.cc:2243] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.854730 25507 raft_consensus.cc:2272] T acf0b0e9a47d459fbfb6ddbe46c0775d P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.854920  2346 consensus_peers.cc:597] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.856760 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.857388 25507 raft_consensus.cc:2243] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.858115 25507 raft_consensus.cc:2272] T e28571b869534957b019639a477450f6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.860584 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.861295 25507 raft_consensus.cc:2243] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.862138 25507 raft_consensus.cc:2272] T d3eb1da29ee2465dbde39c0fbab92e02 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.864494 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.864953 25507 raft_consensus.cc:2243] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.865610 25507 raft_consensus.cc:2272] T 735fe428615d4151ba9722c729b057c6 P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.867573 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.868182 25507 raft_consensus.cc:2243] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.868602 25507 raft_consensus.cc:2272] T 0ad318e5e24a45798f5fb6553649cf1b P e8b718068a784b5cabecfb16859665a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.870560 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.871032 25507 raft_consensus.cc:2243] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.871817 25507 raft_consensus.cc:2272] T ce0fc298147e494fadd29bc6f429c1f8 P e8b718068a784b5cabecfb16859665a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.873695 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:01.874297 25507 raft_consensus.cc:2243] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.874801 25507 raft_consensus.cc:2272] T 62d3ef1464da4fef82b6b02de793694c P e8b718068a784b5cabecfb16859665a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.884523  2198 consensus_peers.cc:597] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.887084  2346 consensus_peers.cc:597] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.894178  2198 consensus_peers.cc:597] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.913661  2272 consensus_peers.cc:597] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.913964  2346 consensus_peers.cc:597] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.922549  2346 consensus_peers.cc:597] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.945734  2272 consensus_peers.cc:597] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.955524 25507 tablet_server.cc:196] TabletServer@127.24.232.193:34297 shutdown complete.
W20260709 13:11:01.969913  2346 consensus_peers.cc:597] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.972080  2346 consensus_peers.cc:597] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.997565  2272 consensus_peers.cc:597] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.014988  2198 consensus_peers.cc:597] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.027486  2346 consensus_peers.cc:597] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.036935  2198 consensus_peers.cc:597] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.060707 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
W20260709 13:11:02.060803  2346 consensus_peers.cc:597] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.081598  2272 consensus_peers.cc:597] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.092538  2198 consensus_peers.cc:597] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.111955 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:02.112795 25507 tablet_replica.cc:333] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.113477 25507 raft_consensus.cc:2243] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.114001 25507 raft_consensus.cc:2272] T e28571b869534957b019639a477450f6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.116436 25507 tablet_replica.cc:333] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.117010 25507 raft_consensus.cc:2243] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.117854 25507 raft_consensus.cc:2272] T 3764b04f0489440686b563e22556a4f7 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.120005 25507 tablet_replica.cc:333] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.120555 25507 raft_consensus.cc:2243] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.120930 25507 raft_consensus.cc:2272] T 322c5581771740d3b4fcf69409b0bef2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.123128 25507 tablet_replica.cc:333] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.123910 25507 raft_consensus.cc:2243] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.124900 25507 raft_consensus.cc:2272] T 9c9cb1963d1649f18a1c6256fd4810f0 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.127007  2198 consensus_peers.cc:597] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.127790 25507 tablet_replica.cc:333] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
W20260709 13:11:02.128014  2349 consensus_peers.cc:597] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.128554 25507 raft_consensus.cc:2243] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.129148 25507 raft_consensus.cc:2272] T f71948f18aa040a99d9fc9af3f14820a P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.130229  2349 consensus_peers.cc:597] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.131781 25507 tablet_replica.cc:333] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.132664 25507 raft_consensus.cc:2243] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.133226 25507 raft_consensus.cc:2272] T 442d06e6435f447e80ad1a730f3cd755 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.134379  2349 consensus_peers.cc:597] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.136773 25507 tablet_replica.cc:333] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.137418 25507 raft_consensus.cc:2243] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.137828 25507 raft_consensus.cc:2272] T 5fc5d31cd8714661a570f28b72be8656 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.139735 25507 tablet_replica.cc:333] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.140343 25507 raft_consensus.cc:2243] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.140758 25507 raft_consensus.cc:2272] T 70e196c60e9b45efa369f89f86c94fba P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.142585 25507 tablet_replica.cc:333] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.143129 25507 raft_consensus.cc:2243] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.143982 25507 raft_consensus.cc:2272] T c66d9240adb241b7a06f6b87f810a07d P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.146469 25507 tablet_replica.cc:333] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.147222 25507 raft_consensus.cc:2243] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.147737 25507 raft_consensus.cc:2272] T bd8e1edc577347899d4aaf8332c28496 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.150360 25507 tablet_replica.cc:333] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.151167 25507 raft_consensus.cc:2243] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.151732 25507 raft_consensus.cc:2272] T 1c273a3ff30d4d62834d75d88cd4a1f3 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.152253  2272 consensus_peers.cc:597] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f -> Peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Couldn't send request to peer e8b718068a784b5cabecfb16859665a4. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.154335 25507 tablet_replica.cc:333] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.155288 25507 raft_consensus.cc:2243] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.155939 25507 raft_consensus.cc:2272] T 0ad318e5e24a45798f5fb6553649cf1b P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.158371 25507 tablet_replica.cc:333] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.158946 25507 raft_consensus.cc:2243] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.159842 25507 raft_consensus.cc:2272] T 8204b768587944178ca101e068d964e2 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.161738 25507 tablet_replica.cc:333] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.162282 25507 raft_consensus.cc:2243] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.162662 25507 raft_consensus.cc:2272] T 6a1947b4022a46aab1955bb0dce5dd55 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.164716 25507 tablet_replica.cc:333] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.165231 25507 raft_consensus.cc:2243] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.165591 25507 raft_consensus.cc:2272] T 791cf48580174beebd42190628c6d944 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.167570 25507 tablet_replica.cc:333] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.168198 25507 raft_consensus.cc:2243] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.168928 25507 raft_consensus.cc:2272] T 78ff2c9d85f64480be1ad48eba7c6c5f P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.170879 25507 tablet_replica.cc:333] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.171360 25507 raft_consensus.cc:2243] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.171818 25507 raft_consensus.cc:2272] T ebfdf679af35482aae92603bd8daea67 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.173645 25507 tablet_replica.cc:333] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.174139 25507 raft_consensus.cc:2243] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.174930 25507 raft_consensus.cc:2272] T 035e31f9034b4c46beab764ce654d702 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.176909 25507 tablet_replica.cc:333] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.177551 25507 raft_consensus.cc:2243] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.178043 25507 raft_consensus.cc:2272] T 9bfe584445644027a6adf14def8b44f9 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.180155 25507 tablet_replica.cc:333] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.180691 25507 raft_consensus.cc:2243] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.181111 25507 raft_consensus.cc:2272] T ce0fc298147e494fadd29bc6f429c1f8 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.182888 25507 tablet_replica.cc:333] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.183413 25507 raft_consensus.cc:2243] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.184182 25507 raft_consensus.cc:2272] T 62d3ef1464da4fef82b6b02de793694c P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.186146 25507 tablet_replica.cc:333] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.186803 25507 raft_consensus.cc:2243] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.187280 25507 raft_consensus.cc:2272] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.189640 25507 tablet_replica.cc:333] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.190416 25507 raft_consensus.cc:2243] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:02.190424  2275 consensus_peers.cc:597] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.191617 25507 raft_consensus.cc:2272] T d37f7d5b1467469b8122fa8393d571c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.194319 25507 tablet_replica.cc:333] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.194942 25507 raft_consensus.cc:2243] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.195371 25507 raft_consensus.cc:2272] T fc8f4ba6025b41a5b7acfa364c00c104 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.197654 25507 tablet_replica.cc:333] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.198299 25507 raft_consensus.cc:2243] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.198829 25507 raft_consensus.cc:2272] T d3ff066c4d7042ddace1185779bcfc97 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.201293 25507 tablet_replica.cc:333] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.202116 25507 raft_consensus.cc:2243] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.203120 25507 raft_consensus.cc:2272] T f9cf437aef6b4035aec14b3974a896ae P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.205691 25507 tablet_replica.cc:333] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.206451 25507 raft_consensus.cc:2243] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.206949 25507 raft_consensus.cc:2272] T 76f4f333411941d4b67259070a4d9fd5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.209702 25507 tablet_replica.cc:333] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.210490 25507 raft_consensus.cc:2243] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.211401 25507 raft_consensus.cc:2272] T ba7611fef54f45fc86c75f42ba1d83cc P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.214128 25507 tablet_replica.cc:333] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.214821 25507 raft_consensus.cc:2243] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.215791 25507 raft_consensus.cc:2272] T 816062140ff0488493bee4a5d1a50872 P 030f4f0790ed4737bfc5a454f29d1e67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.218240 25507 tablet_replica.cc:333] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.218881 25507 raft_consensus.cc:2243] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.219841 25507 raft_consensus.cc:2272] T 6b477970d0584d3db6ce2eccbfc45617 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.221426  2349 consensus_peers.cc:597] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.222236 25507 tablet_replica.cc:333] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.223130 25507 raft_consensus.cc:2243] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.223591 25507 raft_consensus.cc:2272] T a3e5799014e34cefa5db5e5147740a98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.225901 25507 tablet_replica.cc:333] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.226647 25507 raft_consensus.cc:2243] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.227214 25507 raft_consensus.cc:2272] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.230003 25507 tablet_replica.cc:333] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.230773 25507 raft_consensus.cc:2243] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:02.231225  2275 consensus_peers.cc:597] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.231629 25507 raft_consensus.cc:2272] T 3d8e58e88e0d4361b02e63a537424cfc P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.233723 25507 tablet_replica.cc:333] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.234293 25507 raft_consensus.cc:2243] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.234706 25507 raft_consensus.cc:2272] T e122c6caef20456896b39c5eef556a78 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.237021 25507 tablet_replica.cc:333] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.237672 25507 raft_consensus.cc:2243] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.238298 25507 raft_consensus.cc:2272] T 704c2648933e451e9a0ab0fcbdcc5d98 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.240860 25507 tablet_replica.cc:333] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.241462 25507 raft_consensus.cc:2243] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.241885 25507 raft_consensus.cc:2272] T 25d2543e217d4435ac6c5d4291853933 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.244171 25507 tablet_replica.cc:333] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.244882 25507 raft_consensus.cc:2243] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.245389 25507 raft_consensus.cc:2272] T 6820d35ebf7d4653abe467f32fbfffb6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.247654  2349 consensus_peers.cc:597] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.247934 25507 tablet_replica.cc:333] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.248772 25507 raft_consensus.cc:2243] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.249821 25507 raft_consensus.cc:2272] T e79c83b7c75f4271b2a7814b1cc83f25 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.252621 25507 tablet_replica.cc:333] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
W20260709 13:11:02.252954  2275 consensus_peers.cc:597] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.253337 25507 raft_consensus.cc:2243] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.253921 25507 raft_consensus.cc:2272] T c5ec0fc46c1a4c17bfd2365bae887fef P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.256791 25507 tablet_replica.cc:333] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.257504 25507 raft_consensus.cc:2243] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.258056 25507 raft_consensus.cc:2272] T 735fe428615d4151ba9722c729b057c6 P 030f4f0790ed4737bfc5a454f29d1e67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.260696 25507 tablet_replica.cc:333] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.261368 25507 raft_consensus.cc:2243] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.261925 25507 raft_consensus.cc:2272] T d3eb1da29ee2465dbde39c0fbab92e02 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.264187 25507 tablet_replica.cc:333] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.264784 25507 raft_consensus.cc:2243] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.265224 25507 raft_consensus.cc:2272] T ae6d76be90254ddb84a418f4fd751562 P 030f4f0790ed4737bfc5a454f29d1e67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.267481 25507 tablet_replica.cc:333] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.268018 25507 raft_consensus.cc:2243] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.268440 25507 raft_consensus.cc:2272] T 4ccaafad28af45a6b734656bd19362b5 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.270298 25507 tablet_replica.cc:333] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67: stopping tablet replica
I20260709 13:11:02.270782 25507 raft_consensus.cc:2243] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.271494 25507 raft_consensus.cc:2272] T 81f14baaa48c49a7af6015e316412405 P 030f4f0790ed4737bfc5a454f29d1e67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.293553  2349 consensus_peers.cc:597] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.301081  2275 consensus_peers.cc:597] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.326618  2199 connection.cc:466] server connection from 127.0.0.1:58440 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58440 (request call id 248) could send its response
W20260709 13:11:02.327807  2275 consensus_peers.cc:597] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Network error: recv got EOF from 127.24.232.194:46655 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.374925  2275 consensus_peers.cc:597] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.383381 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
W20260709 13:11:02.386837  2275 consensus_peers.cc:597] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.402184  2275 consensus_peers.cc:597] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.468219 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
W20260709 13:11:02.520968  2347 consensus_peers.cc:597] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.521668  2349 consensus_peers.cc:597] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 -> Peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Couldn't send request to peer 030f4f0790ed4737bfc5a454f29d1e67. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.535818 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:02.536814 25507 tablet_replica.cc:333] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.537736 25507 raft_consensus.cc:2243] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.538305 25507 raft_consensus.cc:2272] T 3764b04f0489440686b563e22556a4f7 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.541286 25507 tablet_replica.cc:333] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.542107 25507 raft_consensus.cc:2243] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.543135 25507 raft_consensus.cc:2272] T 322c5581771740d3b4fcf69409b0bef2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.546051 25507 tablet_replica.cc:333] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.546669 25507 raft_consensus.cc:2243] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.547094 25507 raft_consensus.cc:2272] T 1726a2fe283241b4a1435cf7f96f4bf7 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.549341 25507 tablet_replica.cc:333] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.549906 25507 raft_consensus.cc:2243] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.550345 25507 raft_consensus.cc:2272] T f71948f18aa040a99d9fc9af3f14820a P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.552318 25507 tablet_replica.cc:333] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.552934 25507 raft_consensus.cc:2243] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.553340 25507 raft_consensus.cc:2272] T 5cfb558f11c34f60a165af99c68f3702 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.555204 25507 tablet_replica.cc:333] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.555825 25507 raft_consensus.cc:2243] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.556205 25507 raft_consensus.cc:2272] T 442d06e6435f447e80ad1a730f3cd755 P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.557931 25507 tablet_replica.cc:333] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.558485 25507 raft_consensus.cc:2243] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.558877 25507 raft_consensus.cc:2272] T 5fc5d31cd8714661a570f28b72be8656 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.560674 25507 tablet_replica.cc:333] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.561185 25507 raft_consensus.cc:2243] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.561568 25507 raft_consensus.cc:2272] T 70e196c60e9b45efa369f89f86c94fba P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.563628 25507 tablet_replica.cc:333] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.564369 25507 raft_consensus.cc:2243] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.565121 25507 raft_consensus.cc:2272] T 180bf6c8966b4ff5893bcb6546af5b36 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.567188 25507 tablet_replica.cc:333] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.567783 25507 raft_consensus.cc:2243] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.568490 25507 raft_consensus.cc:2272] T 0ad318e5e24a45798f5fb6553649cf1b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.570750 25507 tablet_replica.cc:333] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.571267 25507 raft_consensus.cc:2243] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.571607 25507 raft_consensus.cc:2272] T c66d9240adb241b7a06f6b87f810a07d P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.573607 25507 tablet_replica.cc:333] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.574107 25507 raft_consensus.cc:2243] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.574465 25507 raft_consensus.cc:2272] T acf0b0e9a47d459fbfb6ddbe46c0775d P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.576252 25507 tablet_replica.cc:333] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.576858 25507 raft_consensus.cc:2243] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.577250 25507 raft_consensus.cc:2272] T b7ae74c702234728abca428ef7868d6a P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.579797 25507 tablet_replica.cc:333] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.580569 25507 raft_consensus.cc:2243] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.581090 25507 raft_consensus.cc:2272] T d37f7d5b1467469b8122fa8393d571c6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.584106 25507 tablet_replica.cc:333] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.584878 25507 raft_consensus.cc:2243] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.585407 25507 raft_consensus.cc:2272] T d3ff066c4d7042ddace1185779bcfc97 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.586284  2347 consensus_peers.cc:597] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.588289 25507 tablet_replica.cc:333] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.589071 25507 raft_consensus.cc:2243] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.589612 25507 raft_consensus.cc:2272] T fc8f4ba6025b41a5b7acfa364c00c104 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.592216 25507 tablet_replica.cc:333] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.592943 25507 raft_consensus.cc:2243] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.593806 25507 raft_consensus.cc:2272] T 1e7f38d8faec46fdb1b78d7295af42a6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.596305 25507 tablet_replica.cc:333] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.596933 25507 raft_consensus.cc:2243] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.597874 25507 raft_consensus.cc:2272] T 1c273a3ff30d4d62834d75d88cd4a1f3 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.598431  2347 consensus_peers.cc:597] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.600355 25507 tablet_replica.cc:333] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.601132 25507 raft_consensus.cc:2243] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:02.601348  2347 consensus_peers.cc:597] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.601666 25507 raft_consensus.cc:2272] T 3dbd1c2f69bb4a878a64daf5789d9019 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.603900 25507 tablet_replica.cc:333] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.604416 25507 raft_consensus.cc:2243] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.604773 25507 raft_consensus.cc:2272] T 8204b768587944178ca101e068d964e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.606598 25507 tablet_replica.cc:333] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.607273 25507 raft_consensus.cc:2243] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.608315 25507 raft_consensus.cc:2272] T 6a1947b4022a46aab1955bb0dce5dd55 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.611017 25507 tablet_replica.cc:333] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.611768 25507 raft_consensus.cc:2243] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.612322 25507 raft_consensus.cc:2272] T 78ff2c9d85f64480be1ad48eba7c6c5f P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.615121 25507 tablet_replica.cc:333] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.615866 25507 raft_consensus.cc:2243] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.616856 25507 raft_consensus.cc:2272] T cd4827539b954a14b8ce1a0ca348a353 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.619462 25507 tablet_replica.cc:333] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.620280 25507 raft_consensus.cc:2243] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.621167 25507 raft_consensus.cc:2272] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.623546 25507 tablet_replica.cc:333] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.624270 25507 raft_consensus.cc:2243] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.625270 25507 raft_consensus.cc:2272] T 9bfe584445644027a6adf14def8b44f9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.627849 25507 tablet_replica.cc:333] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.628592 25507 raft_consensus.cc:2243] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.629077 25507 raft_consensus.cc:2272] T 62d3ef1464da4fef82b6b02de793694c P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.630959 25507 tablet_replica.cc:333] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.631458 25507 raft_consensus.cc:2243] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.631889 25507 raft_consensus.cc:2272] T 6081d30467784ede9c3e7fb12625e0f1 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.633687 25507 tablet_replica.cc:333] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.634160 25507 raft_consensus.cc:2243] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.634581 25507 raft_consensus.cc:2272] T 1c2da80d88594f89a913a340eea355d9 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.636417 25507 tablet_replica.cc:333] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.636960 25507 raft_consensus.cc:2243] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.637392 25507 raft_consensus.cc:2272] T 6b477970d0584d3db6ce2eccbfc45617 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.639350 25507 tablet_replica.cc:333] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.639954 25507 raft_consensus.cc:2243] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.640805 25507 raft_consensus.cc:2272] T a3e5799014e34cefa5db5e5147740a98 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.643051 25507 tablet_replica.cc:333] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.643836 25507 raft_consensus.cc:2243] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.644348 25507 raft_consensus.cc:2272] T ae6d76be90254ddb84a418f4fd751562 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.644752  2347 consensus_peers.cc:597] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.646379 25507 tablet_replica.cc:333] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.646935 25507 raft_consensus.cc:2243] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.648020 25507 raft_consensus.cc:2272] T 76f4f333411941d4b67259070a4d9fd5 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.650904 25507 tablet_replica.cc:333] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.651737 25507 raft_consensus.cc:2243] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.652256 25507 raft_consensus.cc:2272] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.654912 25507 tablet_replica.cc:333] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
W20260709 13:11:02.655465  2347 consensus_peers.cc:597] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.655691 25507 raft_consensus.cc:2243] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:02.656226  2347 consensus_peers.cc:597] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.656270 25507 raft_consensus.cc:2272] T ba7611fef54f45fc86c75f42ba1d83cc P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.658466 25507 tablet_replica.cc:333] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.659022 25507 raft_consensus.cc:2243] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.659861 25507 raft_consensus.cc:2272] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.662160 25507 tablet_replica.cc:333] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.662720 25507 raft_consensus.cc:2243] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.663303 25507 raft_consensus.cc:2272] T c5ec0fc46c1a4c17bfd2365bae887fef P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.665884 25507 tablet_replica.cc:333] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.666589 25507 raft_consensus.cc:2243] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.667037 25507 raft_consensus.cc:2272] T e79c83b7c75f4271b2a7814b1cc83f25 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.669658 25507 tablet_replica.cc:333] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.670365 25507 raft_consensus.cc:2243] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.670822 25507 raft_consensus.cc:2272] T e122c6caef20456896b39c5eef556a78 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.672766 25507 tablet_replica.cc:333] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.673260 25507 raft_consensus.cc:2243] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.673995 25507 raft_consensus.cc:2272] T 9636aa4db950425481239f3d2214245b P d815906ba3ba41ef8887f7e5b261553f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.675804 25507 tablet_replica.cc:333] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.676249 25507 raft_consensus.cc:2243] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.676611 25507 raft_consensus.cc:2272] T 25d2543e217d4435ac6c5d4291853933 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.678505 25507 tablet_replica.cc:333] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.679031 25507 raft_consensus.cc:2243] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.679816 25507 raft_consensus.cc:2272] T 535d380792024fadb561b39a0e80f7e2 P d815906ba3ba41ef8887f7e5b261553f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.681820 25507 tablet_replica.cc:333] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.682396 25507 raft_consensus.cc:2243] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.682844 25507 raft_consensus.cc:2272] T 8715de42fd7d4b2b825e082594d4a654 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.685442 25507 tablet_replica.cc:333] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.686108 25507 raft_consensus.cc:2243] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.686622 25507 raft_consensus.cc:2272] T 4ccaafad28af45a6b734656bd19362b5 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.688673 25507 tablet_replica.cc:333] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f: stopping tablet replica
I20260709 13:11:02.689136 25507 raft_consensus.cc:2243] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.689571 25507 raft_consensus.cc:2272] T 81f14baaa48c49a7af6015e316412405 P d815906ba3ba41ef8887f7e5b261553f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.722097  2347 consensus_peers.cc:597] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.727290  2347 consensus_peers.cc:597] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.752605  2347 consensus_peers.cc:597] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.195:41011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.767349 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
W20260709 13:11:02.790752  2347 consensus_peers.cc:597] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.195:41011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.814253  3285 raft_consensus.cc:493] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:11:02.814749  3285 raft_consensus.cc:515] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:02.816656  3285 leader_election.cc:290] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
W20260709 13:11:02.827805  2349 leader_election.cc:336] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111)
W20260709 13:11:02.829960  2346 leader_election.cc:336] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111)
I20260709 13:11:02.830382  2346 leader_election.cc:304] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:11:02.831022  3285 raft_consensus.cc:2749] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.851231 25507 tablet_server.cc:179] TabletServer@127.24.232.196:0 shutting down...
W20260709 13:11:02.858337  2347 consensus_peers.cc:597] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 -> Peer d815906ba3ba41ef8887f7e5b261553f (127.24.232.195:41011): Couldn't send request to peer d815906ba3ba41ef8887f7e5b261553f. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.195:41011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.892887 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:02.893744 25507 tablet_replica.cc:333] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.894405 25507 raft_consensus.cc:2243] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.894866 25507 raft_consensus.cc:2272] T e28571b869534957b019639a477450f6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.896987 25507 tablet_replica.cc:333] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.897565 25507 raft_consensus.cc:2243] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.898350 25507 raft_consensus.cc:2272] T 5cfb558f11c34f60a165af99c68f3702 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.900382 25507 tablet_replica.cc:333] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.900933 25507 raft_consensus.cc:2243] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.901388 25507 raft_consensus.cc:2272] T 322c5581771740d3b4fcf69409b0bef2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.902354  3285 raft_consensus.cc:493] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:11:02.902824  3285 raft_consensus.cc:515] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:02.903988 25507 tablet_replica.cc:333] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.904884 25507 raft_consensus.cc:2243] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.905787  3285 leader_election.cc:290] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:11:02.905966 25507 raft_consensus.cc:2272] T 1726a2fe283241b4a1435cf7f96f4bf7 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.909001  2346 leader_election.cc:336] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111)
I20260709 13:11:02.909243 25507 tablet_replica.cc:333] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
W20260709 13:11:02.909710  2349 leader_election.cc:336] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111)
I20260709 13:11:02.910116 25507 raft_consensus.cc:2243] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.910131  2349 leader_election.cc:304] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:11:02.910809 25507 raft_consensus.cc:2272] T 3d8e58e88e0d4361b02e63a537424cfc P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.910985  3285 raft_consensus.cc:2749] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.913268 25507 tablet_replica.cc:333] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.913829 25507 raft_consensus.cc:2243] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.914566 25507 raft_consensus.cc:2272] T 4ccaafad28af45a6b734656bd19362b5 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.915366  3285 raft_consensus.cc:493] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8b718068a784b5cabecfb16859665a4)
I20260709 13:11:02.915838  3285 raft_consensus.cc:515] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4fb5266da747deb5bece4024d936a7" member_type: VOTER last_known_addr { host: "127.24.232.196" port: 36647 } } peers { permanent_uuid: "e8b718068a784b5cabecfb16859665a4" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 34297 } } peers { permanent_uuid: "030f4f0790ed4737bfc5a454f29d1e67" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46655 } }
I20260709 13:11:02.917042 25507 tablet_replica.cc:333] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.917832  3285 leader_election.cc:290] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297), 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655)
I20260709 13:11:02.917974 25507 raft_consensus.cc:2243] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.918612 25507 raft_consensus.cc:2272] T c66d9240adb241b7a06f6b87f810a07d P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.921535 25507 tablet_replica.cc:333] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
W20260709 13:11:02.921916  2346 leader_election.cc:336] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8b718068a784b5cabecfb16859665a4 (127.24.232.193:34297): Network error: Client connection negotiation failed: client connection to 127.24.232.193:34297: connect: Connection refused (error 111)
I20260709 13:11:02.922351 25507 raft_consensus.cc:2243] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:02.922590  2349 leader_election.cc:336] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 030f4f0790ed4737bfc5a454f29d1e67 (127.24.232.194:46655): Network error: Client connection negotiation failed: client connection to 127.24.232.194:46655: connect: Connection refused (error 111)
I20260709 13:11:02.923035  2349 leader_election.cc:304] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4fb5266da747deb5bece4024d936a7; no voters: 030f4f0790ed4737bfc5a454f29d1e67, e8b718068a784b5cabecfb16859665a4
I20260709 13:11:02.923061 25507 raft_consensus.cc:2272] T 180bf6c8966b4ff5893bcb6546af5b36 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.923635  3285 raft_consensus.cc:2749] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.925516 25507 tablet_replica.cc:333] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.926226 25507 raft_consensus.cc:2243] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.926756 25507 raft_consensus.cc:2272] T bd8e1edc577347899d4aaf8332c28496 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.929347 25507 tablet_replica.cc:333] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.930104 25507 raft_consensus.cc:2243] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.930635 25507 raft_consensus.cc:2272] T acf0b0e9a47d459fbfb6ddbe46c0775d P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.932544 25507 tablet_replica.cc:333] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.933128 25507 raft_consensus.cc:2243] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.933866 25507 raft_consensus.cc:2272] T b7ae74c702234728abca428ef7868d6a P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.935822 25507 tablet_replica.cc:333] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.936419 25507 raft_consensus.cc:2243] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.936861 25507 raft_consensus.cc:2272] T cd4827539b954a14b8ce1a0ca348a353 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.938786 25507 tablet_replica.cc:333] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.939308 25507 raft_consensus.cc:2243] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.939831 25507 raft_consensus.cc:2272] T d37f7d5b1467469b8122fa8393d571c6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.942360 25507 tablet_replica.cc:333] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.943125 25507 raft_consensus.cc:2243] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.944094 25507 raft_consensus.cc:2272] T fc8f4ba6025b41a5b7acfa364c00c104 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.946385 25507 tablet_replica.cc:333] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.946913 25507 raft_consensus.cc:2243] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.947618 25507 raft_consensus.cc:2272] T d3ff066c4d7042ddace1185779bcfc97 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.949632 25507 tablet_replica.cc:333] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.950141 25507 raft_consensus.cc:2243] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.950506 25507 raft_consensus.cc:2272] T d8b9d61ad9bc4e6dbfb3b264e1fc2805 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.952337 25507 tablet_replica.cc:333] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.952870 25507 raft_consensus.cc:2243] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.953311 25507 raft_consensus.cc:2272] T 535d380792024fadb561b39a0e80f7e2 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.955204 25507 tablet_replica.cc:333] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.955821 25507 raft_consensus.cc:2243] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.956254 25507 raft_consensus.cc:2272] T f9cf437aef6b4035aec14b3974a896ae P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.958139 25507 tablet_replica.cc:333] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.958678 25507 raft_consensus.cc:2243] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.959426 25507 raft_consensus.cc:2272] T 8715de42fd7d4b2b825e082594d4a654 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.961328 25507 tablet_replica.cc:333] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.961861 25507 raft_consensus.cc:2243] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.962641 25507 raft_consensus.cc:2272] T ebfdf679af35482aae92603bd8daea67 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.964738 25507 tablet_replica.cc:333] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.965293 25507 raft_consensus.cc:2243] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.965701 25507 raft_consensus.cc:2272] T 035e31f9034b4c46beab764ce654d702 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.967803 25507 tablet_replica.cc:333] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.968535 25507 raft_consensus.cc:2243] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.969039 25507 raft_consensus.cc:2272] T 76f4f333411941d4b67259070a4d9fd5 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.971576 25507 tablet_replica.cc:333] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.972376 25507 raft_consensus.cc:2243] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.973260 25507 raft_consensus.cc:2272] T 0a1f50d9d2d54028a40b1d72fb5a6bf0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.975122 25507 tablet_replica.cc:333] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.975628 25507 raft_consensus.cc:2243] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.976114 25507 raft_consensus.cc:2272] T 816062140ff0488493bee4a5d1a50872 P fd4fb5266da747deb5bece4024d936a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.977902 25507 tablet_replica.cc:333] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.978354 25507 raft_consensus.cc:2243] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.979015 25507 raft_consensus.cc:2272] T 6081d30467784ede9c3e7fb12625e0f1 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.980876 25507 tablet_replica.cc:333] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.981353 25507 raft_consensus.cc:2243] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.982008 25507 raft_consensus.cc:2272] T 1c2da80d88594f89a913a340eea355d9 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.983652 25507 tablet_replica.cc:333] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.984181 25507 raft_consensus.cc:2243] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.984609 25507 raft_consensus.cc:2272] T 6b477970d0584d3db6ce2eccbfc45617 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.986383 25507 tablet_replica.cc:333] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.986861 25507 raft_consensus.cc:2243] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.987205 25507 raft_consensus.cc:2272] T a3e5799014e34cefa5db5e5147740a98 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.989075 25507 tablet_replica.cc:333] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.989542 25507 raft_consensus.cc:2243] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.989892 25507 raft_consensus.cc:2272] T 6820d35ebf7d4653abe467f32fbfffb6 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.991576 25507 tablet_replica.cc:333] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.992102 25507 raft_consensus.cc:2243] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.992771 25507 raft_consensus.cc:2272] T f2e6f3e3a23c4711bd7d8c6f2a624e99 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.994510 25507 tablet_replica.cc:333] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.994958 25507 raft_consensus.cc:2243] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.995332 25507 raft_consensus.cc:2272] T ce0fc298147e494fadd29bc6f429c1f8 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.997141 25507 tablet_replica.cc:333] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:02.997664 25507 raft_consensus.cc:2243] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:02.998067 25507 raft_consensus.cc:2272] T 735fe428615d4151ba9722c729b057c6 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.999831 25507 tablet_replica.cc:333] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.000347 25507 raft_consensus.cc:2243] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.000756 25507 raft_consensus.cc:2272] T d3eb1da29ee2465dbde39c0fbab92e02 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.002351 25507 tablet_replica.cc:333] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.002868 25507 raft_consensus.cc:2243] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.003286 25507 raft_consensus.cc:2272] T e79c83b7c75f4271b2a7814b1cc83f25 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.005136 25507 tablet_replica.cc:333] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.005647 25507 raft_consensus.cc:2243] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:03.006398 25507 raft_consensus.cc:2272] T 704c2648933e451e9a0ab0fcbdcc5d98 P fd4fb5266da747deb5bece4024d936a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.008404 25507 tablet_replica.cc:333] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.008953 25507 raft_consensus.cc:2243] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.009379 25507 raft_consensus.cc:2272] T 9636aa4db950425481239f3d2214245b P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.011390 25507 tablet_replica.cc:333] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.011945 25507 raft_consensus.cc:2243] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:03.012660 25507 raft_consensus.cc:2272] T 25d2543e217d4435ac6c5d4291853933 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.014473 25507 tablet_replica.cc:333] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.014978 25507 raft_consensus.cc:2243] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.015359 25507 raft_consensus.cc:2272] T 1c273a3ff30d4d62834d75d88cd4a1f3 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.017249 25507 tablet_replica.cc:333] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.017776 25507 raft_consensus.cc:2243] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.018198 25507 raft_consensus.cc:2272] T 1e7f38d8faec46fdb1b78d7295af42a6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.020298 25507 tablet_replica.cc:333] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.020813 25507 raft_consensus.cc:2243] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.021200 25507 raft_consensus.cc:2272] T 9c9cb1963d1649f18a1c6256fd4810f0 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.023005 25507 tablet_replica.cc:333] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.023509 25507 raft_consensus.cc:2243] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.023967 25507 raft_consensus.cc:2272] T 9981aab8ad0c4366b6fb8bd99b57e6e6 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.025817 25507 tablet_replica.cc:333] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.026276 25507 raft_consensus.cc:2243] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:03.027043 25507 raft_consensus.cc:2272] T 3dbd1c2f69bb4a878a64daf5789d9019 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.029073 25507 tablet_replica.cc:333] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.029551 25507 raft_consensus.cc:2243] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.029973 25507 raft_consensus.cc:2272] T 6a1947b4022a46aab1955bb0dce5dd55 P fd4fb5266da747deb5bece4024d936a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.031849 25507 tablet_replica.cc:333] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7: stopping tablet replica
I20260709 13:11:03.032267 25507 raft_consensus.cc:2243] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:03.032668 25507 raft_consensus.cc:2272] T 791cf48580174beebd42190628c6d944 P fd4fb5266da747deb5bece4024d936a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.099875 25507 tablet_server.cc:196] TabletServer@127.24.232.196:0 shutdown complete.
I20260709 13:11:03.161041 25507 master.cc:562] Master@127.24.232.254:39959 shutting down...
I20260709 13:11:03.185504 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:03.186110 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.186457 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P aeb247cb566049d9a7cc92c0aae7dbb9: stopping tablet replica
I20260709 13:11:03.209600 25507 master.cc:584] Master@127.24.232.254:39959 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28630 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:11:03.301754 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:45001
I20260709 13:11:03.302945 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:03.309379  3406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.309343  3407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.310259  3409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:03.313705 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:03.315634 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:03.315903 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:03.316020 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602663316008 us; error 0 us; skew 500 ppm
I20260709 13:11:03.316493 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:03.318905 25507 webserver.cc:533] Webserver started at http://127.24.232.254:39275/ using document root <none> and password file <none>
I20260709 13:11:03.319384 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:03.319540 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:03.319852 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:03.321010 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "b76e5823daf54fef9d2faa6ab385c68d"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.325479 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:03.328826  3414 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.329677 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:03.330031 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "b76e5823daf54fef9d2faa6ab385c68d"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.330538 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:03.345394 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:03.346729 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:03.384996 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:45001
I20260709 13:11:03.385113  3465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:45001 every 8 connection(s)
I20260709 13:11:03.388970  3466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.399587  3466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d: Bootstrap starting.
I20260709 13:11:03.404525  3466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.408855  3466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d: No bootstrap required, opened a new log
I20260709 13:11:03.411060  3466 raft_consensus.cc:359] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER }
I20260709 13:11:03.411482  3466 raft_consensus.cc:385] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.411868  3466 raft_consensus.cc:740] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b76e5823daf54fef9d2faa6ab385c68d, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.412552  3466 consensus_queue.cc:260] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER }
I20260709 13:11:03.413025  3466 raft_consensus.cc:399] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:03.413234  3466 raft_consensus.cc:493] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:03.413532  3466 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.418349  3466 raft_consensus.cc:515] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER }
I20260709 13:11:03.418897  3466 leader_election.cc:304] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b76e5823daf54fef9d2faa6ab385c68d; no voters: 
I20260709 13:11:03.420156  3466 leader_election.cc:290] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:03.420519  3469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.421941  3469 raft_consensus.cc:697] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 1 LEADER]: Becoming Leader. State: Replica: b76e5823daf54fef9d2faa6ab385c68d, State: Running, Role: LEADER
I20260709 13:11:03.422663  3469 consensus_queue.cc:237] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER }
I20260709 13:11:03.423185  3466 sys_catalog.cc:565] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:03.427181  3470 sys_catalog.cc:455] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b76e5823daf54fef9d2faa6ab385c68d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER } }
I20260709 13:11:03.427906  3470 sys_catalog.cc:458] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:03.427899  3471 sys_catalog.cc:455] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b76e5823daf54fef9d2faa6ab385c68d. Latest consensus state: current_term: 1 leader_uuid: "b76e5823daf54fef9d2faa6ab385c68d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b76e5823daf54fef9d2faa6ab385c68d" member_type: VOTER } }
I20260709 13:11:03.430316  3471 sys_catalog.cc:458] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:03.431080  3476 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:03.437878  3476 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:03.439303 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:03.447095  3476 catalog_manager.cc:1383] Generated new cluster ID: 2c9d630fd2ef494eba34086327451e89
I20260709 13:11:03.447412  3476 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:03.469352  3476 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:03.470616  3476 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:03.482016  3476 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d: Generated new TSK 0
I20260709 13:11:03.482640  3476 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:03.524564 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:03.533475  3487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.541658  3488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.544191  3490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:03.545004 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:03.546319 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:03.546577 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:03.546787 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602663546769 us; error 0 us; skew 500 ppm
I20260709 13:11:03.547514 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:03.552347 25507 webserver.cc:533] Webserver started at http://127.24.232.193:46723/ using document root <none> and password file <none>
I20260709 13:11:03.553017 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:03.553256 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:03.553642 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:03.558547 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "5be1dca7fa934c32847f9cbf201a647d"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.565276 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:03.570685  3495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.571914 25507 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:11:03.572316 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "5be1dca7fa934c32847f9cbf201a647d"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.572626 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:03.587013 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:03.588392 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:03.589917 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:03.592312 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:03.592506 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.592976 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:03.593179 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.635418 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:36105
I20260709 13:11:03.635529  3557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:36105 every 8 connection(s)
I20260709 13:11:03.640439 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:03.647645  3562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.649705  3563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.650975  3565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:03.652000 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:03.653302 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:03.653538 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:03.653733 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602663653715 us; error 0 us; skew 500 ppm
I20260709 13:11:03.654278 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:03.656774 25507 webserver.cc:533] Webserver started at http://127.24.232.194:38717/ using document root <none> and password file <none>
I20260709 13:11:03.657333 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:03.657596 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:03.657923 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:03.659236 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.659969  3558 heartbeater.cc:344] Connected to a master server at 127.24.232.254:45001
I20260709 13:11:03.660384  3558 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:03.661110  3558 heartbeater.cc:507] Master 127.24.232.254:45001 requested a full tablet report, sending...
I20260709 13:11:03.663395  3431 ts_manager.cc:194] Registered new tserver with Master: 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105)
I20260709 13:11:03.664837 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:03.665887  3431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58808
I20260709 13:11:03.669299  3570 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.670156 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:03.670487 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.670778 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:03.707793 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:03.709038 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:03.710530 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:03.712962 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:03.713194 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.713464 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:03.713646 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.755281 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:40323
I20260709 13:11:03.755381  3632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:40323 every 8 connection(s)
I20260709 13:11:03.760377 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:03.767732  3636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.769511  3637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:03.772894  3639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:03.773626  3633 heartbeater.cc:344] Connected to a master server at 127.24.232.254:45001
I20260709 13:11:03.773779 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:03.774194  3633 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:03.774955 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:03.775045  3633 heartbeater.cc:507] Master 127.24.232.254:45001 requested a full tablet report, sending...
W20260709 13:11:03.775220 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:03.775599 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602663775580 us; error 0 us; skew 500 ppm
I20260709 13:11:03.776274 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:03.777654  3431 ts_manager.cc:194] Registered new tserver with Master: a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:03.779042 25507 webserver.cc:533] Webserver started at http://127.24.232.195:42157/ using document root <none> and password file <none>
I20260709 13:11:03.779644  3431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58816
I20260709 13:11:03.779793 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:03.780175 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:03.780516 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:03.781801 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "d557ee59894049b3990264a4c37f7500"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.786499 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:03.789992  3644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.790831 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:03.791157 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "d557ee59894049b3990264a4c37f7500"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:03.791481 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:03.807512 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:03.808795 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:03.810304 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:03.812748 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:03.812975 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.813216 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:03.813398 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:03.856179 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:45579
I20260709 13:11:03.856285  3706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:45579 every 8 connection(s)
I20260709 13:11:03.869730  3707 heartbeater.cc:344] Connected to a master server at 127.24.232.254:45001
I20260709 13:11:03.870204  3707 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:03.870947  3707 heartbeater.cc:507] Master 127.24.232.254:45001 requested a full tablet report, sending...
I20260709 13:11:03.872918  3431 ts_manager.cc:194] Registered new tserver with Master: d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:03.874070 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014701998s
I20260709 13:11:03.874366  3431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58820
I20260709 13:11:03.900745  3431 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58836:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:03.903738  3431 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:03.982345  3523 tablet_service.cc:1511] Processing CreateTablet for tablet 596627a990884ddf8125677b30c7494e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:03.983076  3521 tablet_service.cc:1511] Processing CreateTablet for tablet c652ee924483475ca112a24c297bfcea (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:03.984757  3522 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf136ca2fa471e82170cffb900d09b (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:03.985344  3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596627a990884ddf8125677b30c7494e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.986248  3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf136ca2fa471e82170cffb900d09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.987121  3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652ee924483475ca112a24c297bfcea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.987291  3520 tablet_service.cc:1511] Processing CreateTablet for tablet 9702a47174ef44a48434c2ff36e7f245 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:03.988710  3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702a47174ef44a48434c2ff36e7f245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.988817  3598 tablet_service.cc:1511] Processing CreateTablet for tablet 596627a990884ddf8125677b30c7494e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:03.990173  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596627a990884ddf8125677b30c7494e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.993433  3597 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf136ca2fa471e82170cffb900d09b (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:03.994933  3597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf136ca2fa471e82170cffb900d09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.996901  3596 tablet_service.cc:1511] Processing CreateTablet for tablet c652ee924483475ca112a24c297bfcea (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:03.998313  3596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652ee924483475ca112a24c297bfcea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.017395  3723 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.016803  3672 tablet_service.cc:1511] Processing CreateTablet for tablet 596627a990884ddf8125677b30c7494e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:04.018708  3672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596627a990884ddf8125677b30c7494e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.020097  3671 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf136ca2fa471e82170cffb900d09b (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:04.022078  3671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf136ca2fa471e82170cffb900d09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.025391  3670 tablet_service.cc:1511] Processing CreateTablet for tablet c652ee924483475ca112a24c297bfcea (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:04.025409  3598 tablet_service.cc:1511] Processing CreateTablet for tablet 9702a47174ef44a48434c2ff36e7f245 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:04.029219  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702a47174ef44a48434c2ff36e7f245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.032418  3669 tablet_service.cc:1511] Processing CreateTablet for tablet 9702a47174ef44a48434c2ff36e7f245 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:04.033254  3670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652ee924483475ca112a24c297bfcea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.034132  3669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702a47174ef44a48434c2ff36e7f245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.038570  3519 tablet_service.cc:1511] Processing CreateTablet for tablet b412602c04244351820e62951d13f4f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:04.040372  3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412602c04244351820e62951d13f4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.041410  3723 tablet_bootstrap.cc:654] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.077476  3672 tablet_service.cc:1511] Processing CreateTablet for tablet b412602c04244351820e62951d13f4f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:04.079007  3672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412602c04244351820e62951d13f4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.081324  3595 tablet_service.cc:1511] Processing CreateTablet for tablet 538572c5a2274d4cafd1f87db55381f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:04.081881  3518 tablet_service.cc:1511] Processing CreateTablet for tablet 538572c5a2274d4cafd1f87db55381f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:04.082827  3595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538572c5a2274d4cafd1f87db55381f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.083285  3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538572c5a2274d4cafd1f87db55381f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.090974  3668 tablet_service.cc:1511] Processing CreateTablet for tablet 538572c5a2274d4cafd1f87db55381f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:04.092554  3668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538572c5a2274d4cafd1f87db55381f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.096175  3594 tablet_service.cc:1511] Processing CreateTablet for tablet 455e11add10b4cf3b082b0c5fe8f874e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:04.098850  3516 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7596a1c7974891a61bcffa19486290 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:04.100894  3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7596a1c7974891a61bcffa19486290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.100782  3596 tablet_service.cc:1511] Processing CreateTablet for tablet b412602c04244351820e62951d13f4f4 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:04.101066  3593 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7596a1c7974891a61bcffa19486290 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:04.102442  3596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412602c04244351820e62951d13f4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.103648  3593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7596a1c7974891a61bcffa19486290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.092563  3517 tablet_service.cc:1511] Processing CreateTablet for tablet 455e11add10b4cf3b082b0c5fe8f874e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:04.105821  3672 tablet_service.cc:1511] Processing CreateTablet for tablet 455e11add10b4cf3b082b0c5fe8f874e (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:04.106338  3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e11add10b4cf3b082b0c5fe8f874e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.107157  3672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e11add10b4cf3b082b0c5fe8f874e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.108338  3594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e11add10b4cf3b082b0c5fe8f874e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.109669  3671 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7596a1c7974891a61bcffa19486290 (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:04.111022  3671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7596a1c7974891a61bcffa19486290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.111191  3515 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd2ebb61e2b48b4994d258f6f4b251a (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:04.113482  3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd2ebb61e2b48b4994d258f6f4b251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.163017  3723 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.163621  3723 ts_tablet_manager.cc:1403] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.003s
I20260709 13:11:04.169627  3724 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.172287  3723 raft_consensus.cc:359] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.173028  3723 raft_consensus.cc:385] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.173251  3723 raft_consensus.cc:740] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.173904  3723 consensus_queue.cc:260] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.176221  3722 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.177505  3724 tablet_bootstrap.cc:654] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.182914  3598 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd2ebb61e2b48b4994d258f6f4b251a (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:04.184538  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd2ebb61e2b48b4994d258f6f4b251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.185989  3668 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd2ebb61e2b48b4994d258f6f4b251a (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:04.187367  3668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd2ebb61e2b48b4994d258f6f4b251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.194571  3722 tablet_bootstrap.cc:654] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.196034  3522 tablet_service.cc:1511] Processing CreateTablet for tablet 675cf94f10314d5696a4a225e696914f (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:04.197535  3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675cf94f10314d5696a4a225e696914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.216353  3724 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.216955  3724 ts_tablet_manager.cc:1403] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.016s
I20260709 13:11:04.217166  3598 tablet_service.cc:1511] Processing CreateTablet for tablet 675cf94f10314d5696a4a225e696914f (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:04.218483  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675cf94f10314d5696a4a225e696914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.220042  3723 ts_tablet_manager.cc:1434] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.014s
I20260709 13:11:04.221069  3633 heartbeater.cc:499] Master 127.24.232.254:45001 was elected leader, sending a full tablet report...
I20260709 13:11:04.221575  3723 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.218510  3669 tablet_service.cc:1511] Processing CreateTablet for tablet 675cf94f10314d5696a4a225e696914f (DEFAULT_TABLE table=test-workload [id=e76abcaf3e244af4a669aa6a80610553]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:04.226146  3669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675cf94f10314d5696a4a225e696914f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.238372  3724 raft_consensus.cc:359] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.239624  3724 raft_consensus.cc:385] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.239995  3724 raft_consensus.cc:740] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.243012  3724 consensus_queue.cc:260] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.247143  3722 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.248039  3722 ts_tablet_manager.cc:1403] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.007s
I20260709 13:11:04.254518  3722 raft_consensus.cc:359] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.255265  3722 raft_consensus.cc:385] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.255602  3722 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.259526  3723 tablet_bootstrap.cc:654] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.259790  3726 raft_consensus.cc:493] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.260416  3726 raft_consensus.cc:515] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.263923  3722 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.273442  3726 leader_election.cc:290] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.287075  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
W20260709 13:11:04.299104  3574 leader_election.cc:343] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.309990  3558 heartbeater.cc:499] Master 127.24.232.254:45001 was elected leader, sending a full tablet report...
I20260709 13:11:04.310814  3723 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.311400  3723 ts_tablet_manager.cc:1403] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.090s	user 0.025s	sys 0.031s
I20260709 13:11:04.314641  3723 raft_consensus.cc:359] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.315608  3707 heartbeater.cc:499] Master 127.24.232.254:45001 was elected leader, sending a full tablet report...
I20260709 13:11:04.316187  3724 ts_tablet_manager.cc:1434] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.099s	user 0.046s	sys 0.032s
I20260709 13:11:04.317392  3724 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.318053  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
W20260709 13:11:04.320217  3571 leader_election.cc:343] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.320771  3571 leader_election.cc:304] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02; no voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500
I20260709 13:11:04.321874  3726 raft_consensus.cc:2749] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.324648  3724 tablet_bootstrap.cc:654] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.315620  3723 raft_consensus.cc:385] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.325223  3723 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.326188  3723 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.328569  3723 ts_tablet_manager.cc:1434] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:11:04.329702  3723 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.333348  3726 raft_consensus.cc:493] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.333957  3726 raft_consensus.cc:515] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.334591  3722 ts_tablet_manager.cc:1434] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.003s
I20260709 13:11:04.335796  3722 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.336200  3726 leader_election.cc:290] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.336954  3723 tablet_bootstrap.cc:654] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.337105  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.337419  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.337886  3533 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 0.
I20260709 13:11:04.338586  3724 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
W20260709 13:11:04.339025  3574 leader_election.cc:343] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.339178  3724 ts_tablet_manager.cc:1403] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:11:04.339790  3571 leader_election.cc:304] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: d557ee59894049b3990264a4c37f7500
I20260709 13:11:04.341187  3726 raft_consensus.cc:2804] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.341599  3726 raft_consensus.cc:493] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.342092  3726 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.342913  3724 raft_consensus.cc:359] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.343786  3724 raft_consensus.cc:385] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.344094  3724 raft_consensus.cc:740] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.345101  3724 consensus_queue.cc:260] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.347646  3724 ts_tablet_manager.cc:1434] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:04.348758  3724 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.348958  3723 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.349527  3723 ts_tablet_manager.cc:1403] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:11:04.350919  3726 raft_consensus.cc:515] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.352986  3723 raft_consensus.cc:359] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.353826  3723 raft_consensus.cc:385] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.354110  3723 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.354950  3723 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.357357  3724 tablet_bootstrap.cc:654] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.360571  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:04.361488  3533 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.365073  3723 ts_tablet_manager.cc:1434] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.015s	user 0.015s	sys 0.000s
I20260709 13:11:04.366325  3723 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.369742  3724 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.370361  3724 ts_tablet_manager.cc:1403] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:11:04.371779  3726 leader_election.cc:290] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.372092  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:04.373266  3723 tablet_bootstrap.cc:654] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.373852  3533 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 1.
I20260709 13:11:04.373636  3724 raft_consensus.cc:359] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.374567  3724 raft_consensus.cc:385] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.374889  3724 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.375541  3571 leader_election.cc:304] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:04.375829  3724 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.376602  3726 raft_consensus.cc:2804] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:04.376377  3574 leader_election.cc:343] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.377239  3729 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.378142  3726 raft_consensus.cc:697] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:04.379534  3726 consensus_queue.cc:237] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.377923  3729 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.386015  3724 ts_tablet_manager.cc:1434] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.007s
I20260709 13:11:04.386503  3723 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.387127  3723 ts_tablet_manager.cc:1403] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:11:04.387601  3724 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.390443  3723 raft_consensus.cc:359] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.391237  3723 raft_consensus.cc:385] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.391681  3723 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.393718  3723 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.396839  3723 ts_tablet_manager.cc:1434] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:11:04.398218  3723 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.398491  3724 tablet_bootstrap.cc:654] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.399042  3729 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.411428  3724 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.412269  3724 ts_tablet_manager.cc:1403] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:11:04.416462  3724 raft_consensus.cc:359] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.417533  3724 raft_consensus.cc:385] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.417925  3724 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.418919  3724 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.420086  3723 tablet_bootstrap.cc:654] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.422178  3724 ts_tablet_manager.cc:1434] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:04.423750  3724 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.433339  3724 tablet_bootstrap.cc:654] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.434705  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
W20260709 13:11:04.435403  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:11:04.437276  3646 leader_election.cc:343] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.441417  3722 tablet_bootstrap.cc:654] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.446592  3724 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.447489  3724 ts_tablet_manager.cc:1403] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 13:11:04.451850  3724 raft_consensus.cc:359] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.453059  3724 raft_consensus.cc:385] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.453480  3724 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.455076  3724 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.459200  3724 ts_tablet_manager.cc:1434] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:11:04.459931  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.460390  3724 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
W20260709 13:11:04.461808  3645 leader_election.cc:343] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.462437  3645 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.462903  3729 raft_consensus.cc:493] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.463582  3738 raft_consensus.cc:2749] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.463446  3729 raft_consensus.cc:515] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.467942  3729 leader_election.cc:290] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.468874  3724 tablet_bootstrap.cc:654] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.468672  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.469592  3533 raft_consensus.cc:2393] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d557ee59894049b3990264a4c37f7500 in current term 1: Already voted for candidate a2c7dd8fec96436e83724f6dbec5ce02 in this term.
I20260709 13:11:04.469547  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.471256  3646 leader_election.cc:304] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.472033  3729 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.479499  3722 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.480163  3722 ts_tablet_manager.cc:1403] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.000s
I20260709 13:11:04.480486  3429 catalog_manager.cc:5697] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.481654  3723 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.481469  3729 raft_consensus.cc:2749] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.482323  3723 ts_tablet_manager.cc:1403] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.026s
I20260709 13:11:04.483112  3722 raft_consensus.cc:359] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.483825  3722 raft_consensus.cc:385] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.484170  3722 raft_consensus.cc:740] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.484925  3722 consensus_queue.cc:260] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.487079  3722 ts_tablet_manager.cc:1434] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:04.486467  3723 raft_consensus.cc:359] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.487732  3723 raft_consensus.cc:385] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.488195  3722 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.492321  3732 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.492899  3732 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.494302  3724 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.494855  3724 ts_tablet_manager.cc:1403] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 13:11:04.497123  3722 tablet_bootstrap.cc:654] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.498175  3724 raft_consensus.cc:359] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.499009  3724 raft_consensus.cc:385] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.499316  3724 raft_consensus.cc:740] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.500239  3724 consensus_queue.cc:260] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.502807  3724 ts_tablet_manager.cc:1434] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:11:04.503851  3724 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.488191  3723 raft_consensus.cc:740] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.508695  3723 consensus_queue.cc:260] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.511112  3723 ts_tablet_manager.cc:1434] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:11:04.511247  3732 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.512241  3723 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.518345  3722 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.519057  3722 ts_tablet_manager.cc:1403] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 13:11:04.519745  3723 tablet_bootstrap.cc:654] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.523329  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
W20260709 13:11:04.525328  3497 leader_election.cc:343] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.523284  3722 raft_consensus.cc:359] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.528776  3722 raft_consensus.cc:385] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.528905  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.529299  3722 raft_consensus.cc:740] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.530074  3682 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5be1dca7fa934c32847f9cbf201a647d in term 0.
I20260709 13:11:04.530611  3724 tablet_bootstrap.cc:654] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.530819  3722 consensus_queue.cc:260] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.531872  3499 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.533118  3732 raft_consensus.cc:2804] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.533658  3732 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.534142  3732 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.542304  3724 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.543143  3724 ts_tablet_manager.cc:1403] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.003s
I20260709 13:11:04.546387  3732 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.547479  3752 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.548121  3752 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.549940  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.549207  3723 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.551393  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
W20260709 13:11:04.551699  3497 leader_election.cc:343] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.552273  3723 ts_tablet_manager.cc:1403] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.002s
W20260709 13:11:04.553064  3497 leader_election.cc:343] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.554025  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.554765  3682 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5be1dca7fa934c32847f9cbf201a647d in term 0.
I20260709 13:11:04.555158  3722 ts_tablet_manager.cc:1434] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.005s
I20260709 13:11:04.556249  3499 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.557575  3752 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.558307  3722 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.558182  3752 raft_consensus.cc:2804] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.557798  3724 raft_consensus.cc:359] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.558972  3724 raft_consensus.cc:385] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.559317  3724 raft_consensus.cc:740] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
W20260709 13:11:04.560469  3462 debug-util.cc:398] Leaking SignalData structure 0x7b0800280b80 after lost signal to thread 25510
I20260709 13:11:04.559568  3723 raft_consensus.cc:359] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.560245  3724 consensus_queue.cc:260] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.562973  3738 raft_consensus.cc:493] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.563380  3752 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.563956  3752 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.563500  3738 raft_consensus.cc:515] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.564321  3732 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 election: Requested vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.566022  3724 ts_tablet_manager.cc:1434] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 13:11:04.568382  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.568608  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.569249  3608 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
W20260709 13:11:04.569991  3645 leader_election.cc:343] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.570242  3722 tablet_bootstrap.cc:654] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.570712  3646 leader_election.cc:304] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.572407  3729 raft_consensus.cc:2804] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.572818  3729 raft_consensus.cc:493] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.573164  3729 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.573846  3752 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.575987  3738 leader_election.cc:290] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.576365  3752 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 election: Requested vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.577095  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.580107  3757 raft_consensus.cc:493] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.580663  3757 raft_consensus.cc:515] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.582181  3722 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.560906  3723 raft_consensus.cc:385] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.583523  3681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:04.583863  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.584275  3681 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.585345  3645 leader_election.cc:343] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.583033  3723 raft_consensus.cc:740] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.586465  3723 consensus_queue.cc:260] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.587121  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:04.587368  3608 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.587829  3682 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.593794  3724 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.597295  3682 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5be1dca7fa934c32847f9cbf201a647d in term 1.
I20260709 13:11:04.594573  3681 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5be1dca7fa934c32847f9cbf201a647d in term 1.
I20260709 13:11:04.599073  3499 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.600606  3499 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:04.601567  3752 raft_consensus.cc:2804] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.602114  3752 raft_consensus.cc:697] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 LEADER]: Becoming Leader. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Running, Role: LEADER
I20260709 13:11:04.603036  3752 consensus_queue.cc:237] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.603564  3724 tablet_bootstrap.cc:654] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.606025  3732 raft_consensus.cc:2804] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.606966  3608 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5be1dca7fa934c32847f9cbf201a647d in term 1.
I20260709 13:11:04.610260  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.610986  3607 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
I20260709 13:11:04.614073  3646 leader_election.cc:304] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.615001  3738 raft_consensus.cc:2804] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.615401  3738 raft_consensus.cc:493] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.615777  3738 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.583032  3729 raft_consensus.cc:515] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.618870  3729 leader_election.cc:290] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.618956  3722 ts_tablet_manager.cc:1403] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.006s
I20260709 13:11:04.619848  3723 ts_tablet_manager.cc:1434] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:11:04.620546  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:04.620998  3723 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
W20260709 13:11:04.622026  3645 leader_election.cc:343] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.628191  3723 tablet_bootstrap.cc:654] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.628988  3732 raft_consensus.cc:697] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 LEADER]: Becoming Leader. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Running, Role: LEADER
I20260709 13:11:04.630129  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.630795  3608 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.630438  3732 consensus_queue.cc:237] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.635212  3722 raft_consensus.cc:359] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.637979  3608 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.637832  3738 raft_consensus.cc:515] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.638365  3722 raft_consensus.cc:385] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.638872  3722 raft_consensus.cc:740] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.639361  3646 leader_election.cc:304] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.640246  3729 raft_consensus.cc:2804] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.640882  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
W20260709 13:11:04.642647  3645 leader_election.cc:343] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.645962  3757 leader_election.cc:290] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.647706  3726 raft_consensus.cc:493] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.648262  3726 raft_consensus.cc:515] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.650533  3726 leader_election.cc:290] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.651427  3722 consensus_queue.cc:260] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.653062  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.653347  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.653858  3722 ts_tablet_manager.cc:1434] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
W20260709 13:11:04.654644  3574 leader_election.cc:343] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.654917  3722 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
W20260709 13:11:04.657090  3571 leader_election.cc:343] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.659009  3571 leader_election.cc:304] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02; no voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500
I20260709 13:11:04.660531  3726 raft_consensus.cc:2749] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.663710  3428 catalog_manager.cc:5697] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193). New cstate: current_term: 1 leader_uuid: "5be1dca7fa934c32847f9cbf201a647d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.665330  3723 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.665905  3723 ts_tablet_manager.cc:1403] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 13:11:04.665757  3428 catalog_manager.cc:5697] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193). New cstate: current_term: 1 leader_uuid: "5be1dca7fa934c32847f9cbf201a647d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.668090  3738 leader_election.cc:290] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.668258  3722 tablet_bootstrap.cc:654] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.669396  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.670130  3608 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.673985  3729 raft_consensus.cc:697] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:04.674985  3729 consensus_queue.cc:237] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.685545  3722 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.686167  3722 ts_tablet_manager.cc:1403] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 13:11:04.683287  3608 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.693037  3646 leader_election.cc:304] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.694636  3763 raft_consensus.cc:2804] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.695204  3763 raft_consensus.cc:697] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:04.696445  3763 consensus_queue.cc:237] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.698220  3722 raft_consensus.cc:359] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.699304  3722 raft_consensus.cc:385] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.699596  3722 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.700435  3722 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.704162  3722 ts_tablet_manager.cc:1434] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:04.705777  3723 raft_consensus.cc:359] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.706759  3723 raft_consensus.cc:385] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.707079  3723 raft_consensus.cc:740] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.707341  3722 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.708819  3723 consensus_queue.cc:260] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.710069  3724 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.710649  3724 ts_tablet_manager.cc:1403] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.074s
I20260709 13:11:04.713562  3723 ts_tablet_manager.cc:1434] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 13:11:04.714493  3724 raft_consensus.cc:359] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.714695  3723 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.713985  3428 catalog_manager.cc:5697] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 0 to 1, leader changed from <none> to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.718048  3722 tablet_bootstrap.cc:654] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.715274  3724 raft_consensus.cc:385] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.723371  3724 raft_consensus.cc:740] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.724354  3724 consensus_queue.cc:260] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.725533  3729 raft_consensus.cc:493] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.725979  3729 raft_consensus.cc:515] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.728155  3729 leader_election.cc:290] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.729265  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.730173  3724 ts_tablet_manager.cc:1434] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:11:04.731204  3724 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
W20260709 13:11:04.732009  3645 leader_election.cc:343] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.730970  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.732851  3608 raft_consensus.cc:2468] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
I20260709 13:11:04.734372  3646 leader_election.cc:304] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.735633  3729 raft_consensus.cc:2804] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.736048  3729 raft_consensus.cc:493] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.736373  3729 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.737619  3724 tablet_bootstrap.cc:654] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.740041  3723 tablet_bootstrap.cc:654] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.747989  3732 raft_consensus.cc:493] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.748559  3732 raft_consensus.cc:515] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.750022  3729 raft_consensus.cc:515] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.750958  3732 leader_election.cc:290] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.752394  3729 leader_election.cc:290] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.753727  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.754565  3608 raft_consensus.cc:2393] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5be1dca7fa934c32847f9cbf201a647d in current term 1: Already voted for candidate d557ee59894049b3990264a4c37f7500 in this term.
I20260709 13:11:04.754397  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:04.754595  3722 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.756098  3722 ts_tablet_manager.cc:1403] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.015s
I20260709 13:11:04.757375  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.757993  3608 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.758147  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.760063  3499 leader_election.cc:304] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d; no voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500
I20260709 13:11:04.760852  3732 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.761278  3645 leader_election.cc:343] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.768625  3732 raft_consensus.cc:2749] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.768987  3608 raft_consensus.cc:2468] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.770606  3646 leader_election.cc:304] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.770826  3723 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.771620  3723 ts_tablet_manager.cc:1403] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.008s
I20260709 13:11:04.772198  3763 raft_consensus.cc:2804] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.772917  3763 raft_consensus.cc:697] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:04.774048  3738 raft_consensus.cc:493] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.773955  3763 consensus_queue.cc:237] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.774546  3738 raft_consensus.cc:515] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.776738  3738 leader_election.cc:290] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.778479  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.779174  3533 raft_consensus.cc:2468] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
I20260709 13:11:04.776839  3431 catalog_manager.cc:5697] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 0 to 1, leader changed from <none> to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.780694  3723 raft_consensus.cc:359] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.781481  3723 raft_consensus.cc:385] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.780611  3645 leader_election.cc:304] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:04.781812  3723 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.782461  3738 raft_consensus.cc:2804] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.782840  3738 raft_consensus.cc:493] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.783272  3738 raft_consensus.cc:3060] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.779268  3722 raft_consensus.cc:359] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.784097  3722 raft_consensus.cc:385] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.784451  3722 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.785259  3722 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.782707  3723 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.790681  3738 raft_consensus.cc:515] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:04.792095  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.792920  3608 raft_consensus.cc:2468] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
I20260709 13:11:04.795832  3722 ts_tablet_manager.cc:1434] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:11:04.798346  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:04.798964  3533 raft_consensus.cc:3060] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.800369  3726 raft_consensus.cc:493] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.800957  3726 raft_consensus.cc:515] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.802785  3723 ts_tablet_manager.cc:1434] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:11:04.803231  3726 leader_election.cc:290] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:04.805373  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.806903  3533 raft_consensus.cc:2468] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.807971  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:04.808166  3645 leader_election.cc:304] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:04.796113  3724 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.808738  3682 raft_consensus.cc:2468] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 0.
I20260709 13:11:04.809063  3729 raft_consensus.cc:2804] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.809376  3724 ts_tablet_manager.cc:1403] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.006s
I20260709 13:11:04.809707  3729 raft_consensus.cc:697] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:04.810676  3729 consensus_queue.cc:237] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
W20260709 13:11:04.811030  3571 leader_election.cc:343] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.812071  3574 leader_election.cc:304] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.812294  3724 raft_consensus.cc:359] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.813023  3724 raft_consensus.cc:385] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.813227  3735 raft_consensus.cc:2804] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.813822  3735 raft_consensus.cc:493] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.814179  3735 raft_consensus.cc:3060] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.816020  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596627a990884ddf8125677b30c7494e" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.816825  3608 raft_consensus.cc:3060] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.820827  3723 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.825362  3608 raft_consensus.cc:2468] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.827000  3738 leader_election.cc:290] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.813303  3724 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.828694  3722 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:04.828480  3724 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.832840  3724 ts_tablet_manager.cc:1434] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:11:04.833860  3724 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: Bootstrap starting.
I20260709 13:11:04.830350  3735 raft_consensus.cc:515] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.838549  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:04.839979  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:04.840649  3682 raft_consensus.cc:3060] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.842085  3735 leader_election.cc:290] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
W20260709 13:11:04.844261  3571 leader_election.cc:343] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.845263  3723 tablet_bootstrap.cc:654] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.846336  3431 catalog_manager.cc:5697] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 0 to 1, leader changed from <none> to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.847710  3726 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.850347  3724 tablet_bootstrap.cc:654] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.860484  3682 raft_consensus.cc:2468] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 1.
I20260709 13:11:04.862258  3723 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.864347  3763 raft_consensus.cc:493] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.864624  3723 ts_tablet_manager.cc:1403] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.013s
I20260709 13:11:04.865135  3763 raft_consensus.cc:515] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.867856  3723 raft_consensus.cc:359] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.868724  3723 raft_consensus.cc:385] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.869065  3723 raft_consensus.cc:740] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.870360  3723 consensus_queue.cc:260] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.872493  3574 leader_election.cc:304] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.862948  3722 tablet_bootstrap.cc:654] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.870605  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:04.876148  3608 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 0.
I20260709 13:11:04.876919  3723 ts_tablet_manager.cc:1434] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:11:04.869207  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.877430  3646 leader_election.cc:304] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:04.881634  3738 raft_consensus.cc:2804] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.880769  3431 catalog_manager.cc:5697] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 0 to 1, leader changed from <none> to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.879602  3723 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: Bootstrap starting.
I20260709 13:11:04.882151  3738 raft_consensus.cc:493] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.886164  3738 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.882189  3645 leader_election.cc:343] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.882921  3726 raft_consensus.cc:2804] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.894642  3726 raft_consensus.cc:697] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:04.869326  3763 leader_election.cc:290] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.870908  3724 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: No bootstrap required, opened a new log
I20260709 13:11:04.896677  3724 ts_tablet_manager.cc:1403] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.004s
I20260709 13:11:04.900357  3723 tablet_bootstrap.cc:654] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.902140  3724 raft_consensus.cc:359] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.902944  3724 raft_consensus.cc:385] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.903268  3724 raft_consensus.cc:740] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.911761  3738 raft_consensus.cc:515] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.915048  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
W20260709 13:11:04.916551  3645 leader_election.cc:343] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.917337  3735 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.895588  3726 consensus_queue.cc:237] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.923120  3738 leader_election.cc:290] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.923996  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:04.905500  3724 consensus_queue.cc:260] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.929667  3724 ts_tablet_manager.cc:1434] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:11:04.928476  3608 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.935132  3738 raft_consensus.cc:493] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.935766  3738 raft_consensus.cc:515] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.939898  3738 leader_election.cc:290] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:04.941538  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:04.942052  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
W20260709 13:11:04.943596  3646 leader_election.cc:343] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:04.944589  3645 leader_election.cc:343] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.945446  3645 leader_election.cc:304] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:04.946249  3738 raft_consensus.cc:2749] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.947003  3608 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:04.950748  3722 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:04.951318  3722 ts_tablet_manager.cc:1403] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.123s	user 0.024s	sys 0.026s
I20260709 13:11:04.957458  3723 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: No bootstrap required, opened a new log
I20260709 13:11:04.958176  3723 ts_tablet_manager.cc:1403] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.005s
I20260709 13:11:04.963819  3646 leader_election.cc:304] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:04.954334  3722 raft_consensus.cc:359] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.966447  3722 raft_consensus.cc:385] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.966886  3722 raft_consensus.cc:740] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.968344  3738 raft_consensus.cc:2804] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.969520  3738 raft_consensus.cc:697] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:04.970976  3722 consensus_queue.cc:260] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.970526  3428 catalog_manager.cc:5697] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.972862  3738 consensus_queue.cc:237] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.970613  3723 raft_consensus.cc:359] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.978726  3723 raft_consensus.cc:385] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.979449  3723 raft_consensus.cc:740] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.980216  3723 consensus_queue.cc:260] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:04.982153  3723 ts_tablet_manager.cc:1434] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:11:04.984447  3722 ts_tablet_manager.cc:1434] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:11:04.998613  3428 catalog_manager.cc:5697] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 0 to 1, leader changed from <none> to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.005074  3722 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:05.012400  3722 tablet_bootstrap.cc:654] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.018085  3722 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:05.018540  3722 ts_tablet_manager.cc:1403] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.006s
I20260709 13:11:05.020483  3722 raft_consensus.cc:359] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.020987  3722 raft_consensus.cc:385] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.021211  3722 raft_consensus.cc:740] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.021842  3722 consensus_queue.cc:260] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.023334  3722 ts_tablet_manager.cc:1434] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:11:05.024540  3722 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:05.030184  3722 tablet_bootstrap.cc:654] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.034706  3722 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:05.035163  3722 ts_tablet_manager.cc:1403] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:05.037779  3722 raft_consensus.cc:359] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.038468  3722 raft_consensus.cc:385] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.038735  3722 raft_consensus.cc:740] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.039285  3722 consensus_queue.cc:260] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.040952  3722 ts_tablet_manager.cc:1434] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:11:05.041712  3722 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:05.046856  3722 tablet_bootstrap.cc:654] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.051173  3722 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: No bootstrap required, opened a new log
I20260709 13:11:05.051645  3722 ts_tablet_manager.cc:1403] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:11:05.054278  3722 raft_consensus.cc:359] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.054945  3722 raft_consensus.cc:385] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.055171  3722 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.055833  3722 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.057344  3722 ts_tablet_manager.cc:1434] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:11:05.074821  3732 consensus_queue.cc:1048] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.085671  3608 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.095563  3752 consensus_queue.cc:1048] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.102990  3752 raft_consensus.cc:493] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.103586  3752 raft_consensus.cc:515] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.104687  3780 raft_consensus.cc:493] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.105249  3780 raft_consensus.cc:515] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.107371  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:05.108301  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d" is_pre_election: true
I20260709 13:11:05.108981  3752 leader_election.cc:290] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:05.109050  3533 raft_consensus.cc:2468] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 0.
I20260709 13:11:05.110808  3571 leader_election.cc:304] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:05.111748  3726 raft_consensus.cc:2804] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.112174  3726 raft_consensus.cc:493] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.112229  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:05.112603  3726 raft_consensus.cc:3060] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.113219  3608 raft_consensus.cc:2393] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5be1dca7fa934c32847f9cbf201a647d in current term 1: Already voted for candidate d557ee59894049b3990264a4c37f7500 in this term.
I20260709 13:11:05.114494  3497 leader_election.cc:304] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d; no voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500
I20260709 13:11:05.116005  3732 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.116580  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:05.117316  3682 raft_consensus.cc:2468] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 0.
I20260709 13:11:05.121004  3726 raft_consensus.cc:515] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.123174  3780 leader_election.cc:290] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:05.124413  3732 raft_consensus.cc:2749] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.124814  3726 leader_election.cc:290] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:05.125644  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:05.127271  3533 raft_consensus.cc:3060] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.126195  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675cf94f10314d5696a4a225e696914f" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:05.131654  3752 consensus_queue.cc:1048] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.132283  3682 raft_consensus.cc:3060] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.134953  3533 raft_consensus.cc:2468] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 1.
I20260709 13:11:05.137423  3571 leader_election.cc:304] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:05.140375  3682 raft_consensus.cc:2468] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 1.
I20260709 13:11:05.141563  3726 raft_consensus.cc:2804] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.142092  3726 raft_consensus.cc:697] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:05.142910  3726 consensus_queue.cc:237] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.152887  3759 consensus_queue.cc:1048] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.158133  3430 catalog_manager.cc:5697] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.191166  3738 consensus_queue.cc:1048] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.197736  3759 raft_consensus.cc:493] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.198276  3759 raft_consensus.cc:515] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.200503  3759 leader_election.cc:290] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:05.203120  3533 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.204856  3681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:05.205891  3681 raft_consensus.cc:2393] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5be1dca7fa934c32847f9cbf201a647d in current term 1: Already voted for candidate a2c7dd8fec96436e83724f6dbec5ce02 in this term.
I20260709 13:11:05.213063  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e11add10b4cf3b082b0c5fe8f874e" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:05.214656  3763 consensus_queue.cc:1048] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.215260  3497 leader_election.cc:304] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d; no voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500
I20260709 13:11:05.216315  3759 raft_consensus.cc:3060] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.221510  3738 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.225481  3759 raft_consensus.cc:2749] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.230746  3763 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.241235  3738 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.256618  3729 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.288985  3729 consensus_queue.cc:1048] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.312593  3729 consensus_queue.cc:1048] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.344431  3732 raft_consensus.cc:493] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.345007  3732 raft_consensus.cc:515] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:05.346781  3732 leader_election.cc:290] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:05.347788  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:05.348016  3681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "5be1dca7fa934c32847f9cbf201a647d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
I20260709 13:11:05.348518  3607 raft_consensus.cc:2393] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5be1dca7fa934c32847f9cbf201a647d in current term 1: Already voted for candidate d557ee59894049b3990264a4c37f7500 in this term.
I20260709 13:11:05.349728  3499 leader_election.cc:304] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d; no voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500
I20260709 13:11:05.350430  3732 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.355497  3732 raft_consensus.cc:2749] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.364579  3729 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.376575  3738 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.429844 25507 ts_manager.cc:295] Set tserver state for 5be1dca7fa934c32847f9cbf201a647d to MAINTENANCE_MODE
I20260709 13:11:05.430842 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:11:05.436715  3726 consensus_queue.cc:1048] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:05.436765  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:05.480661  3571 consensus_peers.cc:597] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:05.487869 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:05.489032 25507 tablet_replica.cc:333] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.489970 25507 raft_consensus.cc:2243] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.490556 25507 raft_consensus.cc:2272] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.493942 25507 tablet_replica.cc:333] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.494758 25507 raft_consensus.cc:2243] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.495267 25507 raft_consensus.cc:2272] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.498013 25507 tablet_replica.cc:333] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.498818 25507 raft_consensus.cc:2243] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.499303 25507 raft_consensus.cc:2272] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.501669 25507 tablet_replica.cc:333] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.502408 25507 raft_consensus.cc:2243] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.502926 25507 raft_consensus.cc:2272] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.505890 25507 tablet_replica.cc:333] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.506699 25507 raft_consensus.cc:2243] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.507231 25507 raft_consensus.cc:2272] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.510172 25507 tablet_replica.cc:333] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.510987 25507 raft_consensus.cc:2243] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.511525 25507 raft_consensus.cc:2272] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.514634 25507 tablet_replica.cc:333] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.515427 25507 raft_consensus.cc:2243] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:05.516577 25507 raft_consensus.cc:2272] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.519614 25507 tablet_replica.cc:333] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.520470 25507 raft_consensus.cc:2243] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:05.521585 25507 raft_consensus.cc:2272] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.524581 25507 tablet_replica.cc:333] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.525362 25507 raft_consensus.cc:2243] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.525911 25507 raft_consensus.cc:2272] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.529484 25507 tablet_replica.cc:333] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: stopping tablet replica
I20260709 13:11:05.530213 25507 raft_consensus.cc:2243] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.530754 25507 raft_consensus.cc:2272] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:05.553543  3571 consensus_peers.cc:597] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:05.558512 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
I20260709 13:11:05.653517  3726 consensus_queue.cc:1048] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:05.656152  3645 consensus_peers.cc:597] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.670054  3645 consensus_peers.cc:597] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.797210  3645 consensus_peers.cc:597] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.823732  3645 consensus_peers.cc:597] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.948200  3645 consensus_peers.cc:597] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.953385  3571 consensus_peers.cc:597] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:06.439248  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:06.600366  3810 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.600965  3810 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.602677  3810 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:06.603936  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
W20260709 13:11:06.606539  3571 leader_election.cc:336] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.606921  3571 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02; no voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500
I20260709 13:11:06.607565  3810 raft_consensus.cc:2749] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.656587  3810 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.657153  3810 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.659405  3810 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:06.660657  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d557ee59894049b3990264a4c37f7500" is_pre_election: true
W20260709 13:11:06.664525  3571 leader_election.cc:336] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.664973  3571 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02; no voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500
I20260709 13:11:06.665661  3810 raft_consensus.cc:2749] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.665745  3763 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.666477  3763 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.668782  3763 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:06.670068  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:06.670789  3608 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
I20260709 13:11:06.672087  3646 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 
W20260709 13:11:06.673226  3645 leader_election.cc:336] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.673764  3763 raft_consensus.cc:2804] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.674217  3763 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.674584  3763 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:06.680194  3645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111) [suppressed 113 similar messages]
I20260709 13:11:06.681743  3763 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.684103  3763 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:06.685606  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:06.686197  3608 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:06.689109  3645 leader_election.cc:336] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.692095  3608 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 2.
I20260709 13:11:06.693394  3646 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:06.694366  3763 raft_consensus.cc:2804] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.694941  3763 raft_consensus.cc:697] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:06.695797  3763 consensus_queue.cc:237] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.704092  3430 catalog_manager.cc:5697] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 1 to 2, leader changed from 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:06.967257  3738 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.967870  3738 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.969936  3738 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:06.971253  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" is_pre_election: true
I20260709 13:11:06.972065  3608 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 1.
W20260709 13:11:06.973209  3645 leader_election.cc:336] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.973860  3646 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:06.974560  3738 raft_consensus.cc:2804] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.974965  3738 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5be1dca7fa934c32847f9cbf201a647d)
I20260709 13:11:06.975276  3738 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.980651  3738 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:06.982254  3738 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:06.983363  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:06.984007  3608 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:06.986953  3645 leader_election.cc:336] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111)
I20260709 13:11:06.989732  3608 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 2.
I20260709 13:11:06.990805  3646 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 5be1dca7fa934c32847f9cbf201a647d
I20260709 13:11:06.991492  3738 raft_consensus.cc:2804] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.992009  3738 raft_consensus.cc:697] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:06.992779  3738 consensus_queue.cc:237] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:07.000514  3430 catalog_manager.cc:5697] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 1 to 2, leader changed from 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:07.121008  3645 consensus_peers.cc:597] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.121456  3608 raft_consensus.cc:1275] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.123101  3738 consensus_queue.cc:1048] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:07.440510  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:07.577488  3608 raft_consensus.cc:1275] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.579063  3763 consensus_queue.cc:1048] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:07.598558  3645 consensus_peers.cc:597] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:07.967056  3645 consensus_peers.cc:597] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.037635  3645 consensus_peers.cc:597] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.102613  3571 consensus_peers.cc:597] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.130046  3645 consensus_peers.cc:597] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.316258  3645 consensus_peers.cc:597] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.368676  3571 consensus_peers.cc:597] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.389659  3645 consensus_peers.cc:597] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.417681  3571 consensus_peers.cc:597] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:08.442082  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:09.332530  3645 consensus_peers.cc:597] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:09.443337  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:10.287423  3645 consensus_peers.cc:597] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:10.310250  3645 consensus_peers.cc:597] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:10.363399  3645 consensus_peers.cc:597] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:10.444378  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:10.579088 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:10.587934  3826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:10.588199  3827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:10.596247  3829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:10.598629 25507 server_base.cc:1061] running on GCE node
W20260709 13:11:10.599334  3645 consensus_peers.cc:597] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:10.601091 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:10.601464 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:10.601707 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602670601689 us; error 0 us; skew 500 ppm
I20260709 13:11:10.602440 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:11:10.604058  3571 consensus_peers.cc:597] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:10.605679 25507 webserver.cc:533] Webserver started at http://127.24.232.193:46723/ using document root <none> and password file <none>
I20260709 13:11:10.606360 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:10.606592 25507 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:10.611130 25507 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:10.615649  3834 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:10.616565 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:11:10.616940 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "5be1dca7fa934c32847f9cbf201a647d"
format_stamp: "Formatted at 2026-07-09 13:11:03 on dist-test-slave-sdg5"
I20260709 13:11:10.617393 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:10.638862 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:10.640177 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:10.641749 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:10.645473  3841 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:11:10.661042  3645 consensus_peers.cc:597] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:10.704458 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:10.704811 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.001s	sys 0.002s
I20260709 13:11:10.705071 25507 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:10.711087  3841 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.726162  3841 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.727005  3841 tablet_bootstrap.cc:492] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.727607  3841 ts_tablet_manager.cc:1403] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:11:10.729959  3841 raft_consensus.cc:359] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.730767  3841 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.731417  3841 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.733922  3841 ts_tablet_manager.cc:1434] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:10.734658  3841 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.748570  3841 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.749610  3841 tablet_bootstrap.cc:492] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.750329  3841 ts_tablet_manager.cc:1403] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:11:10.750574 25507 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:10.751067 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.046s	user 0.031s	sys 0.012s
I20260709 13:11:10.753391  3841 raft_consensus.cc:359] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.754235  3841 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.755142  3841 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.757596  3841 ts_tablet_manager.cc:1434] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:10.758520  3841 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.781371  3841 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.782552  3841 tablet_bootstrap.cc:492] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
W20260709 13:11:10.782593  3571 consensus_peers.cc:597] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:10.783191  3841 ts_tablet_manager.cc:1403] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:11:10.785692  3841 raft_consensus.cc:359] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:10.786276  3841 raft_consensus.cc:740] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.786967  3841 consensus_queue.cc:260] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } }
I20260709 13:11:10.788653  3841 ts_tablet_manager.cc:1434] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:11:10.789381  3841 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.800840  3841 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.801590  3841 tablet_bootstrap.cc:492] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.802268  3841 ts_tablet_manager.cc:1403] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:11:10.804891  3841 raft_consensus.cc:359] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.805601  3841 raft_consensus.cc:740] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.806454  3841 consensus_queue.cc:260] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.808094  3841 ts_tablet_manager.cc:1434] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:10.808770  3841 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.818238 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:36105
I20260709 13:11:10.818375  3903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:36105 every 8 connection(s)
I20260709 13:11:10.823001  3841 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.824064  3841 tablet_bootstrap.cc:492] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.825055  3841 ts_tablet_manager.cc:1403] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
W20260709 13:11:10.825172  3905 tablet.cc:2406] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:10.825332 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:10.828927  3841 raft_consensus.cc:359] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.830063  3841 raft_consensus.cc:740] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.831286  3841 consensus_queue.cc:260] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.833957  3841 ts_tablet_manager.cc:1434] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:10.835309  3841 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.851892  3841 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.852928  3841 tablet_bootstrap.cc:492] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.853700  3841 ts_tablet_manager.cc:1403] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:11:10.856436  3841 raft_consensus.cc:359] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.857219  3841 raft_consensus.cc:740] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.858099  3904 heartbeater.cc:344] Connected to a master server at 127.24.232.254:45001
I20260709 13:11:10.858563  3904 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:10.858049  3841 consensus_queue.cc:260] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.859551  3904 heartbeater.cc:507] Master 127.24.232.254:45001 requested a full tablet report, sending...
I20260709 13:11:10.860577  3841 ts_tablet_manager.cc:1434] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:10.861511  3841 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.867112  3430 ts_manager.cc:194] Re-registered known tserver with Master: 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105)
I20260709 13:11:10.876420  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:10.877166  3682 raft_consensus.cc:606] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:10.879102  3841 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.880141  3841 tablet_bootstrap.cc:492] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.879956  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:10.880636  3682 raft_consensus.cc:606] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:10.880800  3841 ts_tablet_manager.cc:1403] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:11:10.880821  3430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36742
I20260709 13:11:10.883419  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b412602c04244351820e62951d13f4f4"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:10.883944  3682 raft_consensus.cc:606] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:10.883553  3841 raft_consensus.cc:359] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.884405  3841 raft_consensus.cc:740] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.885002  3904 heartbeater.cc:499] Master 127.24.232.254:45001 was elected leader, sending a full tablet report...
I20260709 13:11:10.885150 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:10.885812 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:10.885295  3841 consensus_queue.cc:260] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.886521 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:10.887774  3841 ts_tablet_manager.cc:1434] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:11:10.888660  3841 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.900929  3841 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.901875  3841 tablet_bootstrap.cc:492] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.902524  3841 ts_tablet_manager.cc:1403] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:11:10.904657  3841 raft_consensus.cc:359] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.905123  3841 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.905746  3841 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.907157  3841 ts_tablet_manager.cc:1434] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:10.908051  3841 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.920010  3841 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.920738  3841 tablet_bootstrap.cc:492] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.921281  3841 ts_tablet_manager.cc:1403] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:11:10.923022  3841 raft_consensus.cc:359] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.923509  3841 raft_consensus.cc:740] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.924062  3841 consensus_queue.cc:260] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.925554  3841 ts_tablet_manager.cc:1434] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:10.926273  3841 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap starting.
I20260709 13:11:10.938609  3841 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:10.939342  3841 tablet_bootstrap.cc:492] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Bootstrap complete.
I20260709 13:11:10.939978  3841 ts_tablet_manager.cc:1403] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:11:10.942090  3841 raft_consensus.cc:359] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.942618  3841 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be1dca7fa934c32847f9cbf201a647d, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.943156  3841 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:10.945053  3841 ts_tablet_manager.cc:1434] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:11.034029  3763 raft_consensus.cc:993] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.034652  3918 raft_consensus.cc:1081] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.036631  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b412602c04244351820e62951d13f4f4"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:11.037158  3608 raft_consensus.cc:493] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.037477  3608 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.044763  3608 raft_consensus.cc:515] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.046254  3608 leader_election.cc:290] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:11.047372  3877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:11.047715  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:11.048134  3877 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.048355  3682 raft_consensus.cc:3055] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.048743  3682 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:11.049799  3682 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.051345  3682 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.054594  3877 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.055733  3571 leader_election.cc:304] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:11.056614  3810 raft_consensus.cc:2804] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.057853  3810 raft_consensus.cc:697] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:11.058475  3682 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.058972  3810 consensus_queue.cc:237] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.066900  3430 catalog_manager.cc:5697] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 1 to 2, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.116657  3918 raft_consensus.cc:993] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.117281  3918 raft_consensus.cc:1081] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.118660  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:11.119161  3608 raft_consensus.cc:493] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.119508  3608 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.124444  3608 raft_consensus.cc:515] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.126065  3608 leader_election.cc:290] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:11.127005  3877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:11.127215  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7596a1c7974891a61bcffa19486290" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:11.127632  3877 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.127866  3682 raft_consensus.cc:3055] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.128332  3682 raft_consensus.cc:740] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:11.129182  3682 consensus_queue.cc:260] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.130286  3682 raft_consensus.cc:3060] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.133563  3877 raft_consensus.cc:2468] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.134737  3571 leader_election.cc:304] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:11.135604  3810 raft_consensus.cc:2804] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.136081  3810 raft_consensus.cc:697] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:11.136592  3682 raft_consensus.cc:2468] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.137117  3810 consensus_queue.cc:237] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.145614  3877 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.144996  3429 catalog_manager.cc:5697] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 1 to 2, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.243367  3918 raft_consensus.cc:993] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.243875  3763 raft_consensus.cc:1081] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:11.245376  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:11.245769  3608 raft_consensus.cc:493] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.245997  3608 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.250317  3608 raft_consensus.cc:515] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.251787  3608 leader_election.cc:290] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:11.252660  3877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:11.252840  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:11.253278  3877 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.253496  3682 raft_consensus.cc:3055] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.253880  3682 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:11.254670  3682 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.255689  3682 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.258564  3877 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.259614  3571 leader_election.cc:304] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:11.260406  3810 raft_consensus.cc:2804] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.260890  3810 raft_consensus.cc:697] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:11.261768  3682 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:11.261869  3810 consensus_queue.cc:237] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.269687  3429 catalog_manager.cc:5697] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 1 to 2, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.377008  3877 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:11.445458  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:11.453644  3682 raft_consensus.cc:1275] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.454980  3930 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.464984  3877 raft_consensus.cc:1275] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.466614  3930 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.681202  3877 raft_consensus.cc:1275] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.682700  3920 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.684913  3682 raft_consensus.cc:1275] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.686331  3920 consensus_queue.cc:1048] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.692412  3681 raft_consensus.cc:1275] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.695307  3810 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.710737  3876 raft_consensus.cc:1275] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.715781  3938 consensus_queue.cc:1048] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.895767 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.915647  3608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b412602c04244351820e62951d13f4f4"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
mode: GRACEFUL
new_leader_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:40890
I20260709 13:11:11.916169  3608 raft_consensus.cc:606] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Received request to transfer leadership to TS d557ee59894049b3990264a4c37f7500
I20260709 13:11:11.918735  3608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c652ee924483475ca112a24c297bfcea"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
mode: GRACEFUL
new_leader_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:40890
I20260709 13:11:11.919199  3608 raft_consensus.cc:606] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Received request to transfer leadership to TS d557ee59894049b3990264a4c37f7500
I20260709 13:11:11.920423 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:11.920935 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:11.921564 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.983608  3940 raft_consensus.cc:993] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: : Instructing follower d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:11.984347  3941 raft_consensus.cc:1081] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Signalling peer d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:11.985803  3682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b412602c04244351820e62951d13f4f4"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:43872
I20260709 13:11:11.986406  3682 raft_consensus.cc:493] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.986721  3682 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.992175  3682 raft_consensus.cc:515] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.993851  3682 leader_election.cc:290] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:11.994628  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:11.994923  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412602c04244351820e62951d13f4f4" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:11.995324  3876 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.995535  3608 raft_consensus.cc:3055] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.995903  3608 raft_consensus.cc:740] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:11.996572  3608 consensus_queue.cc:260] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:11.997437  3608 raft_consensus.cc:3060] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.002231  3876 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:12.002898  3608 raft_consensus.cc:2468] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:12.003644  3645 leader_election.cc:304] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:12.004460  3763 raft_consensus.cc:2804] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:12.004841  3763 raft_consensus.cc:697] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:12.005509  3763 consensus_queue.cc:237] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:12.011427  3428 catalog_manager.cc:5697] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 2 to 3, leader changed from a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.111937  3940 raft_consensus.cc:993] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: : Instructing follower d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:12.112372  3941 raft_consensus.cc:1081] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Signalling peer d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:12.113766  3682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c652ee924483475ca112a24c297bfcea"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:43872
I20260709 13:11:12.114215  3682 raft_consensus.cc:493] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.114519  3682 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.118942  3682 raft_consensus.cc:515] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:12.120736  3682 leader_election.cc:290] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:12.121485  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:12.121781  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:12.122107  3876 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.122359  3608 raft_consensus.cc:3055] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.122679  3608 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:12.123338  3608 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:12.124373  3608 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.127451  3876 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 2.
I20260709 13:11:12.128965  3645 leader_election.cc:304] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:12.129029  3608 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 2.
I20260709 13:11:12.129735  3763 raft_consensus.cc:2804] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.130239  3763 raft_consensus.cc:697] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:12.131032  3763 consensus_queue.cc:237] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:12.137987  3428 catalog_manager.cc:5697] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 1 to 2, leader changed from a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.415323  3876 raft_consensus.cc:1275] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:12.417095  3763 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:12.424175  3608 raft_consensus.cc:1275] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:12.425830  3935 consensus_queue.cc:1048] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:12.446436  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:12.583537  3876 raft_consensus.cc:1275] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:12.584918  3950 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.594358  3608 raft_consensus.cc:1275] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:12.595719  3955 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.927883 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.935465  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:12.936002  3682 raft_consensus.cc:606] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:12.938274  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:12.938659  3682 raft_consensus.cc:606] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:12.939656 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:12.940160 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:12.940714 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.333297  3935 raft_consensus.cc:993] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:13.333765  3955 raft_consensus.cc:1081] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:13.335176  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:13.335587  3608 raft_consensus.cc:493] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.335912  3608 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.340340  3608 raft_consensus.cc:515] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.341909  3608 leader_election.cc:290] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:13.342765  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:13.342957  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:13.343333  3876 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.343583  3682 raft_consensus.cc:3055] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.343966  3682 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:13.344633  3682 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.345532  3682 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.348814  3876 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:13.350075  3682 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 2.
I20260709 13:11:13.350086  3571 leader_election.cc:304] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:13.351199  3941 raft_consensus.cc:2804] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.351816  3941 raft_consensus.cc:697] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:13.352706  3941 consensus_queue.cc:237] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.360024  3428 catalog_manager.cc:5697] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 1 to 2, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:13.447499  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:13.494287  3935 raft_consensus.cc:993] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:13.494928  3955 raft_consensus.cc:1081] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:13.496392  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:13.496814  3608 raft_consensus.cc:493] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.497066  3608 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.501523  3608 raft_consensus.cc:515] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.502993  3608 leader_election.cc:290] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:13.503875  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:13.504093  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538572c5a2274d4cafd1f87db55381f4" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:13.504575  3876 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.504663  3682 raft_consensus.cc:3055] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.505059  3682 raft_consensus.cc:740] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:13.505834  3682 consensus_queue.cc:260] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.506726  3682 raft_consensus.cc:3060] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.510309  3876 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:13.511093  3682 raft_consensus.cc:2468] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:13.511483  3571 leader_election.cc:304] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:13.512365  3941 raft_consensus.cc:2804] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:13.512794  3941 raft_consensus.cc:697] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:13.513598  3941 consensus_queue.cc:237] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:13.519984  3428 catalog_manager.cc:5697] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 2 to 3, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.834263  3876 raft_consensus.cc:1275] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.835554  3941 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.845353  3682 raft_consensus.cc:1275] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.846805  3967 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.894261  3682 raft_consensus.cc:1275] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.895468  3967 consensus_queue.cc:1048] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:13.904795  3876 raft_consensus.cc:1275] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.907015  3967 consensus_queue.cc:1048] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:13.947003 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.954898  3608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
mode: GRACEFUL
new_leader_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:40890
I20260709 13:11:13.955440  3608 raft_consensus.cc:606] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Received request to transfer leadership to TS d557ee59894049b3990264a4c37f7500
I20260709 13:11:13.957983  3608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
mode: GRACEFUL
new_leader_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:40890
I20260709 13:11:13.958468  3608 raft_consensus.cc:606] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Received request to transfer leadership to TS d557ee59894049b3990264a4c37f7500
I20260709 13:11:13.959682 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:13.960198 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:13.960793 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.154273  3972 raft_consensus.cc:993] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: : Instructing follower d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:14.154860  3957 raft_consensus.cc:1081] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Signalling peer d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:14.156334  3682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:43872
I20260709 13:11:14.156787  3682 raft_consensus.cc:493] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.157089  3682 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.161612  3682 raft_consensus.cc:515] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.163123  3682 leader_election.cc:290] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:14.163957  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:14.164201  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd2ebb61e2b48b4994d258f6f4b251a" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:14.164556  3876 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.164788  3608 raft_consensus.cc:3055] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.165126  3608 raft_consensus.cc:740] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:14.165751  3608 consensus_queue.cc:260] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.166710  3608 raft_consensus.cc:3060] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.169982  3876 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:14.171144  3608 raft_consensus.cc:2468] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:14.171136  3645 leader_election.cc:304] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:14.172226  3955 raft_consensus.cc:2804] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:14.173177  3955 raft_consensus.cc:697] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:14.174001  3955 consensus_queue.cc:237] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.180150  3430 catalog_manager.cc:5697] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 2 to 3, leader changed from a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.365939  3957 raft_consensus.cc:993] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: : Instructing follower d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:14.366540  3967 raft_consensus.cc:1081] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Signalling peer d557ee59894049b3990264a4c37f7500 to start an election
I20260709 13:11:14.368060  3682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
 from {username='slave'} at 127.0.0.1:43872
I20260709 13:11:14.368520  3682 raft_consensus.cc:493] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.368820  3682 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.373385  3682 raft_consensus.cc:515] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.374724  3682 leader_election.cc:290] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323)
I20260709 13:11:14.375636  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:14.375854  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf136ca2fa471e82170cffb900d09b" candidate_uuid: "d557ee59894049b3990264a4c37f7500" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
I20260709 13:11:14.376304  3876 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.376406  3608 raft_consensus.cc:3055] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.376771  3608 raft_consensus.cc:740] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:14.377413  3608 consensus_queue.cc:260] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.378363  3608 raft_consensus.cc:3060] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.382577  3876 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:14.382627  3608 raft_consensus.cc:2468] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d557ee59894049b3990264a4c37f7500 in term 3.
I20260709 13:11:14.383905  3646 leader_election.cc:304] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c7dd8fec96436e83724f6dbec5ce02, d557ee59894049b3990264a4c37f7500; no voters: 
I20260709 13:11:14.384603  3955 raft_consensus.cc:2804] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:14.385213  3955 raft_consensus.cc:697] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Becoming Leader. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:14.386108  3955 consensus_queue.cc:237] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:14.393153  3430 catalog_manager.cc:5697] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 reported cstate change: term changed from 2 to 3, leader changed from a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194) to d557ee59894049b3990264a4c37f7500 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "d557ee59894049b3990264a4c37f7500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.448576  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:14.575526  3876 raft_consensus.cc:1275] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.576961  3955 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.590749  3608 raft_consensus.cc:1275] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.592633  3955 consensus_queue.cc:1048] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:14.769344  3608 raft_consensus.cc:1275] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.770653  3983 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.779636  3876 raft_consensus.cc:1275] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer d557ee59894049b3990264a4c37f7500: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.781163  3974 consensus_queue.cc:1048] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:14.967437 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.974673  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:14.975208  3682 raft_consensus.cc:606] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:14.977607  3682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c652ee924483475ca112a24c297bfcea"
dest_uuid: "d557ee59894049b3990264a4c37f7500"
mode: GRACEFUL
new_leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:36418
I20260709 13:11:14.978070  3682 raft_consensus.cc:606] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Received request to transfer leadership to TS a2c7dd8fec96436e83724f6dbec5ce02
I20260709 13:11:14.979058 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:14.979588 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:14.980238 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.088383  3955 raft_consensus.cc:993] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:15.088886  3974 raft_consensus.cc:1081] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:15.090304  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:15.090723  3608 raft_consensus.cc:493] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.090946  3608 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.096100  3608 raft_consensus.cc:515] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.097661  3608 leader_election.cc:290] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:15.098512  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:15.098667  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702a47174ef44a48434c2ff36e7f245" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:15.099084  3876 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.099287  3682 raft_consensus.cc:3055] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:15.099730  3682 raft_consensus.cc:740] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:15.100483  3682 consensus_queue.cc:260] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.101694  3682 raft_consensus.cc:3060] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.105247  3876 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:15.106345  3571 leader_election.cc:304] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:15.106462  3682 raft_consensus.cc:2468] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:15.107219  3967 raft_consensus.cc:2804] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:15.108343  3967 raft_consensus.cc:697] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:15.109277  3967 consensus_queue.cc:237] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.116001  3428 catalog_manager.cc:5697] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 2 to 3, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.239173  3955 raft_consensus.cc:993] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: : Instructing follower a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:15.239598  3974 raft_consensus.cc:1081] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Signalling peer a2c7dd8fec96436e83724f6dbec5ce02 to start an election
I20260709 13:11:15.241057  3608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c652ee924483475ca112a24c297bfcea"
dest_uuid: "a2c7dd8fec96436e83724f6dbec5ce02"
 from {username='slave'} at 127.0.0.1:51616
I20260709 13:11:15.241467  3608 raft_consensus.cc:493] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.241696  3608 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.245983  3608 raft_consensus.cc:515] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.247385  3608 leader_election.cc:290] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Requested vote from peers 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105), d557ee59894049b3990264a4c37f7500 (127.24.232.195:45579)
I20260709 13:11:15.248425  3682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d557ee59894049b3990264a4c37f7500"
I20260709 13:11:15.248340  3876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652ee924483475ca112a24c297bfcea" candidate_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5be1dca7fa934c32847f9cbf201a647d"
I20260709 13:11:15.249177  3682 raft_consensus.cc:3055] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:15.249239  3876 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.249588  3682 raft_consensus.cc:740] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d557ee59894049b3990264a4c37f7500, State: Running, Role: LEADER
I20260709 13:11:15.250355  3682 consensus_queue.cc:260] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.251451  3682 raft_consensus.cc:3060] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.255959  3876 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:15.257205  3571 leader_election.cc:304] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5be1dca7fa934c32847f9cbf201a647d, a2c7dd8fec96436e83724f6dbec5ce02; no voters: 
I20260709 13:11:15.257539  3682 raft_consensus.cc:2468] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c7dd8fec96436e83724f6dbec5ce02 in term 3.
I20260709 13:11:15.258014  3967 raft_consensus.cc:2804] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:15.258710  3967 raft_consensus.cc:697] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Becoming Leader. State: Replica: a2c7dd8fec96436e83724f6dbec5ce02, State: Running, Role: LEADER
I20260709 13:11:15.259475  3967 consensus_queue.cc:237] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } }
I20260709 13:11:15.266522  3428 catalog_manager.cc:5697] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 reported cstate change: term changed from 2 to 3, leader changed from d557ee59894049b3990264a4c37f7500 (127.24.232.195) to a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194). New cstate: current_term: 3 leader_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c7dd8fec96436e83724f6dbec5ce02" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:15.449520  3479 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:15.552191  3682 raft_consensus.cc:1275] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.553610  3967 consensus_queue.cc:1048] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.563472  3876 raft_consensus.cc:1275] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.565228  3986 consensus_queue.cc:1048] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.675638  3876 raft_consensus.cc:1275] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.676983  3967 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5be1dca7fa934c32847f9cbf201a647d" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.685495  3682 raft_consensus.cc:1275] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Refusing update from remote peer a2c7dd8fec96436e83724f6dbec5ce02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.687163  3967 consensus_queue.cc:1048] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d557ee59894049b3990264a4c37f7500" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.986140 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:16.013732 25507 tablet_server.cc:179] TabletServer@127.24.232.193:36105 shutting down...
W20260709 13:11:16.019026  3645 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 87 similar messages]
W20260709 13:11:16.024001  3645 consensus_peers.cc:597] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.030639  3571 consensus_peers.cc:597] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:16.039113  3571 consensus_peers.cc:597] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.039808 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:16.040522 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.041141 25507 raft_consensus.cc:2243] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.041599 25507 raft_consensus.cc:2272] T 3f7596a1c7974891a61bcffa19486290 P 5be1dca7fa934c32847f9cbf201a647d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.043503 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.044123 25507 raft_consensus.cc:2243] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.044554 25507 raft_consensus.cc:2272] T 3cd2ebb61e2b48b4994d258f6f4b251a P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.046289 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.046808 25507 raft_consensus.cc:2243] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.047226 25507 raft_consensus.cc:2272] T c652ee924483475ca112a24c297bfcea P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.049711 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.050408 25507 raft_consensus.cc:2243] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.050880 25507 raft_consensus.cc:2272] T 9702a47174ef44a48434c2ff36e7f245 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.053565 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.054103 25507 raft_consensus.cc:2243] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.054589 25507 raft_consensus.cc:2272] T 455e11add10b4cf3b082b0c5fe8f874e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.056782 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.057471 25507 raft_consensus.cc:2243] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.057847 25507 raft_consensus.cc:2272] T 538572c5a2274d4cafd1f87db55381f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.059556 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.060168 25507 raft_consensus.cc:2243] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.060571 25507 raft_consensus.cc:2272] T 675cf94f10314d5696a4a225e696914f P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.062348 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.062848 25507 raft_consensus.cc:2243] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.063213 25507 raft_consensus.cc:2272] T 596627a990884ddf8125677b30c7494e P 5be1dca7fa934c32847f9cbf201a647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.065001 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.065480 25507 raft_consensus.cc:2243] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.065888 25507 raft_consensus.cc:2272] T 55bf136ca2fa471e82170cffb900d09b P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.067605 25507 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:16.068132 25507 raft_consensus.cc:2243] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.068545 25507 raft_consensus.cc:2272] T b412602c04244351820e62951d13f4f4 P 5be1dca7fa934c32847f9cbf201a647d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.098151  3645 consensus_peers.cc:597] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.099293 25507 tablet_server.cc:196] TabletServer@127.24.232.193:36105 shutdown complete.
W20260709 13:11:16.101253  3645 consensus_peers.cc:597] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.119434 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
I20260709 13:11:16.145248 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:16.146088 25507 tablet_replica.cc:333] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.146739 25507 raft_consensus.cc:2243] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.147512 25507 raft_consensus.cc:2272] T 675cf94f10314d5696a4a225e696914f P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.149839 25507 tablet_replica.cc:333] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.150516 25507 raft_consensus.cc:2243] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.151230 25507 raft_consensus.cc:2272] T 538572c5a2274d4cafd1f87db55381f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.153230 25507 tablet_replica.cc:333] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.153699 25507 raft_consensus.cc:2243] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.154423 25507 raft_consensus.cc:2272] T 455e11add10b4cf3b082b0c5fe8f874e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.156813 25507 tablet_replica.cc:333] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.157428 25507 raft_consensus.cc:2243] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.158195 25507 raft_consensus.cc:2272] T 9702a47174ef44a48434c2ff36e7f245 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.160820 25507 tablet_replica.cc:333] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
W20260709 13:11:16.160969  3571 consensus_peers.cc:597] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 -> Peer 5be1dca7fa934c32847f9cbf201a647d (127.24.232.193:36105): Couldn't send request to peer 5be1dca7fa934c32847f9cbf201a647d. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:36105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.161490 25507 raft_consensus.cc:2243] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.162060 25507 raft_consensus.cc:2272] T 3cd2ebb61e2b48b4994d258f6f4b251a P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.164230 25507 tablet_replica.cc:333] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.164785 25507 raft_consensus.cc:2243] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.165593 25507 raft_consensus.cc:2272] T c652ee924483475ca112a24c297bfcea P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.168175 25507 tablet_replica.cc:333] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.168722 25507 raft_consensus.cc:2243] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.169484 25507 raft_consensus.cc:2272] T 3f7596a1c7974891a61bcffa19486290 P a2c7dd8fec96436e83724f6dbec5ce02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.171528 25507 tablet_replica.cc:333] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.172056 25507 raft_consensus.cc:2243] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.172567 25507 raft_consensus.cc:2272] T b412602c04244351820e62951d13f4f4 P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.175379 25507 tablet_replica.cc:333] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.176082 25507 raft_consensus.cc:2243] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.176577 25507 raft_consensus.cc:2272] T 55bf136ca2fa471e82170cffb900d09b P a2c7dd8fec96436e83724f6dbec5ce02 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:16.178049  3646 consensus_peers.cc:597] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 -> Peer a2c7dd8fec96436e83724f6dbec5ce02 (127.24.232.194:40323): Couldn't send request to peer a2c7dd8fec96436e83724f6dbec5ce02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.179059 25507 tablet_replica.cc:333] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02: stopping tablet replica
I20260709 13:11:16.179575 25507 raft_consensus.cc:2243] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.180059 25507 raft_consensus.cc:2272] T 596627a990884ddf8125677b30c7494e P a2c7dd8fec96436e83724f6dbec5ce02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.212598 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
I20260709 13:11:16.238788 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
I20260709 13:11:16.266925 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:16.267652 25507 tablet_replica.cc:333] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.268432 25507 raft_consensus.cc:2243] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.268929 25507 raft_consensus.cc:2272] T 675cf94f10314d5696a4a225e696914f P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.271189 25507 tablet_replica.cc:333] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.271854 25507 raft_consensus.cc:2243] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.272281 25507 raft_consensus.cc:2272] T 3f7596a1c7974891a61bcffa19486290 P d557ee59894049b3990264a4c37f7500 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.274897 25507 tablet_replica.cc:333] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.275446 25507 raft_consensus.cc:2243] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.275924 25507 raft_consensus.cc:2272] T 455e11add10b4cf3b082b0c5fe8f874e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.278131 25507 tablet_replica.cc:333] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.278667 25507 raft_consensus.cc:2243] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.279064 25507 raft_consensus.cc:2272] T 538572c5a2274d4cafd1f87db55381f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.281030 25507 tablet_replica.cc:333] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.281546 25507 raft_consensus.cc:2243] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.282284 25507 raft_consensus.cc:2272] T 3cd2ebb61e2b48b4994d258f6f4b251a P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.284355 25507 tablet_replica.cc:333] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.284848 25507 raft_consensus.cc:2243] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.285243 25507 raft_consensus.cc:2272] T c652ee924483475ca112a24c297bfcea P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.288107 25507 tablet_replica.cc:333] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.288661 25507 raft_consensus.cc:2243] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.289391 25507 raft_consensus.cc:2272] T b412602c04244351820e62951d13f4f4 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.291303 25507 tablet_replica.cc:333] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.291822 25507 raft_consensus.cc:2243] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.292568 25507 raft_consensus.cc:2272] T 55bf136ca2fa471e82170cffb900d09b P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.294607 25507 tablet_replica.cc:333] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.295147 25507 raft_consensus.cc:2243] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.296026 25507 raft_consensus.cc:2272] T 596627a990884ddf8125677b30c7494e P d557ee59894049b3990264a4c37f7500 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.298053 25507 tablet_replica.cc:333] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500: stopping tablet replica
I20260709 13:11:16.298569 25507 raft_consensus.cc:2243] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.298976 25507 raft_consensus.cc:2272] T 9702a47174ef44a48434c2ff36e7f245 P d557ee59894049b3990264a4c37f7500 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.330387 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:11:16.356761 25507 master.cc:562] Master@127.24.232.254:45001 shutting down...
I20260709 13:11:16.384694 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:16.385313 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.385689 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P b76e5823daf54fef9d2faa6ab385c68d: stopping tablet replica
I20260709 13:11:16.422135 25507 master.cc:584] Master@127.24.232.254:45001 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13165 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:11:16.467654 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:33351
I20260709 13:11:16.468834 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:16.473834  4008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.473829  4007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.476516  4010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:16.476632 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:16.477751 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:16.477923 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:16.478165 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602676478131 us; error 0 us; skew 500 ppm
I20260709 13:11:16.478726 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:16.481310 25507 webserver.cc:533] Webserver started at http://127.24.232.254:46261/ using document root <none> and password file <none>
I20260709 13:11:16.481817 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:16.482002 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:16.482287 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:16.483351 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "d88a559fcfe649fbad511cf20c8043f2"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.487741 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:11:16.491039  4015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.491806 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:16.492100 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "d88a559fcfe649fbad511cf20c8043f2"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.492388 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:16.528590 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:16.529785 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:16.566612 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:33351
I20260709 13:11:16.566715  4066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:33351 every 8 connection(s)
I20260709 13:11:16.570499  4067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.581584  4067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2: Bootstrap starting.
I20260709 13:11:16.586421  4067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.590785  4067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2: No bootstrap required, opened a new log
I20260709 13:11:16.593011  4067 raft_consensus.cc:359] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER }
I20260709 13:11:16.593381  4067 raft_consensus.cc:385] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:16.593721  4067 raft_consensus.cc:740] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88a559fcfe649fbad511cf20c8043f2, State: Initialized, Role: FOLLOWER
I20260709 13:11:16.594389  4067 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER }
I20260709 13:11:16.594851  4067 raft_consensus.cc:399] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:16.595088  4067 raft_consensus.cc:493] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:16.595336  4067 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.600123  4067 raft_consensus.cc:515] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER }
I20260709 13:11:16.600646  4067 leader_election.cc:304] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d88a559fcfe649fbad511cf20c8043f2; no voters: 
I20260709 13:11:16.601778  4067 leader_election.cc:290] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:16.602113  4070 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:16.603494  4070 raft_consensus.cc:697] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 1 LEADER]: Becoming Leader. State: Replica: d88a559fcfe649fbad511cf20c8043f2, State: Running, Role: LEADER
I20260709 13:11:16.604179  4070 consensus_queue.cc:237] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER }
I20260709 13:11:16.604931  4067 sys_catalog.cc:565] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:16.610375  4072 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d88a559fcfe649fbad511cf20c8043f2. Latest consensus state: current_term: 1 leader_uuid: "d88a559fcfe649fbad511cf20c8043f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER } }
I20260709 13:11:16.611003  4072 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:16.612845  4078 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:16.613473  4071 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d88a559fcfe649fbad511cf20c8043f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88a559fcfe649fbad511cf20c8043f2" member_type: VOTER } }
I20260709 13:11:16.613940  4071 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:16.621037  4078 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:16.622072 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:16.630210  4078 catalog_manager.cc:1383] Generated new cluster ID: b212500ee63442e7b42e50951525e537
I20260709 13:11:16.630535  4078 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:16.656858  4078 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:16.658601  4078 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:16.669606  4078 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2: Generated new TSK 0
I20260709 13:11:16.670282  4078 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:16.690135 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:16.696432  4088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.697533  4089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.699213  4091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:16.699252 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:16.700624 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:16.700809 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:16.700929 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602676700917 us; error 0 us; skew 500 ppm
I20260709 13:11:16.701396 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:16.703632 25507 webserver.cc:533] Webserver started at http://127.24.232.193:41813/ using document root <none> and password file <none>
I20260709 13:11:16.704151 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:16.704303 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:16.704504 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:16.705595 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "2af8d123902a47308f8c6f3754058bc1"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.709959 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:16.713263  4096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.714118 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:16.714385 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "2af8d123902a47308f8c6f3754058bc1"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.714643 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:16.735270 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:16.736438 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:16.737848 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:16.740293 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:16.740533 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.740849 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:16.740985 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.782099 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:46587
I20260709 13:11:16.782219  4158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:46587 every 8 connection(s)
I20260709 13:11:16.787199 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:16.794850  4163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.795846  4164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.798127  4166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:16.798974 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:16.800310 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:16.800606 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:16.800798 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602676800782 us; error 0 us; skew 500 ppm
I20260709 13:11:16.801342 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:16.801682  4159 heartbeater.cc:344] Connected to a master server at 127.24.232.254:33351
I20260709 13:11:16.802104  4159 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:16.802978  4159 heartbeater.cc:507] Master 127.24.232.254:33351 requested a full tablet report, sending...
I20260709 13:11:16.804056 25507 webserver.cc:533] Webserver started at http://127.24.232.194:39273/ using document root <none> and password file <none>
I20260709 13:11:16.804664 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:16.804878 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:16.805156 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:16.805243  4032 ts_manager.cc:194] Registered new tserver with Master: 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193:46587)
I20260709 13:11:16.806304 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "255c79c8e1d2427a89a06169979ae46f"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.807196  4032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46336
I20260709 13:11:16.810963 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:11:16.814697  4171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.815462 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:16.815809 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "255c79c8e1d2427a89a06169979ae46f"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.816146 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:16.846113 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:16.847379 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:16.848951 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:16.851204 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:16.851432 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.851699 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:16.851876 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.891513 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:34063
I20260709 13:11:16.891608  4233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:34063 every 8 connection(s)
I20260709 13:11:16.896417 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:16.904189  4237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.904822  4238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:16.908159  4240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:16.908602 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:16.909641 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:16.909884 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:16.910110 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602676910091 us; error 0 us; skew 500 ppm
I20260709 13:11:16.910804 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:16.910739  4234 heartbeater.cc:344] Connected to a master server at 127.24.232.254:33351
I20260709 13:11:16.911518  4234 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:16.912595  4234 heartbeater.cc:507] Master 127.24.232.254:33351 requested a full tablet report, sending...
I20260709 13:11:16.914135 25507 webserver.cc:533] Webserver started at http://127.24.232.195:44223/ using document root <none> and password file <none>
I20260709 13:11:16.914832 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:16.915095 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:16.915118  4032 ts_manager.cc:194] Registered new tserver with Master: 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063)
I20260709 13:11:16.915513 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:16.917150 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "02e55fc244ca4f638af65aabbb096948"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.917167  4032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46340
I20260709 13:11:16.922775 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:11:16.926374  4245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.927143 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:11:16.927466 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "02e55fc244ca4f638af65aabbb096948"
format_stamp: "Formatted at 2026-07-09 13:11:16 on dist-test-slave-sdg5"
I20260709 13:11:16.927836 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:16.946578 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:16.947952 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:16.949417 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:16.951781 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:16.952005 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.952279 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:16.952492 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:16.992880 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:45711
I20260709 13:11:16.993000  4307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:45711 every 8 connection(s)
I20260709 13:11:17.007035  4308 heartbeater.cc:344] Connected to a master server at 127.24.232.254:33351
I20260709 13:11:17.007503  4308 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:17.008361  4308 heartbeater.cc:507] Master 127.24.232.254:33351 requested a full tablet report, sending...
I20260709 13:11:17.010460  4032 ts_manager.cc:194] Registered new tserver with Master: 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.010582 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014483765s
I20260709 13:11:17.012343  4032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46350
I20260709 13:11:17.038697  4032 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46356:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:17.041082  4032 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:17.100329  4273 tablet_service.cc:1511] Processing CreateTablet for tablet 24c70a00b62c438b9fc590eca2b6f13e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.101815  4273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c70a00b62c438b9fc590eca2b6f13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.108973  4124 tablet_service.cc:1511] Processing CreateTablet for tablet 24c70a00b62c438b9fc590eca2b6f13e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.110463  4124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c70a00b62c438b9fc590eca2b6f13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.111825  4123 tablet_service.cc:1511] Processing CreateTablet for tablet c3f138f0d1c44e57889a7ce66084f038 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.112811  4272 tablet_service.cc:1511] Processing CreateTablet for tablet c3f138f0d1c44e57889a7ce66084f038 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.113408  4123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f138f0d1c44e57889a7ce66084f038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.114251  4272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f138f0d1c44e57889a7ce66084f038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.113886  4199 tablet_service.cc:1511] Processing CreateTablet for tablet 24c70a00b62c438b9fc590eca2b6f13e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.116333  4199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c70a00b62c438b9fc590eca2b6f13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.116809  4198 tablet_service.cc:1511] Processing CreateTablet for tablet c3f138f0d1c44e57889a7ce66084f038 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=809c09ace00542158aae50e43b1a6ce5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.118038  4198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f138f0d1c44e57889a7ce66084f038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.140654  4323 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: Bootstrap starting.
I20260709 13:11:17.144624  4324 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: Bootstrap starting.
I20260709 13:11:17.152529  4323 tablet_bootstrap.cc:654] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.157040  4324 tablet_bootstrap.cc:654] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.162537  4325 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: Bootstrap starting.
I20260709 13:11:17.164806  4323 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: No bootstrap required, opened a new log
I20260709 13:11:17.165305  4323 ts_tablet_manager.cc:1403] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:11:17.165925  4324 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: No bootstrap required, opened a new log
I20260709 13:11:17.166524  4324 ts_tablet_manager.cc:1403] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:11:17.167832  4323 raft_consensus.cc:359] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.168642  4323 raft_consensus.cc:385] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.168967  4323 raft_consensus.cc:740] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.169935  4324 raft_consensus.cc:359] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.169891  4323 consensus_queue.cc:260] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.170815  4324 raft_consensus.cc:385] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.171178  4324 raft_consensus.cc:740] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.172461  4325 tablet_bootstrap.cc:654] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.172129  4324 consensus_queue.cc:260] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.172724  4308 heartbeater.cc:499] Master 127.24.232.254:33351 was elected leader, sending a full tablet report...
I20260709 13:11:17.173204  4323 ts_tablet_manager.cc:1434] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:11:17.174266  4323 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Bootstrap starting.
I20260709 13:11:17.183272  4323 tablet_bootstrap.cc:654] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.184756  4325 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: No bootstrap required, opened a new log
I20260709 13:11:17.185395  4325 ts_tablet_manager.cc:1403] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:11:17.190047  4325 raft_consensus.cc:359] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.191232  4325 raft_consensus.cc:385] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.191685  4325 raft_consensus.cc:740] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255c79c8e1d2427a89a06169979ae46f, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.193114  4325 consensus_queue.cc:260] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.202768  4234 heartbeater.cc:499] Master 127.24.232.254:33351 was elected leader, sending a full tablet report...
I20260709 13:11:17.204562  4325 ts_tablet_manager.cc:1434] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:11:17.206156  4325 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: Bootstrap starting.
I20260709 13:11:17.216485  4325 tablet_bootstrap.cc:654] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.230247  4325 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: No bootstrap required, opened a new log
I20260709 13:11:17.231020  4325 ts_tablet_manager.cc:1403] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 13:11:17.232782  4329 raft_consensus.cc:493] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.233006  4159 heartbeater.cc:499] Master 127.24.232.254:33351 was elected leader, sending a full tablet report...
I20260709 13:11:17.234092  4329 raft_consensus.cc:515] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.235762  4325 raft_consensus.cc:359] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.233553  4324 ts_tablet_manager.cc:1434] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: Time spent starting tablet: real 0.067s	user 0.036s	sys 0.028s
I20260709 13:11:17.236675  4323 tablet_bootstrap.cc:492] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: No bootstrap required, opened a new log
I20260709 13:11:17.237286  4323 ts_tablet_manager.cc:1403] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.042s
I20260709 13:11:17.237636  4324 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Bootstrap starting.
I20260709 13:11:17.236701  4325 raft_consensus.cc:385] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.240149  4325 raft_consensus.cc:740] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255c79c8e1d2427a89a06169979ae46f, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.241309  4325 consensus_queue.cc:260] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.244405  4325 ts_tablet_manager.cc:1434] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:11:17.245960  4323 raft_consensus.cc:359] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.246783  4323 raft_consensus.cc:385] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.247112  4323 raft_consensus.cc:740] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.248145  4323 consensus_queue.cc:260] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.250461  4323 ts_tablet_manager.cc:1434] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:17.252920  4329 leader_election.cc:290] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.257129  4324 tablet_bootstrap.cc:654] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.262856  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f" is_pre_election: true
I20260709 13:11:17.263695  4209 raft_consensus.cc:2468] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.265790  4099 leader_election.cc:304] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255c79c8e1d2427a89a06169979ae46f, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.266763  4329 raft_consensus.cc:2804] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.267158  4329 raft_consensus.cc:493] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.267479  4329 raft_consensus.cc:3060] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.267791  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948" is_pre_election: true
I20260709 13:11:17.268529  4283 raft_consensus.cc:2468] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.269038  4324 tablet_bootstrap.cc:492] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: No bootstrap required, opened a new log
I20260709 13:11:17.269582  4324 ts_tablet_manager.cc:1403] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 13:11:17.272713  4324 raft_consensus.cc:359] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.273288  4324 raft_consensus.cc:385] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.273562  4324 raft_consensus.cc:740] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.274255  4324 consensus_queue.cc:260] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.274422  4329 raft_consensus.cc:515] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.276276  4324 ts_tablet_manager.cc:1434] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:17.276418  4329 leader_election.cc:290] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Requested vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.277525  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948"
I20260709 13:11:17.277771  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.278147  4283 raft_consensus.cc:3060] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.278391  4209 raft_consensus.cc:3060] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.284895  4209 raft_consensus.cc:2468] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.285128  4283 raft_consensus.cc:2468] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.285966  4099 leader_election.cc:304] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255c79c8e1d2427a89a06169979ae46f, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.286878  4329 raft_consensus.cc:2804] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.287395  4329 raft_consensus.cc:697] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.288151  4329 consensus_queue.cc:237] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.296263  4031 catalog_manager.cc:5697] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "2af8d123902a47308f8c6f3754058bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.299612  4328 raft_consensus.cc:493] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.300213  4328 raft_consensus.cc:515] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.302853  4328 leader_election.cc:290] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193:46587), 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063)
I20260709 13:11:17.313076  4134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af8d123902a47308f8c6f3754058bc1" is_pre_election: true
I20260709 13:11:17.313901  4134 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e55fc244ca4f638af65aabbb096948 in term 0.
I20260709 13:11:17.314586  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f" is_pre_election: true
I20260709 13:11:17.315155  4246 leader_election.cc:304] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.315363  4209 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e55fc244ca4f638af65aabbb096948 in term 0.
I20260709 13:11:17.316107  4328 raft_consensus.cc:2804] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.316509  4328 raft_consensus.cc:493] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.316798  4328 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.322180  4328 raft_consensus.cc:515] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.323869  4328 leader_election.cc:290] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 1 election: Requested vote from peers 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193:46587), 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063)
I20260709 13:11:17.324847  4134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
I20260709 13:11:17.324934  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.325589  4134 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.325654  4209 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.330862  4209 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e55fc244ca4f638af65aabbb096948 in term 1.
I20260709 13:11:17.331243  4134 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e55fc244ca4f638af65aabbb096948 in term 1.
I20260709 13:11:17.332072  4248 leader_election.cc:304] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 255c79c8e1d2427a89a06169979ae46f; no voters: 
I20260709 13:11:17.332902  4328 raft_consensus.cc:2804] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.333822  4328 raft_consensus.cc:697] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 LEADER]: Becoming Leader. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Running, Role: LEADER
I20260709 13:11:17.334481  4328 consensus_queue.cc:237] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.342072  4031 catalog_manager.cc:5697] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e55fc244ca4f638af65aabbb096948 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "02e55fc244ca4f638af65aabbb096948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.381271  4031 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46360:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:17.383219  4031 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:17.406080  4124 tablet_service.cc:1511] Processing CreateTablet for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.407343  4124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.407287  4198 tablet_service.cc:1511] Processing CreateTablet for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.408771  4198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.410506  4123 tablet_service.cc:1511] Processing CreateTablet for tablet f87c040f5de946c39f7ee8181faad2ab (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.411782  4123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c040f5de946c39f7ee8181faad2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.412446  4272 tablet_service.cc:1511] Processing CreateTablet for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:17.413415  4272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d0b29d586f41dcb67ebfc3d8f7a9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.428248  4325 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Bootstrap starting.
I20260709 13:11:17.428292  4323 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: Bootstrap starting.
I20260709 13:11:17.428463  4199 tablet_service.cc:1511] Processing CreateTablet for tablet f87c040f5de946c39f7ee8181faad2ab (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.430020  4199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c040f5de946c39f7ee8181faad2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.436020  4323 tablet_bootstrap.cc:654] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.436236  4324 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: Bootstrap starting.
I20260709 13:11:17.436757  4325 tablet_bootstrap.cc:654] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.444742  4324 tablet_bootstrap.cc:654] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.446259  4272 tablet_service.cc:1511] Processing CreateTablet for tablet f87c040f5de946c39f7ee8181faad2ab (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c981d81a3326402286be0ef862c99b2a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:17.448220  4272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c040f5de946c39f7ee8181faad2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.450143  4325 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: No bootstrap required, opened a new log
I20260709 13:11:17.450867  4325 ts_tablet_manager.cc:1403] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:11:17.455060  4323 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: No bootstrap required, opened a new log
I20260709 13:11:17.455132  4324 tablet_bootstrap.cc:492] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: No bootstrap required, opened a new log
I20260709 13:11:17.455807  4324 ts_tablet_manager.cc:1403] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:11:17.455808  4323 ts_tablet_manager.cc:1403] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.014s
I20260709 13:11:17.458920  4324 raft_consensus.cc:359] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.459267  4323 raft_consensus.cc:359] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.460207  4323 raft_consensus.cc:385] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.460601  4323 raft_consensus.cc:740] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.454710  4325 raft_consensus.cc:359] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.459725  4324 raft_consensus.cc:385] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.461436  4324 raft_consensus.cc:740] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.461138  4325 raft_consensus.cc:385] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.461534  4323 consensus_queue.cc:260] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.462401  4325 raft_consensus.cc:740] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255c79c8e1d2427a89a06169979ae46f, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.463322  4325 consensus_queue.cc:260] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.464398  4323 ts_tablet_manager.cc:1434] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:17.465617  4325 ts_tablet_manager.cc:1434] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:11:17.470533  4323 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: Bootstrap starting.
I20260709 13:11:17.470851  4324 consensus_queue.cc:260] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.475116  4324 ts_tablet_manager.cc:1434] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:17.476238  4324 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: Bootstrap starting.
I20260709 13:11:17.477394  4325 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: Bootstrap starting.
I20260709 13:11:17.478509  4323 tablet_bootstrap.cc:654] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.484571  4324 tablet_bootstrap.cc:654] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.484745  4325 tablet_bootstrap.cc:654] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.494742  4323 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: No bootstrap required, opened a new log
I20260709 13:11:17.495326  4323 ts_tablet_manager.cc:1403] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 13:11:17.495535  4324 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: No bootstrap required, opened a new log
I20260709 13:11:17.496111  4324 ts_tablet_manager.cc:1403] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:11:17.496620  4325 tablet_bootstrap.cc:492] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: No bootstrap required, opened a new log
I20260709 13:11:17.497143  4325 ts_tablet_manager.cc:1403] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:11:17.498374  4324 raft_consensus.cc:359] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.498402  4323 raft_consensus.cc:359] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.499038  4324 raft_consensus.cc:385] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.499338  4323 raft_consensus.cc:385] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.499424  4324 raft_consensus.cc:740] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.499794  4323 raft_consensus.cc:740] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.500144  4325 raft_consensus.cc:359] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.500342  4324 consensus_queue.cc:260] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.500905  4325 raft_consensus.cc:385] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.500653  4323 consensus_queue.cc:260] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.501302  4325 raft_consensus.cc:740] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255c79c8e1d2427a89a06169979ae46f, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.502208  4325 consensus_queue.cc:260] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.504380  4325 ts_tablet_manager.cc:1434] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:17.505494  4324 ts_tablet_manager.cc:1434] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:17.506286  4323 ts_tablet_manager.cc:1434] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:11:17.517593  4329 raft_consensus.cc:493] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.518225  4329 raft_consensus.cc:515] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.520043  4329 leader_election.cc:290] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.520656  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f" is_pre_election: true
I20260709 13:11:17.521001  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948" is_pre_election: true
I20260709 13:11:17.521281  4209 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.521720  4283 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.522475  4099 leader_election.cc:304] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255c79c8e1d2427a89a06169979ae46f, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.523314  4329 raft_consensus.cc:2804] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.523727  4329 raft_consensus.cc:493] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.524070  4329 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.529094  4329 raft_consensus.cc:515] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.530750  4329 leader_election.cc:290] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Requested vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.531643  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.531996  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948"
I20260709 13:11:17.532243  4209 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.532635  4283 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.537040  4209 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.538126  4099 leader_election.cc:304] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255c79c8e1d2427a89a06169979ae46f, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.538867  4283 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.538863  4329 raft_consensus.cc:2804] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.539714  4329 raft_consensus.cc:697] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.540571  4329 consensus_queue.cc:237] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.547345  4029 catalog_manager.cc:5697] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "2af8d123902a47308f8c6f3754058bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.606860  4329 raft_consensus.cc:493] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.607455  4329 raft_consensus.cc:515] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.609567  4329 leader_election.cc:290] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.610841  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87c040f5de946c39f7ee8181faad2ab" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948" is_pre_election: true
I20260709 13:11:17.611632  4283 raft_consensus.cc:2468] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.611725  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87c040f5de946c39f7ee8181faad2ab" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f" is_pre_election: true
I20260709 13:11:17.612452  4209 raft_consensus.cc:2468] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 0.
I20260709 13:11:17.612843  4099 leader_election.cc:304] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.613699  4329 raft_consensus.cc:2804] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.614048  4329 raft_consensus.cc:493] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.614403  4329 raft_consensus.cc:3060] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:17.615208  4079 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:17.620543  4329 raft_consensus.cc:515] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.622298  4329 leader_election.cc:290] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Requested vote from peers 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.622953  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87c040f5de946c39f7ee8181faad2ab" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.623231  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87c040f5de946c39f7ee8181faad2ab" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e55fc244ca4f638af65aabbb096948"
I20260709 13:11:17.623519  4209 raft_consensus.cc:3060] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.623873  4283 raft_consensus.cc:3060] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.628615  4209 raft_consensus.cc:2468] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.628733  4283 raft_consensus.cc:2468] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 1.
I20260709 13:11:17.629799  4099 leader_election.cc:304] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255c79c8e1d2427a89a06169979ae46f, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.630561  4329 raft_consensus.cc:2804] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.630964  4329 raft_consensus.cc:697] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.631711  4329 consensus_queue.cc:237] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.638674  4029 catalog_manager.cc:5697] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "2af8d123902a47308f8c6f3754058bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.671322  4283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e"
dest_uuid: "02e55fc244ca4f638af65aabbb096948"
mode: GRACEFUL
new_leader_uuid: "2af8d123902a47308f8c6f3754058bc1"
 from {username='slave'} at 127.0.0.1:42682
I20260709 13:11:17.671911  4283 raft_consensus.cc:606] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 LEADER]: Received request to transfer leadership to TS 2af8d123902a47308f8c6f3754058bc1
I20260709 13:11:17.685132  4134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038"
dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
mode: GRACEFUL
new_leader_uuid: "02e55fc244ca4f638af65aabbb096948"
 from {username='slave'} at 127.0.0.1:46186
I20260709 13:11:17.685633  4134 raft_consensus.cc:606] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Received request to transfer leadership to TS 02e55fc244ca4f638af65aabbb096948
I20260709 13:11:17.713963 25507 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:11:17.715790 25507 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:11:17.716360 25507 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:11:17.728161  4134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1"
dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
mode: GRACEFUL
new_leader_uuid: "255c79c8e1d2427a89a06169979ae46f"
 from {username='slave'} at 127.0.0.1:46198
I20260709 13:11:17.728713  4134 raft_consensus.cc:606] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Received request to transfer leadership to TS 255c79c8e1d2427a89a06169979ae46f
I20260709 13:11:17.729930 25507 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:11:17.802947  4329 consensus_queue.cc:1048] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.813808  4333 raft_consensus.cc:993] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: : Instructing follower 02e55fc244ca4f638af65aabbb096948 to start an election
I20260709 13:11:17.814997  4329 raft_consensus.cc:1081] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Signalling peer 02e55fc244ca4f638af65aabbb096948 to start an election
I20260709 13:11:17.818420  4282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038"
dest_uuid: "02e55fc244ca4f638af65aabbb096948"
 from {username='slave'} at 127.0.0.1:42674
I20260709 13:11:17.820254  4282 raft_consensus.cc:493] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.820813  4282 raft_consensus.cc:3060] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.828227  4329 consensus_queue.cc:1048] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.836946  4282 raft_consensus.cc:515] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.848374  4282 leader_election.cc:290] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 2 election: Requested vote from peers 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193:46587), 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063)
I20260709 13:11:17.849891  4134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
I20260709 13:11:17.850474  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f138f0d1c44e57889a7ce66084f038" candidate_uuid: "02e55fc244ca4f638af65aabbb096948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.850790  4134 raft_consensus.cc:3055] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.851207  4134 raft_consensus.cc:740] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.852334  4134 consensus_queue.cc:260] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.853648  4134 raft_consensus.cc:3060] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.864554  4134 raft_consensus.cc:2468] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e55fc244ca4f638af65aabbb096948 in term 2.
I20260709 13:11:17.865962  4246 leader_election.cc:304] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 2af8d123902a47308f8c6f3754058bc1; no voters: 255c79c8e1d2427a89a06169979ae46f
I20260709 13:11:17.866906  4328 raft_consensus.cc:2804] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.868193  4328 raft_consensus.cc:697] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 LEADER]: Becoming Leader. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Running, Role: LEADER
I20260709 13:11:17.869246  4328 consensus_queue.cc:237] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.872815  4328 consensus_queue.cc:1048] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:17.877144  4030 catalog_manager.cc:5697] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 reported cstate change: term changed from 1 to 2, leader changed from 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193) to 02e55fc244ca4f638af65aabbb096948 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "02e55fc244ca4f638af65aabbb096948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.882539  4328 raft_consensus.cc:993] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: : Instructing follower 2af8d123902a47308f8c6f3754058bc1 to start an election
I20260709 13:11:17.883319  4328 raft_consensus.cc:1081] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 LEADER]: Signalling peer 2af8d123902a47308f8c6f3754058bc1 to start an election
I20260709 13:11:17.891892  4134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e"
dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
 from {username='slave'} at 127.0.0.1:46178
I20260709 13:11:17.892608  4134 raft_consensus.cc:493] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.893165  4134 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.895793  4363 consensus_queue.cc:1048] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.903033  4134 raft_consensus.cc:515] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.906600  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e55fc244ca4f638af65aabbb096948"
I20260709 13:11:17.907290  4282 raft_consensus.cc:3055] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.907634  4282 raft_consensus.cc:740] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02e55fc244ca4f638af65aabbb096948, State: Running, Role: LEADER
I20260709 13:11:17.908641  4282 consensus_queue.cc:260] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.909605  4282 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.914556  4134 leader_election.cc:290] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 2 election: Requested vote from peers 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711), 255c79c8e1d2427a89a06169979ae46f (127.24.232.194:34063)
I20260709 13:11:17.916774  4209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c70a00b62c438b9fc590eca2b6f13e" candidate_uuid: "2af8d123902a47308f8c6f3754058bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
I20260709 13:11:17.917452  4209 raft_consensus.cc:3060] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.921721  4282 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 2.
I20260709 13:11:17.923028  4099 leader_election.cc:304] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 2af8d123902a47308f8c6f3754058bc1; no voters: 
I20260709 13:11:17.923928  4333 raft_consensus.cc:2804] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.924435  4333 raft_consensus.cc:697] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.925364  4209 raft_consensus.cc:2468] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af8d123902a47308f8c6f3754058bc1 in term 2.
I20260709 13:11:17.925298  4333 consensus_queue.cc:237] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } }
I20260709 13:11:17.929838  4333 consensus_queue.cc:1048] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.932525  4030 catalog_manager.cc:5697] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 reported cstate change: term changed from 1 to 2, leader changed from 02e55fc244ca4f638af65aabbb096948 (127.24.232.195) to 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "2af8d123902a47308f8c6f3754058bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.945016  4358 consensus_queue.cc:1048] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.957377  4333 raft_consensus.cc:993] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: : Instructing follower 255c79c8e1d2427a89a06169979ae46f to start an election
I20260709 13:11:17.957873  4358 raft_consensus.cc:1081] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Signalling peer 255c79c8e1d2427a89a06169979ae46f to start an election
I20260709 13:11:17.959470  4209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1"
dest_uuid: "255c79c8e1d2427a89a06169979ae46f"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:11:17.960042  4209 raft_consensus.cc:493] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.960393  4209 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.966269  4209 raft_consensus.cc:515] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.971827  4209 leader_election.cc:290] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [CANDIDATE]: Term 2 election: Requested vote from peers 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193:46587), 02e55fc244ca4f638af65aabbb096948 (127.24.232.195:45711)
I20260709 13:11:17.983566  4134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "255c79c8e1d2427a89a06169979ae46f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af8d123902a47308f8c6f3754058bc1"
I20260709 13:11:17.983742  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d0b29d586f41dcb67ebfc3d8f7a9d1" candidate_uuid: "255c79c8e1d2427a89a06169979ae46f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e55fc244ca4f638af65aabbb096948"
I20260709 13:11:17.984205  4134 raft_consensus.cc:3055] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.984357  4282 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.984535  4134 raft_consensus.cc:740] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af8d123902a47308f8c6f3754058bc1, State: Running, Role: LEADER
I20260709 13:11:17.985500  4134 consensus_queue.cc:260] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:17.986492  4134 raft_consensus.cc:3060] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.989817  4282 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255c79c8e1d2427a89a06169979ae46f in term 2.
I20260709 13:11:17.990996  4174 leader_election.cc:304] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e55fc244ca4f638af65aabbb096948, 255c79c8e1d2427a89a06169979ae46f; no voters: 
I20260709 13:11:17.991914  4332 raft_consensus.cc:2804] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.992146  4134 raft_consensus.cc:2468] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255c79c8e1d2427a89a06169979ae46f in term 2.
I20260709 13:11:17.992972  4332 raft_consensus.cc:697] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 LEADER]: Becoming Leader. State: Replica: 255c79c8e1d2427a89a06169979ae46f, State: Running, Role: LEADER
I20260709 13:11:17.994189  4332 consensus_queue.cc:237] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } }
I20260709 13:11:18.000838  4029 catalog_manager.cc:5697] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f reported cstate change: term changed from 1 to 2, leader changed from 2af8d123902a47308f8c6f3754058bc1 (127.24.232.193) to 255c79c8e1d2427a89a06169979ae46f (127.24.232.194). New cstate: current_term: 2 leader_uuid: "255c79c8e1d2427a89a06169979ae46f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af8d123902a47308f8c6f3754058bc1" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 46587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.039860 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:11:18.045101  4358 consensus_queue.cc:1048] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e55fc244ca4f638af65aabbb096948" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.060264  4333 consensus_queue.cc:1048] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255c79c8e1d2427a89a06169979ae46f" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.090049 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:18.090873 25507 tablet_replica.cc:333] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1: stopping tablet replica
I20260709 13:11:18.091612 25507 raft_consensus.cc:2243] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:18.092595 25507 raft_consensus.cc:2272] T f87c040f5de946c39f7ee8181faad2ab P 2af8d123902a47308f8c6f3754058bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.095361 25507 tablet_replica.cc:333] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1: stopping tablet replica
I20260709 13:11:18.096020 25507 raft_consensus.cc:2243] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.096462 25507 raft_consensus.cc:2272] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.099309 25507 tablet_replica.cc:333] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: stopping tablet replica
I20260709 13:11:18.099944 25507 raft_consensus.cc:2243] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:18.100565 25507 pending_rounds.cc:70] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Trying to abort 1 pending ops.
I20260709 13:11:18.100741 25507 pending_rounds.cc:77] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636568791773184 op_type: NO_OP noop_request { }
I20260709 13:11:18.101066 25507 raft_consensus.cc:2889] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:18.101393 25507 raft_consensus.cc:2272] T 24c70a00b62c438b9fc590eca2b6f13e P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.104509 25507 tablet_replica.cc:333] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1: stopping tablet replica
I20260709 13:11:18.105038 25507 raft_consensus.cc:2243] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.105464 25507 raft_consensus.cc:2272] T c3f138f0d1c44e57889a7ce66084f038 P 2af8d123902a47308f8c6f3754058bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.131987 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
I20260709 13:11:18.149570 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
I20260709 13:11:18.172158 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:18.172884 25507 tablet_replica.cc:333] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f: stopping tablet replica
I20260709 13:11:18.173559 25507 raft_consensus.cc:2243] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.174041 25507 raft_consensus.cc:2272] T f87c040f5de946c39f7ee8181faad2ab P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.176870 25507 tablet_replica.cc:333] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: stopping tablet replica
I20260709 13:11:18.177454 25507 raft_consensus.cc:2243] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:18.178056 25507 pending_rounds.cc:70] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Trying to abort 1 pending ops.
I20260709 13:11:18.178241 25507 pending_rounds.cc:77] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636569072566272 op_type: NO_OP noop_request { }
I20260709 13:11:18.178519 25507 raft_consensus.cc:2889] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:18.178797 25507 raft_consensus.cc:2272] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.181473 25507 tablet_replica.cc:333] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f: stopping tablet replica
I20260709 13:11:18.182020 25507 raft_consensus.cc:2243] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.182466 25507 raft_consensus.cc:2272] T 24c70a00b62c438b9fc590eca2b6f13e P 255c79c8e1d2427a89a06169979ae46f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.185298 25507 tablet_replica.cc:333] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f: stopping tablet replica
I20260709 13:11:18.185803 25507 raft_consensus.cc:2243] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.186259 25507 raft_consensus.cc:2272] T c3f138f0d1c44e57889a7ce66084f038 P 255c79c8e1d2427a89a06169979ae46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.211184 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
I20260709 13:11:18.227254 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
I20260709 13:11:18.250662 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:18.251475 25507 tablet_replica.cc:333] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948: stopping tablet replica
I20260709 13:11:18.252272 25507 raft_consensus.cc:2243] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.252764 25507 raft_consensus.cc:2272] T f87c040f5de946c39f7ee8181faad2ab P 02e55fc244ca4f638af65aabbb096948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.255774 25507 tablet_replica.cc:333] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948: stopping tablet replica
I20260709 13:11:18.256394 25507 raft_consensus.cc:2243] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.256851 25507 raft_consensus.cc:2272] T 56d0b29d586f41dcb67ebfc3d8f7a9d1 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.259477 25507 tablet_replica.cc:333] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: stopping tablet replica
I20260709 13:11:18.260156 25507 raft_consensus.cc:2243] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:18.260874 25507 pending_rounds.cc:70] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Trying to abort 1 pending ops.
I20260709 13:11:18.261036 25507 pending_rounds.cc:77] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636568561758208 op_type: NO_OP noop_request { }
I20260709 13:11:18.261344 25507 raft_consensus.cc:2889] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:18.261631 25507 raft_consensus.cc:2272] T c3f138f0d1c44e57889a7ce66084f038 P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.264235 25507 tablet_replica.cc:333] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948: stopping tablet replica
I20260709 13:11:18.264724 25507 raft_consensus.cc:2243] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.265146 25507 raft_consensus.cc:2272] T 24c70a00b62c438b9fc590eca2b6f13e P 02e55fc244ca4f638af65aabbb096948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.289740 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:11:18.307296 25507 master.cc:562] Master@127.24.232.254:33351 shutting down...
I20260709 13:11:18.327586 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:18.328253 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.328610 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P d88a559fcfe649fbad511cf20c8043f2: stopping tablet replica
I20260709 13:11:18.347838 25507 master.cc:584] Master@127.24.232.254:33351 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1918 ms)
[----------] 6 tests from LeaderRebalancerTest (302189 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:11:18.386803 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:43935
I20260709 13:11:18.388046 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.393610  4374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.393669  4375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.395107  4377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.396108 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:18.397047 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.397274 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.397455 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602678397420 us; error 0 us; skew 500 ppm
I20260709 13:11:18.398062 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.400791 25507 webserver.cc:533] Webserver started at http://127.24.232.254:46097/ using document root <none> and password file <none>
I20260709 13:11:18.401329 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.401527 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.401820 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.403072 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "fc7711766c1346e4b9f7e16caad0ebbc"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.407603 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:18.411077  4382 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.411986 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:18.412236 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "fc7711766c1346e4b9f7e16caad0ebbc"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.412535 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.440478 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.441779 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.480321 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:43935
I20260709 13:11:18.480443  4433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:43935 every 8 connection(s)
I20260709 13:11:18.484236  4434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.496536  4434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: Bootstrap starting.
I20260709 13:11:18.501586  4434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.506364  4434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: No bootstrap required, opened a new log
I20260709 13:11:18.508708  4434 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER }
I20260709 13:11:18.509114  4434 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.509398  4434 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7711766c1346e4b9f7e16caad0ebbc, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.510082  4434 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER }
I20260709 13:11:18.510556  4434 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:18.510787  4434 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:18.511153  4434 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.516913  4434 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER }
I20260709 13:11:18.517509  4434 leader_election.cc:304] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc7711766c1346e4b9f7e16caad0ebbc; no voters: 
I20260709 13:11:18.518785  4434 leader_election.cc:290] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:18.519273  4437 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.520821  4437 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 1 LEADER]: Becoming Leader. State: Replica: fc7711766c1346e4b9f7e16caad0ebbc, State: Running, Role: LEADER
I20260709 13:11:18.521597  4437 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER }
I20260709 13:11:18.522042  4434 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:18.524775  4438 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER } }
I20260709 13:11:18.524876  4439 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc7711766c1346e4b9f7e16caad0ebbc. Latest consensus state: current_term: 1 leader_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc7711766c1346e4b9f7e16caad0ebbc" member_type: VOTER } }
I20260709 13:11:18.525687  4438 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:18.525827  4439 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:18.532053  4442 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:18.540629  4442 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:18.541689 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:18.550257  4442 catalog_manager.cc:1383] Generated new cluster ID: 5664c86cb7734a55b8a3c5c166bc313b
I20260709 13:11:18.550544  4442 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:18.568998  4442 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:18.570338  4442 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:18.581944  4442 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: Generated new TSK 0
I20260709 13:11:18.582551  4442 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:18.608314 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.615363  4455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.615760  4456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.620102  4458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.621627 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:18.622431 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.622623 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.622742 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602678622731 us; error 0 us; skew 500 ppm
I20260709 13:11:18.623275 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.625488 25507 webserver.cc:533] Webserver started at http://127.24.232.193:33813/ using document root <none> and password file <none>
I20260709 13:11:18.625944 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.626116 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.626319 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.627357 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.632512 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:11:18.635844  4463 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.636656 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:11:18.636955 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.637221 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.688113 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.689366 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.690857 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.693285 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.693464 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.693804 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.694002 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.735028 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:42047
I20260709 13:11:18.735131  4525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:42047 every 8 connection(s)
I20260709 13:11:18.740240 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.747768  4530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.749001  4531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.750823  4533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.753474 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:18.754585  4526 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43935
I20260709 13:11:18.754721 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:18.755010  4526 heartbeater.cc:461] Registering TS with master...
W20260709 13:11:18.755057 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.755384 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602678755367 us; error 0 us; skew 500 ppm
I20260709 13:11:18.756028 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.755962  4526 heartbeater.cc:507] Master 127.24.232.254:43935 requested a full tablet report, sending...
I20260709 13:11:18.758601  4399 ts_manager.cc:194] Registered new tserver with Master: aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047)
I20260709 13:11:18.758808 25507 webserver.cc:533] Webserver started at http://127.24.232.194:40677/ using document root <none> and password file <none>
I20260709 13:11:18.759510 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.759775 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.760118 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.761174  4399 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42302
I20260709 13:11:18.761864 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "2c59aff8a49f49d186871c198b8f78c4"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.766705 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:18.770001  4538 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.770877 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:18.771140 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "2c59aff8a49f49d186871c198b8f78c4"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.771370 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.783851 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.785019 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.786413 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.788686 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.788911 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.789183 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.789343 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.828833 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:46401
I20260709 13:11:18.828939  4600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:46401 every 8 connection(s)
I20260709 13:11:18.833657 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.842533  4605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.843286  4604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.845155  4607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.846099 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:18.846509  4601 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43935
I20260709 13:11:18.846992  4601 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.847132 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.847447 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.847635 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602678847617 us; error 0 us; skew 500 ppm
I20260709 13:11:18.847898  4601 heartbeater.cc:507] Master 127.24.232.254:43935 requested a full tablet report, sending...
I20260709 13:11:18.848348 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.850193  4399 ts_manager.cc:194] Registered new tserver with Master: 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:18.851264 25507 webserver.cc:533] Webserver started at http://127.24.232.195:36833/ using document root <none> and password file <none>
I20260709 13:11:18.851970 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.852221 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.852162  4399 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42306
I20260709 13:11:18.852773 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.854087 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "deeb07674eaa4feab81bc0ef25e9d011"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.858642 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:18.862146  4612 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.862922 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:18.863227 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "deeb07674eaa4feab81bc0ef25e9d011"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-sdg5"
I20260709 13:11:18.863516 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.901762 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.902964 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.904507 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.906788 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.907023 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.907272 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.907444 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.949019 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:44905
I20260709 13:11:18.949136  4674 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:44905 every 8 connection(s)
I20260709 13:11:18.963256  4675 heartbeater.cc:344] Connected to a master server at 127.24.232.254:43935
I20260709 13:11:18.963833  4675 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.964681  4675 heartbeater.cc:507] Master 127.24.232.254:43935 requested a full tablet report, sending...
I20260709 13:11:18.966753  4399 ts_manager.cc:194] Registered new tserver with Master: deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:18.967155 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014852672s
I20260709 13:11:18.968516  4399 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42318
I20260709 13:11:18.993014  4399 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42330:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:18.995846  4399 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:19.062387  4640 tablet_service.cc:1511] Processing CreateTablet for tablet fd332d6fac0543c48f4e006472d1c1c6 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:19.064323  4640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd332d6fac0543c48f4e006472d1c1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.063594  4638 tablet_service.cc:1511] Processing CreateTablet for tablet 1672c47e5b3042cabad8daab8db96f29 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:19.065662  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672c47e5b3042cabad8daab8db96f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.067039  4639 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc8615b2dd4fb59ef55a2434a97099 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:19.068758  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc8615b2dd4fb59ef55a2434a97099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.070416  4491 tablet_service.cc:1511] Processing CreateTablet for tablet fd332d6fac0543c48f4e006472d1c1c6 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:19.070950  4489 tablet_service.cc:1511] Processing CreateTablet for tablet 1672c47e5b3042cabad8daab8db96f29 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:19.071923  4491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd332d6fac0543c48f4e006472d1c1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.072647  4489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672c47e5b3042cabad8daab8db96f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.074229  4490 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc8615b2dd4fb59ef55a2434a97099 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:19.075991  4490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc8615b2dd4fb59ef55a2434a97099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.078831  4637 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e215e42284a6db68e5480b4d1d411 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:19.080348  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e215e42284a6db68e5480b4d1d411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.081166  4488 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e215e42284a6db68e5480b4d1d411 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:19.082638  4488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e215e42284a6db68e5480b4d1d411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.086366  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 9125fac1e8e74429bcc7d56bce6b5b85 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:19.087280  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 9125fac1e8e74429bcc7d56bce6b5b85 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:19.087754  4635 tablet_service.cc:1511] Processing CreateTablet for tablet 93243b50c3524508961e96966903ca9e (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:19.089915  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9125fac1e8e74429bcc7d56bce6b5b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.097261  4486 tablet_service.cc:1511] Processing CreateTablet for tablet 93243b50c3524508961e96966903ca9e (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:19.098801  4486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93243b50c3524508961e96966903ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.087914  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9125fac1e8e74429bcc7d56bce6b5b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.104177  4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93243b50c3524508961e96966903ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.118310  4690 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.121517  4485 tablet_service.cc:1511] Processing CreateTablet for tablet cfb2699d69884158b791c456dcb30611 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:19.123656  4485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb2699d69884158b791c456dcb30611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.129491  4690 tablet_bootstrap.cc:654] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.143196  4634 tablet_service.cc:1511] Processing CreateTablet for tablet cfb2699d69884158b791c456dcb30611 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:19.145038  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb2699d69884158b791c456dcb30611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.166999  4490 tablet_service.cc:1511] Processing CreateTablet for tablet 2da8c55c5900467785b5ab97700c09fb (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:19.169037  4490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da8c55c5900467785b5ab97700c09fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.186837  4637 tablet_service.cc:1511] Processing CreateTablet for tablet 2da8c55c5900467785b5ab97700c09fb (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:19.188331  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da8c55c5900467785b5ab97700c09fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.190934  4633 tablet_service.cc:1511] Processing CreateTablet for tablet be5e81a5e9de4be6a2e612f691f5c8c0 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:19.192809  4491 tablet_service.cc:1511] Processing CreateTablet for tablet be5e81a5e9de4be6a2e612f691f5c8c0 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:19.194191  4491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e81a5e9de4be6a2e612f691f5c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.196743  4690 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.198158  4690 ts_tablet_manager.cc:1403] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.027s
I20260709 13:11:19.201381  4690 raft_consensus.cc:359] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.202145  4690 raft_consensus.cc:385] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.202451  4690 raft_consensus.cc:740] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.203305  4690 consensus_queue.cc:260] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.204360  4633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e81a5e9de4be6a2e612f691f5c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.212853  4692 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.222123  4526 heartbeater.cc:499] Master 127.24.232.254:43935 was elected leader, sending a full tablet report...
I20260709 13:11:19.225113  4690 ts_tablet_manager.cc:1434] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.016s
I20260709 13:11:19.226166  4690 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.220819  4692 tablet_bootstrap.cc:654] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.232385  4566 tablet_service.cc:1511] Processing CreateTablet for tablet fd332d6fac0543c48f4e006472d1c1c6 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:19.232986  4564 tablet_service.cc:1511] Processing CreateTablet for tablet 1672c47e5b3042cabad8daab8db96f29 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:19.233978  4566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd332d6fac0543c48f4e006472d1c1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.234390  4692 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.234941  4692 ts_tablet_manager.cc:1403] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.022s	user 0.000s	sys 0.011s
I20260709 13:11:19.235263  4563 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e215e42284a6db68e5480b4d1d411 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:19.236795  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e215e42284a6db68e5480b4d1d411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.237772  4690 tablet_bootstrap.cc:654] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.238449  4692 raft_consensus.cc:359] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.239377  4692 raft_consensus.cc:385] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.239722  4692 raft_consensus.cc:740] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.239845  4562 tablet_service.cc:1511] Processing CreateTablet for tablet 9125fac1e8e74429bcc7d56bce6b5b85 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:19.241832  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9125fac1e8e74429bcc7d56bce6b5b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.242813  4561 tablet_service.cc:1511] Processing CreateTablet for tablet 93243b50c3524508961e96966903ca9e (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:19.244257  4561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93243b50c3524508961e96966903ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.246462  4560 tablet_service.cc:1511] Processing CreateTablet for tablet cfb2699d69884158b791c456dcb30611 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:19.247915  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb2699d69884158b791c456dcb30611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.240736  4692 consensus_queue.cc:260] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.252719  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672c47e5b3042cabad8daab8db96f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.252920  4565 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc8615b2dd4fb59ef55a2434a97099 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:19.256044  4565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc8615b2dd4fb59ef55a2434a97099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.253289  4559 tablet_service.cc:1511] Processing CreateTablet for tablet 2da8c55c5900467785b5ab97700c09fb (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:19.265708  4559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da8c55c5900467785b5ab97700c09fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.273818  4692 ts_tablet_manager.cc:1434] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.013s
I20260709 13:11:19.276193  4675 heartbeater.cc:499] Master 127.24.232.254:43935 was elected leader, sending a full tablet report...
I20260709 13:11:19.281395  4558 tablet_service.cc:1511] Processing CreateTablet for tablet be5e81a5e9de4be6a2e612f691f5c8c0 (DEFAULT_TABLE table=test-workload [id=1a50fa234f564567a0d056c09f86c0e7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:19.283437  4558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e81a5e9de4be6a2e612f691f5c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.275478  4692 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.303684  4690 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.312530  4690 ts_tablet_manager.cc:1403] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.018s
I20260709 13:11:19.315244  4690 raft_consensus.cc:359] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.315953  4690 raft_consensus.cc:385] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.316666  4690 raft_consensus.cc:740] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.320405  4690 consensus_queue.cc:260] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.322062  4692 tablet_bootstrap.cc:654] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.328862  4697 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.329789  4690 ts_tablet_manager.cc:1434] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:11:19.330920  4690 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.333743  4692 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.334329  4692 ts_tablet_manager.cc:1403] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.005s
I20260709 13:11:19.339175  4692 raft_consensus.cc:359] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.339964  4692 raft_consensus.cc:385] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.340253  4692 raft_consensus.cc:740] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.340654  4690 tablet_bootstrap.cc:654] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.341048  4692 consensus_queue.cc:260] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.343330  4692 ts_tablet_manager.cc:1434] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:19.344362  4692 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.349864  4697 tablet_bootstrap.cc:654] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.361981  4692 tablet_bootstrap.cc:654] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.367524  4697 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.368073  4697 ts_tablet_manager.cc:1403] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.016s
I20260709 13:11:19.368363  4690 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.368911  4690 ts_tablet_manager.cc:1403] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.002s
I20260709 13:11:19.369915  4692 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.370468  4692 ts_tablet_manager.cc:1403] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:11:19.370487  4697 raft_consensus.cc:359] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.371328  4697 raft_consensus.cc:385] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.371603  4697 raft_consensus.cc:740] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.372112  4690 raft_consensus.cc:359] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.372411  4697 consensus_queue.cc:260] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.372884  4690 raft_consensus.cc:385] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.373327  4690 raft_consensus.cc:740] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.373701  4692 raft_consensus.cc:359] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.374477  4692 raft_consensus.cc:385] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.374799  4692 raft_consensus.cc:740] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.374997  4601 heartbeater.cc:499] Master 127.24.232.254:43935 was elected leader, sending a full tablet report...
I20260709 13:11:19.375591  4697 ts_tablet_manager.cc:1434] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:19.375576  4692 consensus_queue.cc:260] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.376694  4697 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.377952  4692 ts_tablet_manager.cc:1434] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:19.378993  4692 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.382459  4697 tablet_bootstrap.cc:654] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.374225  4690 consensus_queue.cc:260] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.386032  4692 tablet_bootstrap.cc:654] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.390585  4690 ts_tablet_manager.cc:1434] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:11:19.391901  4690 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.399348  4693 raft_consensus.cc:493] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.399917  4693 raft_consensus.cc:515] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.405047  4690 tablet_bootstrap.cc:654] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.412321  4693 leader_election.cc:290] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.415485  4690 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.415843  4697 tablet_bootstrap.cc:492] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.416029  4692 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.416525  4690 ts_tablet_manager.cc:1403] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:11:19.416649  4692 ts_tablet_manager.cc:1403] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.014s
I20260709 13:11:19.420122  4697 ts_tablet_manager.cc:1403] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.026s
I20260709 13:11:19.420184  4692 raft_consensus.cc:359] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.421087  4692 raft_consensus.cc:385] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.420630  4690 raft_consensus.cc:359] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.421464  4692 raft_consensus.cc:740] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.421764  4690 raft_consensus.cc:385] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.422374  4690 raft_consensus.cc:740] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.422559  4692 consensus_queue.cc:260] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.423496  4690 consensus_queue.cc:260] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.423801  4697 raft_consensus.cc:359] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.424638  4697 raft_consensus.cc:385] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.425266  4697 raft_consensus.cc:740] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.426280  4690 ts_tablet_manager.cc:1434] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:11:19.426208  4697 consensus_queue.cc:260] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.427578  4690 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.430898  4697 ts_tablet_manager.cc:1434] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:11:19.432166  4697 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.434805  4692 ts_tablet_manager.cc:1434] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:11:19.435503  4690 tablet_bootstrap.cc:654] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.438992  4697 tablet_bootstrap.cc:654] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.441138  4692 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.452853  4692 tablet_bootstrap.cc:654] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.455309  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.456162  4697 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.456789  4697 ts_tablet_manager.cc:1403] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
W20260709 13:11:19.457299  4465 leader_election.cc:343] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.459736  4696 raft_consensus.cc:493] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.460124  4697 raft_consensus.cc:359] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.460608  4690 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.460319  4696 raft_consensus.cc:515] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.461344  4690 ts_tablet_manager.cc:1403] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.005s
I20260709 13:11:19.464809  4690 raft_consensus.cc:359] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.465606  4690 raft_consensus.cc:385] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.465911  4690 raft_consensus.cc:740] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.466125  4696 leader_election.cc:290] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:19.466709  4690 consensus_queue.cc:260] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.469753  4690 ts_tablet_manager.cc:1434] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:11:19.471083  4690 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.471810  4697 raft_consensus.cc:385] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.472363  4697 raft_consensus.cc:740] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.473654  4697 consensus_queue.cc:260] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.476266  4697 ts_tablet_manager.cc:1434] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:11:19.477552  4697 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.481993  4693 raft_consensus.cc:493] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.482648  4693 raft_consensus.cc:515] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.485575  4690 tablet_bootstrap.cc:654] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.485020  4693 leader_election.cc:290] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.489539  4696 raft_consensus.cc:493] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.491864  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.496819  4696 raft_consensus.cc:515] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
W20260709 13:11:19.497175  4465 leader_election.cc:343] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.498450  4690 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.499089  4696 leader_election.cc:290] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:19.499164  4690 ts_tablet_manager.cc:1403] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.002s
I20260709 13:11:19.494706  4697 tablet_bootstrap.cc:654] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.495257  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.490357  4702 raft_consensus.cc:493] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.500378  4650 raft_consensus.cc:2468] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.500521  4702 raft_consensus.cc:515] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.502669  4690 raft_consensus.cc:359] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.503469  4690 raft_consensus.cc:385] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.500537  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.503918  4690 raft_consensus.cc:740] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.504258  4464 leader_election.cc:304] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:19.504393  4649 raft_consensus.cc:2468] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.504742  4690 consensus_queue.cc:260] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.505399  4693 raft_consensus.cc:2804] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.505851  4693 raft_consensus.cc:493] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.506304  4693 raft_consensus.cc:3060] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.508561  4692 tablet_bootstrap.cc:492] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.509258  4692 ts_tablet_manager.cc:1403] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.017s
I20260709 13:11:19.503402  4702 leader_election.cc:290] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.513008  4692 raft_consensus.cc:359] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.513790  4692 raft_consensus.cc:385] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.514385  4692 raft_consensus.cc:740] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.515561  4692 consensus_queue.cc:260] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.515879  4464 leader_election.cc:304] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:19.520896  4692 ts_tablet_manager.cc:1434] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:19.522090  4692 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.522545  4693 raft_consensus.cc:515] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
W20260709 13:11:19.533301  4447 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:19.534653  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.535499  4649 raft_consensus.cc:3060] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.538565  4692 tablet_bootstrap.cc:654] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.544405  4718 raft_consensus.cc:2804] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.545089  4718 raft_consensus.cc:493] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.545528  4718 raft_consensus.cc:3060] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.551843  4693 leader_election.cc:290] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.558212  4718 raft_consensus.cc:515] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.579025  4649 raft_consensus.cc:2468] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.606774  4693 raft_consensus.cc:493] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.607647  4693 raft_consensus.cc:515] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.610680  4693 leader_election.cc:290] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.579488  4718 leader_election.cc:290] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.594640  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:19.595014  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.612733  4650 raft_consensus.cc:3060] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.614887  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.615911  4575 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:19.617875  4614 leader_election.cc:304] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.619098  4696 raft_consensus.cc:2804] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.619541  4696 raft_consensus.cc:493] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.619973  4696 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.623453  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.624534  4648 raft_consensus.cc:2468] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.624706  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.628144  4464 leader_election.cc:304] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
W20260709 13:11:19.629225  4614 leader_election.cc:343] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.629345  4718 raft_consensus.cc:2804] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.630300  4718 raft_consensus.cc:493] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.630829  4718 raft_consensus.cc:3060] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.635552  4696 raft_consensus.cc:515] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.639001  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:19.647426  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.647713  4696 leader_election.cc:290] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:19.641856  4690 ts_tablet_manager.cc:1434] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.142s	user 0.016s	sys 0.049s
I20260709 13:11:19.650038  4697 tablet_bootstrap.cc:492] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.640237  4692 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.650605  4697 ts_tablet_manager.cc:1403] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.173s	user 0.081s	sys 0.068s
I20260709 13:11:19.650866  4692 ts_tablet_manager.cc:1403] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.042s
I20260709 13:11:19.640229  4464 leader_election.cc:304] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.651961  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
W20260709 13:11:19.652909  4465 leader_election.cc:343] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.653208  4576 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.654204  4692 raft_consensus.cc:359] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.655001  4692 raft_consensus.cc:385] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.655290  4692 raft_consensus.cc:740] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.652308  4690 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.655748  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.656962  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.657675  4500 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:19.658756  4650 raft_consensus.cc:2468] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.659013  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:19.659833  4499 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.660235  4697 raft_consensus.cc:359] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.661005  4697 raft_consensus.cc:385] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.660742  4718 raft_consensus.cc:515] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.661322  4697 raft_consensus.cc:740] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.662158  4697 consensus_queue.cc:260] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.662950  4718 leader_election.cc:290] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.663341  4501 raft_consensus.cc:2393] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate deeb07674eaa4feab81bc0ef25e9d011 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:19.663558  4718 raft_consensus.cc:2804] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.664114  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.665069  4692 consensus_queue.cc:260] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
W20260709 13:11:19.665818  4539 leader_election.cc:343] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.662963  4702 raft_consensus.cc:493] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.666507  4702 raft_consensus.cc:515] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.668731  4702 leader_election.cc:290] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.668880  4692 ts_tablet_manager.cc:1434] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:11:19.670101  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.670936  4650 raft_consensus.cc:2468] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
I20260709 13:11:19.672224  4539 leader_election.cc:304] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.673290  4702 raft_consensus.cc:2804] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.673625  4702 raft_consensus.cc:493] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.673947  4702 raft_consensus.cc:3060] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.675191  4464 leader_election.cc:304] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.676282  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.677173  4650 raft_consensus.cc:3060] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.677630  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.678771  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.679510  4501 raft_consensus.cc:2468] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
W20260709 13:11:19.682752  4465 leader_election.cc:343] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.683068  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e215e42284a6db68e5480b4d1d411" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:19.675288  4693 raft_consensus.cc:493] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.683691  4575 raft_consensus.cc:3060] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.684029  4693 raft_consensus.cc:515] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.686973  4693 leader_election.cc:290] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.687085  4500 raft_consensus.cc:2468] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
I20260709 13:11:19.687758  4693 raft_consensus.cc:2804] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.688385  4693 raft_consensus.cc:697] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
W20260709 13:11:19.688882  4465 leader_election.cc:343] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.689525  4693 consensus_queue.cc:237] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.668732  4718 raft_consensus.cc:697] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:19.692703  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.696237  4690 tablet_bootstrap.cc:654] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.697386  4539 leader_election.cc:304] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:19.700392  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.701329  4649 raft_consensus.cc:2468] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.697706  4718 consensus_queue.cc:237] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.695544  4613 leader_election.cc:304] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:19.702622  4464 leader_election.cc:304] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.705632  4715 raft_consensus.cc:2804] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.706070  4715 raft_consensus.cc:493] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.706462  4715 raft_consensus.cc:3060] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.703809  4576 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:19.712551  4692 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.713405  4614 leader_election.cc:304] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.694844  4575 raft_consensus.cc:2468] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.704110  4499 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:19.701905  4702 raft_consensus.cc:515] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.716868  4574 raft_consensus.cc:2393] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa25b94a1ae64a47b4b3689b37ba28b6 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:19.717851  4702 leader_election.cc:290] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.718466  4702 raft_consensus.cc:2804] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.718830  4702 raft_consensus.cc:493] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.719161  4702 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.719992  4465 leader_election.cc:304] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:19.715231  4715 raft_consensus.cc:515] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.723470  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:19.724776  4499 raft_consensus.cc:2393] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c59aff8a49f49d186871c198b8f78c4 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:19.725191  4715 leader_election.cc:290] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.725850  4715 raft_consensus.cc:2804] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.726369  4715 raft_consensus.cc:697] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:19.727298  4715 consensus_queue.cc:237] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.730111  4692 tablet_bootstrap.cc:654] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.724676  4690 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.737900  4690 ts_tablet_manager.cc:1403] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.009s
I20260709 13:11:19.744555  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:19.745535  4574 raft_consensus.cc:2393] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa25b94a1ae64a47b4b3689b37ba28b6 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:19.739416  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.749781  4697 ts_tablet_manager.cc:1434] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.099s	user 0.035s	sys 0.047s
I20260709 13:11:19.750726  4650 raft_consensus.cc:2468] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.751037  4697 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.751495  4696 raft_consensus.cc:2749] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.755029  4696 raft_consensus.cc:2804] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.755648  4696 raft_consensus.cc:697] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:19.756793  4696 consensus_queue.cc:237] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:19.757643  4396 catalog_manager.cc:5697] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.759446  4697 tablet_bootstrap.cc:654] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.747944  4649 raft_consensus.cc:3060] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:19.761897  4614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:46401, user_credentials={real_user=slave}} blocked reactor thread for 48634.6us
I20260709 13:11:19.764950  4690 raft_consensus.cc:359] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.765882  4690 raft_consensus.cc:385] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.766295  4690 raft_consensus.cc:740] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.768836  4702 raft_consensus.cc:515] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.767316  4690 consensus_queue.cc:260] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.774530  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:19.775206  4499 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.776682  4690 ts_tablet_manager.cc:1434] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:11:19.777614  4649 raft_consensus.cc:2468] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:19.778805  4690 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.780349  4702 leader_election.cc:290] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.777390  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9125fac1e8e74429bcc7d56bce6b5b85" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.781255  4650 raft_consensus.cc:2393] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa25b94a1ae64a47b4b3689b37ba28b6 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:19.781416  4697 tablet_bootstrap.cc:492] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.781946  4697 ts_tablet_manager.cc:1403] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:11:19.782598  4464 leader_election.cc:304] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:19.784288  4715 raft_consensus.cc:2749] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.785861  4692 tablet_bootstrap.cc:492] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.778828  4539 leader_election.cc:304] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:19.785295  4697 raft_consensus.cc:359] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.786450  4697 raft_consensus.cc:385] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.786543  4692 ts_tablet_manager.cc:1403] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.021s
I20260709 13:11:19.786792  4697 raft_consensus.cc:740] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.787647  4697 consensus_queue.cc:260] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.788803  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.788923  4721 raft_consensus.cc:2804] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:19.790390  4539 leader_election.cc:343] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.791365  4721 raft_consensus.cc:697] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:19.792354  4721 consensus_queue.cc:237] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.795506  4499 raft_consensus.cc:2468] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:19.798731  4539 leader_election.cc:304] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:19.798934  4692 raft_consensus.cc:359] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.797423  4697 ts_tablet_manager.cc:1434] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:11:19.801262  4697 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.795243  4397 catalog_manager.cc:5697] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 0 to 1, leader changed from <none> to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.806087  4702 raft_consensus.cc:2804] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.806890  4702 raft_consensus.cc:697] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:19.808136  4702 consensus_queue.cc:237] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.809747  4690 tablet_bootstrap.cc:654] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.811780  4692 raft_consensus.cc:385] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.812163  4692 raft_consensus.cc:740] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.819088  4697 tablet_bootstrap.cc:654] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.814133  4692 consensus_queue.cc:260] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.824591  4692 ts_tablet_manager.cc:1434] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:11:19.825716  4692 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.831508  4692 tablet_bootstrap.cc:654] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.834586  4697 tablet_bootstrap.cc:492] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.835165  4697 ts_tablet_manager.cc:1403] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 13:11:19.841522  4697 raft_consensus.cc:359] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.842316  4697 raft_consensus.cc:385] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.842617  4697 raft_consensus.cc:740] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.843427  4697 consensus_queue.cc:260] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.846165  4697 ts_tablet_manager.cc:1434] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:19.847265  4697 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.849831  4396 catalog_manager.cc:5697] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.851871  4396 catalog_manager.cc:5697] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.855336  4697 tablet_bootstrap.cc:654] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.862957  4690 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.863485  4690 ts_tablet_manager.cc:1403] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.025s
I20260709 13:11:19.865325  4399 catalog_manager.cc:5697] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.866323  4690 raft_consensus.cc:359] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.867129  4690 raft_consensus.cc:385] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.867426  4690 raft_consensus.cc:740] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.872614  4692 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.872653  4697 tablet_bootstrap.cc:492] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.873422  4692 ts_tablet_manager.cc:1403] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.018s
I20260709 13:11:19.873477  4697 ts_tablet_manager.cc:1403] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.008s
I20260709 13:11:19.876667  4692 raft_consensus.cc:359] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.876919  4697 raft_consensus.cc:359] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.877439  4692 raft_consensus.cc:385] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.877684  4697 raft_consensus.cc:385] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.877753  4692 raft_consensus.cc:740] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.876961  4690 consensus_queue.cc:260] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.878059  4697 raft_consensus.cc:740] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.878610  4692 consensus_queue.cc:260] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.879184  4697 consensus_queue.cc:260] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.880482  4690 ts_tablet_manager.cc:1434] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:11:19.880740  4692 ts_tablet_manager.cc:1434] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:19.881626  4690 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:19.882498  4697 ts_tablet_manager.cc:1434] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:19.883574  4697 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.884482  4399 catalog_manager.cc:5697] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.889109  4690 tablet_bootstrap.cc:654] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.889334  4721 raft_consensus.cc:493] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.890283  4697 tablet_bootstrap.cc:654] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.890622  4692 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:19.889906  4721 raft_consensus.cc:515] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.893601  4721 leader_election.cc:290] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.896761  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.898747  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672c47e5b3042cabad8daab8db96f29" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.901201  4650 raft_consensus.cc:2393] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c59aff8a49f49d186871c198b8f78c4 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:19.901726  4692 tablet_bootstrap.cc:654] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.902945  4539 leader_election.cc:304] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4; no voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:19.907218  4721 raft_consensus.cc:3060] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.909468  4690 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:19.910356  4690 ts_tablet_manager.cc:1403] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 13:11:19.913326  4697 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.913921  4697 ts_tablet_manager.cc:1403] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.003s
I20260709 13:11:19.913774  4690 raft_consensus.cc:359] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.914209  4692 tablet_bootstrap.cc:492] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:19.915264  4692 ts_tablet_manager.cc:1403] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.001s
I20260709 13:11:19.917153  4697 raft_consensus.cc:359] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.917886  4697 raft_consensus.cc:385] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.918148  4697 raft_consensus.cc:740] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.914700  4690 raft_consensus.cc:385] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.919399  4690 raft_consensus.cc:740] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.918387  4692 raft_consensus.cc:359] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.918444  4721 raft_consensus.cc:2749] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.919870  4692 raft_consensus.cc:385] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.918932  4697 consensus_queue.cc:260] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.920264  4715 raft_consensus.cc:493] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.920756  4715 raft_consensus.cc:515] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.922084  4697 ts_tablet_manager.cc:1434] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:19.923072  4697 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:19.924888  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.925566  4650 raft_consensus.cc:2468] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.920266  4692 raft_consensus.cc:740] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.926848  4464 leader_election.cc:304] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:19.927496  4692 consensus_queue.cc:260] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.927524  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:19.928748  4574 raft_consensus.cc:2468] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:19.927726  4718 raft_consensus.cc:2804] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.929553  4718 raft_consensus.cc:493] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.929623  4692 ts_tablet_manager.cc:1434] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:11:19.929926  4718 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.930178  4697 tablet_bootstrap.cc:654] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.922955  4715 leader_election.cc:290] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.935781  4690 consensus_queue.cc:260] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.936586  4721 raft_consensus.cc:493] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.937117  4721 raft_consensus.cc:515] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.938556  4690 ts_tablet_manager.cc:1434] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:19.939167  4721 leader_election.cc:290] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.941375  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:19.943078  4718 raft_consensus.cc:515] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.943804  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc8615b2dd4fb59ef55a2434a97099" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:19.944579  4650 raft_consensus.cc:2393] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c59aff8a49f49d186871c198b8f78c4 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:19.945793  4539 leader_election.cc:304] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4; no voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:19.947402  4721 raft_consensus.cc:3060] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.947510  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:19.948304  4574 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.951699  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:19.947502  4718 leader_election.cc:290] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:19.952577  4650 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.955693  4697 tablet_bootstrap.cc:492] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:19.956257  4697 ts_tablet_manager.cc:1403] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.008s
I20260709 13:11:19.956207  4574 raft_consensus.cc:2468] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.957599  4465 leader_election.cc:304] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:19.958494  4718 raft_consensus.cc:2804] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.959744  4718 raft_consensus.cc:697] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:19.960602  4718 consensus_queue.cc:237] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.960738  4650 raft_consensus.cc:2468] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:19.959957  4697 raft_consensus.cc:359] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.962224  4697 raft_consensus.cc:385] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.962581  4697 raft_consensus.cc:740] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.963320  4697 consensus_queue.cc:260] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:19.965696  4721 raft_consensus.cc:2749] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.965826  4697 ts_tablet_manager.cc:1434] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:19.972070  4396 catalog_manager.cc:5697] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.092232  4718 raft_consensus.cc:493] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.092701  4718 raft_consensus.cc:515] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.094511  4718 leader_election.cc:290] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.095554  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:20.095770  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:20.096261  4574 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:20.096516  4650 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:20.097527  4465 leader_election.cc:304] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:20.098346  4718 raft_consensus.cc:2804] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.098650  4718 raft_consensus.cc:493] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.098893  4718 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.105063  4718 raft_consensus.cc:515] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.107069  4718 leader_election.cc:290] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.108150  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:20.108326  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:20.108883  4574 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.108970  4649 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.111937  4718 consensus_queue.cc:1048] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.115161  4649 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:20.116168  4574 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:20.116343  4464 leader_election.cc:304] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:20.117377  4718 raft_consensus.cc:2804] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.117844  4718 raft_consensus.cc:697] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.118703  4718 consensus_queue.cc:237] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.121073  4715 consensus_queue.cc:1048] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.130465  4396 catalog_manager.cc:5697] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.136543  4718 consensus_queue.cc:1048] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.154059  4726 consensus_queue.cc:1048] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.167044  4726 raft_consensus.cc:493] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.167558  4726 raft_consensus.cc:515] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.169940  4726 leader_election.cc:290] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.170732  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:20.171088  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:20.171475  4574 raft_consensus.cc:2468] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:20.171775  4650 raft_consensus.cc:2468] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:20.172673  4465 leader_election.cc:304] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:20.173585  4726 raft_consensus.cc:2804] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.173995  4726 raft_consensus.cc:493] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.174434  4726 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.179749  4696 raft_consensus.cc:493] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.180334  4696 raft_consensus.cc:515] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.180711  4726 raft_consensus.cc:515] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.182596  4696 leader_election.cc:290] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:20.183329  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:20.183329  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:20.183491  4726 leader_election.cc:290] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.184302  4574 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.184548  4499 raft_consensus.cc:2393] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate deeb07674eaa4feab81bc0ef25e9d011 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:20.184443  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:20.185105  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:20.185667  4650 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.186400  4614 leader_election.cc:304] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:20.187286  4696 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.191130  4574 raft_consensus.cc:2468] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:20.192340  4465 leader_election.cc:304] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:20.193051  4726 raft_consensus.cc:2804] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.193493  4726 raft_consensus.cc:697] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.194134  4650 raft_consensus.cc:2468] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:20.194238  4726 consensus_queue.cc:237] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.195998  4696 raft_consensus.cc:2749] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.201128  4721 consensus_queue.cc:1048] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.202786  4396 catalog_manager.cc:5697] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.215505  4732 consensus_queue.cc:1048] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.258674  4726 consensus_queue.cc:1048] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.270668  4715 consensus_queue.cc:1048] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.271130  4650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
mode: GRACEFUL
new_leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
 from {username='slave'} at 127.0.0.1:56204
I20260709 13:11:20.271931  4650 raft_consensus.cc:606] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Received request to transfer leadership to TS aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:20.300205  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93243b50c3524508961e96966903ca9e"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
mode: GRACEFUL
new_leader_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:36790
I20260709 13:11:20.300838  4499 raft_consensus.cc:606] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Received request to transfer leadership to TS 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:20.304126  4732 consensus_queue.cc:1048] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.309768  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
mode: GRACEFUL
new_leader_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:36790
I20260709 13:11:20.310423  4499 raft_consensus.cc:606] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Received request to transfer leadership to TS 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:20.316802  4721 consensus_queue.cc:1048] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.321056  4500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:36790
I20260709 13:11:20.321707  4500 raft_consensus.cc:606] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:20.354919  4696 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.362936  4766 raft_consensus.cc:993] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: : Instructing follower aa25b94a1ae64a47b4b3689b37ba28b6 to start an election
I20260709 13:11:20.363559  4696 raft_consensus.cc:1081] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Signalling peer aa25b94a1ae64a47b4b3689b37ba28b6 to start an election
I20260709 13:11:20.365859  4500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
 from {username='slave'} at 127.0.0.1:36770
I20260709 13:11:20.366484  4500 raft_consensus.cc:493] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.366923  4500 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.369060  4696 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.375126  4500 raft_consensus.cc:515] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:20.379596  4500 leader_election.cc:290] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 2 election: Requested vote from peers deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:20.380362  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:20.381027  4650 raft_consensus.cc:3055] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:20.381111  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:20.381419  4650 raft_consensus.cc:740] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:20.382319  4650 consensus_queue.cc:260] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:20.383548  4650 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.389959  4650 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 2.
I20260709 13:11:20.390966  4464 leader_election.cc:304] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:20.391741  4693 raft_consensus.cc:2804] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.392141  4693 raft_consensus.cc:697] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.392841  4693 consensus_queue.cc:237] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:20.398706  4399 catalog_manager.cc:5697] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 1 to 2, leader changed from deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195) to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.433156  4693 consensus_queue.cc:1048] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.439348  4715 raft_consensus.cc:993] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: : Instructing follower 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:20.440006  4718 raft_consensus.cc:1081] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Signalling peer 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:20.441834  4575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93243b50c3524508961e96966903ca9e"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:37618
I20260709 13:11:20.442440  4575 raft_consensus.cc:493] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.442842  4575 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.446465  4718 consensus_queue.cc:1048] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.449667  4575 raft_consensus.cc:515] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.451901  4575 leader_election.cc:290] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.452965  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:20.453701  4500 raft_consensus.cc:3055] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:20.454028  4500 raft_consensus.cc:740] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.454842  4500 consensus_queue.cc:260] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.455731  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93243b50c3524508961e96966903ca9e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:20.456001  4500 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.462402  4500 raft_consensus.cc:2468] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:20.463410  4539 leader_election.cc:304] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:20.464198  4702 raft_consensus.cc:2804] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.464644  4702 raft_consensus.cc:697] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:20.465449  4702 consensus_queue.cc:237] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.472102  4399 catalog_manager.cc:5697] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 1 to 2, leader changed from aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193) to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.547523  4718 consensus_queue.cc:1048] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.558367  4693 consensus_queue.cc:1048] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.566448  4726 raft_consensus.cc:993] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:20.566989  4693 raft_consensus.cc:1081] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:20.568533  4650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56180
I20260709 13:11:20.569185  4650 raft_consensus.cc:493] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.569556  4650 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.574749  4650 raft_consensus.cc:515] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.576452  4650 leader_election.cc:290] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:20.577458  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:20.577736  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e81a5e9de4be6a2e612f691f5c8c0" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:20.578138  4575 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.578397  4500 raft_consensus.cc:3055] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:20.578780  4500 raft_consensus.cc:740] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.579598  4500 consensus_queue.cc:260] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.580974  4500 raft_consensus.cc:3060] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.583570  4693 consensus_queue.cc:1048] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.584715  4575 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:20.585915  4614 leader_election.cc:304] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:20.586591  4767 raft_consensus.cc:2804] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.587061  4767 raft_consensus.cc:697] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:20.588297  4500 raft_consensus.cc:2468] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:20.587913  4767 consensus_queue.cc:237] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.592713  4726 raft_consensus.cc:993] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: : Instructing follower 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:20.593182  4718 raft_consensus.cc:1081] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Signalling peer 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:20.595321  4575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:37618
I20260709 13:11:20.595934  4575 raft_consensus.cc:493] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.596333  4575 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.600754  4397 catalog_manager.cc:5697] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 1 to 2, leader changed from aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.603426  4693 consensus_queue.cc:1048] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.604744  4575 raft_consensus.cc:515] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.605674  4574 raft_consensus.cc:1240] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Rejecting Update request from peer aa25b94a1ae64a47b4b3689b37ba28b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:20.608193  4575 leader_election.cc:290] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:20.608409  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:20.610819  4693 consensus_queue.cc:1059] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.611600  4718 raft_consensus.cc:3055] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:20.611994  4718 raft_consensus.cc:740] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:20.608322  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da8c55c5900467785b5ab97700c09fb" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:20.612888  4718 consensus_queue.cc:260] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.614369  4718 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.627566  4500 raft_consensus.cc:2468] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:20.629148  4539 leader_election.cc:304] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:20.629822  4702 raft_consensus.cc:2804] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.630271  4702 raft_consensus.cc:697] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:20.631071  4702 consensus_queue.cc:237] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:20.637454  4397 catalog_manager.cc:5697] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 1 to 2, leader changed from aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193) to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.877799  4649 raft_consensus.cc:3060] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.881192  4650 raft_consensus.cc:1275] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer aa25b94a1ae64a47b4b3689b37ba28b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.882620  4693 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:20.884686  4649 raft_consensus.cc:1275] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.886029  4702 consensus_queue.cc:1048] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:20.891151  4574 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.896440  4500 raft_consensus.cc:1275] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.902820  4775 consensus_queue.cc:1048] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:20.904357  4574 raft_consensus.cc:1275] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer aa25b94a1ae64a47b4b3689b37ba28b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.907517  4718 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.043992  4649 raft_consensus.cc:3060] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.049340  4649 raft_consensus.cc:1275] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.050678  4775 consensus_queue.cc:1048] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.059813  4500 raft_consensus.cc:1275] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.061535  4702 consensus_queue.cc:1048] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.090284  4500 raft_consensus.cc:1275] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.091557  4767 consensus_queue.cc:1048] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.100603  4574 raft_consensus.cc:1275] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.102080  4776 consensus_queue.cc:1048] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:23.349723  4397 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42346:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:23.351863  4397 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:23.403025  4491 tablet_service.cc:1511] Processing CreateTablet for tablet 3698976fc7254c4f9fb4dc19fa0f430b (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.404217  4491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3698976fc7254c4f9fb4dc19fa0f430b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.405303  4558 tablet_service.cc:1511] Processing CreateTablet for tablet 3698976fc7254c4f9fb4dc19fa0f430b (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.406605  4558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3698976fc7254c4f9fb4dc19fa0f430b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.407655  4489 tablet_service.cc:1511] Processing CreateTablet for tablet c74108dde8fe4edfb617a654fdde96a2 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.409058  4489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74108dde8fe4edfb617a654fdde96a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.414143  4637 tablet_service.cc:1511] Processing CreateTablet for tablet c74108dde8fe4edfb617a654fdde96a2 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.405171  4633 tablet_service.cc:1511] Processing CreateTablet for tablet 3698976fc7254c4f9fb4dc19fa0f430b (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.415524  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74108dde8fe4edfb617a654fdde96a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.417538  4559 tablet_service.cc:1511] Processing CreateTablet for tablet c74108dde8fe4edfb617a654fdde96a2 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.418784  4559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74108dde8fe4edfb617a654fdde96a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.420069  4633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3698976fc7254c4f9fb4dc19fa0f430b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.421675  4490 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4475da69d54814850dc409f20caf31 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.422989  4490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4475da69d54814850dc409f20caf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.423477  4564 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4475da69d54814850dc409f20caf31 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.424744  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4475da69d54814850dc409f20caf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.428424  4565 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6c7e4b31624b1fa56109710c8f3d2f (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.428452  4634 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4475da69d54814850dc409f20caf31 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.428890  4486 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6c7e4b31624b1fa56109710c8f3d2f (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.429868  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4475da69d54814850dc409f20caf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.430181  4486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6c7e4b31624b1fa56109710c8f3d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.429868  4565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6c7e4b31624b1fa56109710c8f3d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.435341  4635 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6c7e4b31624b1fa56109710c8f3d2f (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.436628  4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6c7e4b31624b1fa56109710c8f3d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.436528  4485 tablet_service.cc:1511] Processing CreateTablet for tablet e97386bdb1ac426d8c324814f935e19e (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.437851  4485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97386bdb1ac426d8c324814f935e19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.440209  4561 tablet_service.cc:1511] Processing CreateTablet for tablet e97386bdb1ac426d8c324814f935e19e (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.441455  4561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97386bdb1ac426d8c324814f935e19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.441901  4638 tablet_service.cc:1511] Processing CreateTablet for tablet e97386bdb1ac426d8c324814f935e19e (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.442318  4563 tablet_service.cc:1511] Processing CreateTablet for tablet 26338f92004141f58fff27847edb9ffd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.443132  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97386bdb1ac426d8c324814f935e19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.443607  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26338f92004141f58fff27847edb9ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.447506  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 26338f92004141f58fff27847edb9ffd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.448801  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26338f92004141f58fff27847edb9ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.458452  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 26338f92004141f58fff27847edb9ffd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.459841  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26338f92004141f58fff27847edb9ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.465947  4488 tablet_service.cc:1511] Processing CreateTablet for tablet eaf4e73fe9a2440fa6eb02e9878535fd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.467290  4488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf4e73fe9a2440fa6eb02e9878535fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.460896  4562 tablet_service.cc:1511] Processing CreateTablet for tablet eaf4e73fe9a2440fa6eb02e9878535fd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.468675  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf4e73fe9a2440fa6eb02e9878535fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.470016  4484 tablet_service.cc:1511] Processing CreateTablet for tablet f146cdeb2fb543d3adfb5a02f04bc048 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.470445  4639 tablet_service.cc:1511] Processing CreateTablet for tablet eaf4e73fe9a2440fa6eb02e9878535fd (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.471006  4566 tablet_service.cc:1511] Processing CreateTablet for tablet f146cdeb2fb543d3adfb5a02f04bc048 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.471493  4484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146cdeb2fb543d3adfb5a02f04bc048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.471771  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf4e73fe9a2440fa6eb02e9878535fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.472293  4566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146cdeb2fb543d3adfb5a02f04bc048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.532739  4792 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.544727  4793 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.558887  4793 tablet_bootstrap.cc:654] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.560413  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba384fb8d94286b65b2f54d707e4ac (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.561905  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba384fb8d94286b65b2f54d707e4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.566704  4560 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba384fb8d94286b65b2f54d707e4ac (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.568041  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba384fb8d94286b65b2f54d707e4ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:23.572350  4447 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:23.565162  4638 tablet_service.cc:1511] Processing CreateTablet for tablet f146cdeb2fb543d3adfb5a02f04bc048 (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.583842  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f146cdeb2fb543d3adfb5a02f04bc048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.590062  4792 tablet_bootstrap.cc:654] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.604648  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba384fb8d94286b65b2f54d707e4ac (DEFAULT_TABLE table=soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.606046  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba384fb8d94286b65b2f54d707e4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.615653  4793 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.616328  4793 ts_tablet_manager.cc:1403] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.010s
I20260709 13:11:23.621259  4794 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.622524  4793 raft_consensus.cc:359] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.628042  4793 raft_consensus.cc:385] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.628438  4793 raft_consensus.cc:740] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.629271  4793 consensus_queue.cc:260] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.631860  4793 ts_tablet_manager.cc:1434] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:23.633644  4793 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.634986  4794 tablet_bootstrap.cc:654] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.624485  4792 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:23.636264  4792 ts_tablet_manager.cc:1403] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.000s
I20260709 13:11:23.640009  4792 raft_consensus.cc:359] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.640733  4792 raft_consensus.cc:385] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.641116  4792 raft_consensus.cc:740] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.641646  4793 tablet_bootstrap.cc:654] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.641955  4792 consensus_queue.cc:260] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.644639  4792 ts_tablet_manager.cc:1434] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:11:23.647809  4794 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.648237  4793 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.648422  4794 ts_tablet_manager.cc:1403] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.005s
I20260709 13:11:23.648818  4793 ts_tablet_manager.cc:1403] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:11:23.651845  4794 raft_consensus.cc:359] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.652691  4794 raft_consensus.cc:385] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.652685  4793 raft_consensus.cc:359] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.653273  4794 raft_consensus.cc:740] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.653568  4793 raft_consensus.cc:385] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.653935  4793 raft_consensus.cc:740] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.654233  4794 consensus_queue.cc:260] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.654726  4793 consensus_queue.cc:260] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.653208  4792 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.657150  4793 ts_tablet_manager.cc:1434] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:23.658255  4793 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.664091  4794 ts_tablet_manager.cc:1434] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:23.664813  4793 tablet_bootstrap.cc:654] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.665346  4794 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.668752  4792 tablet_bootstrap.cc:654] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.674577  4794 tablet_bootstrap.cc:654] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.675402  4792 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:23.676440  4792 ts_tablet_manager.cc:1403] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.008s
I20260709 13:11:23.677126  4793 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.677578  4793 ts_tablet_manager.cc:1403] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 13:11:23.680047  4792 raft_consensus.cc:359] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.680860  4792 raft_consensus.cc:385] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.681468  4792 raft_consensus.cc:740] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.681777  4794 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.680835  4793 raft_consensus.cc:359] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.682370  4794 ts_tablet_manager.cc:1403] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:11:23.682561  4793 raft_consensus.cc:385] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.682353  4792 consensus_queue.cc:260] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.683180  4793 raft_consensus.cc:740] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.684101  4793 consensus_queue.cc:260] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.684993  4792 ts_tablet_manager.cc:1434] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:11:23.686239  4792 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.686118  4794 raft_consensus.cc:359] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.686962  4794 raft_consensus.cc:385] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.687299  4794 raft_consensus.cc:740] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.688078  4794 consensus_queue.cc:260] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.693876  4793 ts_tablet_manager.cc:1434] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:11:23.697922  4792 tablet_bootstrap.cc:654] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.694960  4793 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.707135  4794 ts_tablet_manager.cc:1434] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:11:23.708336  4794 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.709975  4793 tablet_bootstrap.cc:654] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.715142  4794 tablet_bootstrap.cc:654] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.720311  4794 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.720853  4794 ts_tablet_manager.cc:1403] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:11:23.721709  4792 tablet_bootstrap.cc:492] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:23.722256  4792 ts_tablet_manager.cc:1403] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.014s
I20260709 13:11:23.723371  4793 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.724020  4793 ts_tablet_manager.cc:1403] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.001s
I20260709 13:11:23.725533  4792 raft_consensus.cc:359] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.726459  4792 raft_consensus.cc:385] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.726811  4792 raft_consensus.cc:740] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.726687  4794 raft_consensus.cc:359] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.727579  4794 raft_consensus.cc:385] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.727927  4794 raft_consensus.cc:740] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.727157  4793 raft_consensus.cc:359] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.727855  4792 consensus_queue.cc:260] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.728638  4793 raft_consensus.cc:385] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.728986  4793 raft_consensus.cc:740] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.728888  4794 consensus_queue.cc:260] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.730124  4793 consensus_queue.cc:260] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.730793  4792 ts_tablet_manager.cc:1434] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:11:23.731356  4794 ts_tablet_manager.cc:1434] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:23.731868  4792 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.732474  4794 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.738952  4794 tablet_bootstrap.cc:654] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.739564  4793 ts_tablet_manager.cc:1434] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:23.740675  4793 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.742746  4792 tablet_bootstrap.cc:654] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.759562  4794 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.760156  4794 ts_tablet_manager.cc:1403] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.018s
I20260709 13:11:23.763216  4794 raft_consensus.cc:359] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.764146  4794 raft_consensus.cc:385] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.764539  4794 raft_consensus.cc:740] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.765573  4794 consensus_queue.cc:260] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.767978  4794 ts_tablet_manager.cc:1434] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:11:23.769093  4794 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.769755  4793 tablet_bootstrap.cc:654] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.775367  4792 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:23.775877  4794 tablet_bootstrap.cc:654] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.775938  4792 ts_tablet_manager.cc:1403] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.011s
I20260709 13:11:23.780885  4792 raft_consensus.cc:359] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.782318  4792 raft_consensus.cc:385] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.782719  4792 raft_consensus.cc:740] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.783681  4792 consensus_queue.cc:260] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.786731  4792 ts_tablet_manager.cc:1434] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:11:23.787488  4794 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.788062  4794 ts_tablet_manager.cc:1403] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:11:23.788142  4792 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.791235  4794 raft_consensus.cc:359] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.792011  4794 raft_consensus.cc:385] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.791432  4779 raft_consensus.cc:493] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.792343  4794 raft_consensus.cc:740] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.792714  4779 raft_consensus.cc:515] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.793150  4794 consensus_queue.cc:260] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.793569  4802 raft_consensus.cc:493] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.794189  4802 raft_consensus.cc:515] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.794934  4779 leader_election.cc:290] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:23.796422  4802 leader_election.cc:290] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.796891  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:23.797569  4500 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:23.797755  4792 tablet_bootstrap.cc:654] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.798702  4794 ts_tablet_manager.cc:1434] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:23.799491  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:23.799795  4794 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.800176  4574 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:23.802397  4613 leader_election.cc:304] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:23.804598  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97386bdb1ac426d8c324814f935e19e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:23.804725  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97386bdb1ac426d8c324814f935e19e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:23.805346  4649 raft_consensus.cc:2468] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
I20260709 13:11:23.806710  4539 leader_election.cc:304] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:23.807058  4794 tablet_bootstrap.cc:654] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:23.807911  4539 leader_election.cc:343] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.808849  4702 raft_consensus.cc:2804] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.809309  4702 raft_consensus.cc:493] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.809641  4702 raft_consensus.cc:3060] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.810678  4792 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:23.811264  4792 ts_tablet_manager.cc:1403] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:11:23.813549  4793 tablet_bootstrap.cc:492] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.814107  4793 ts_tablet_manager.cc:1403] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.011s
I20260709 13:11:23.814855  4779 raft_consensus.cc:2804] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.815441  4779 raft_consensus.cc:493] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.815907  4779 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.820806  4702 raft_consensus.cc:515] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.821962  4793 raft_consensus.cc:359] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.822721  4793 raft_consensus.cc:385] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.824398  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97386bdb1ac426d8c324814f935e19e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:23.814929  4792 raft_consensus.cc:359] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.823783  4702 leader_election.cc:290] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.823009  4793 raft_consensus.cc:740] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.825464  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97386bdb1ac426d8c324814f935e19e" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:23.826318  4649 raft_consensus.cc:3060] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.827996  4792 raft_consensus.cc:385] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.828377  4792 raft_consensus.cc:740] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.828531  4779 raft_consensus.cc:515] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.829231  4792 consensus_queue.cc:260] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.833446  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:23.834339  4499 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.836716  4649 raft_consensus.cc:2468] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:23.826304  4793 consensus_queue.cc:260] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.839529  4500 raft_consensus.cc:3060] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.840219  4539 leader_election.cc:304] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:23.843901  4802 raft_consensus.cc:2804] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.856046  4702 raft_consensus.cc:493] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.859221  4702 raft_consensus.cc:515] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.865121  4779 leader_election.cc:290] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:23.861776  4500 raft_consensus.cc:2468] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:23.870642  4499 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:23.881805  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:23.882913  4702 leader_election.cc:290] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
W20260709 13:11:23.883795  4539 leader_election.cc:343] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.885685  4791 raft_consensus.cc:493] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.888041  4793 ts_tablet_manager.cc:1434] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.002s
I20260709 13:11:23.888787  4791 raft_consensus.cc:515] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.891396  4793 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:23.892880  4791 leader_election.cc:290] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.894721  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:23.896201  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:23.895391  4574 raft_consensus.cc:2468] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:23.896862  4650 raft_consensus.cc:2468] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
I20260709 13:11:23.908699  4613 leader_election.cc:304] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:23.909493  4794 tablet_bootstrap.cc:492] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:23.910095  4794 ts_tablet_manager.cc:1403] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.111s	user 0.048s	sys 0.042s
I20260709 13:11:23.907043  4539 leader_election.cc:304] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:23.911279  4702 raft_consensus.cc:2804] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.911721  4702 raft_consensus.cc:493] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.911846  4465 leader_election.cc:304] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:23.912117  4702 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.912768  4791 raft_consensus.cc:2804] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.904610  4779 raft_consensus.cc:493] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.913121  4791 raft_consensus.cc:493] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.913535  4791 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.913357  4779 raft_consensus.cc:515] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.913888  4794 raft_consensus.cc:359] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.914878  4794 raft_consensus.cc:385] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.915153  4794 raft_consensus.cc:740] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.915907  4794 consensus_queue.cc:260] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.916751  4779 leader_election.cc:290] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:23.917203  4812 raft_consensus.cc:2804] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.917796  4812 raft_consensus.cc:697] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:23.918656  4812 consensus_queue.cc:237] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.919095  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
W20260709 13:11:23.920452  4613 leader_election.cc:343] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.921074  4791 raft_consensus.cc:515] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.922503  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:23.923182  4574 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.923620  4793 tablet_bootstrap.cc:654] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.923900  4794 ts_tablet_manager.cc:1434] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:23.924988  4794 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:23.922354  4702 raft_consensus.cc:515] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.925658  4792 ts_tablet_manager.cc:1434] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.114s	user 0.034s	sys 0.033s
I20260709 13:11:23.926832  4792 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.927806  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:23.926883  4702 leader_election.cc:290] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.928675  4575 raft_consensus.cc:2393] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate deeb07674eaa4feab81bc0ef25e9d011 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:23.928793  4802 raft_consensus.cc:697] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:23.929858  4802 consensus_queue.cc:237] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.930514  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:23.933274  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:23.933753  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:23.934052  4649 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.934531  4575 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.934985  4794 tablet_bootstrap.cc:654] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.936362  4614 leader_election.cc:304] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:23.923827  4791 leader_election.cc:290] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.946318  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:23.941200  4817 raft_consensus.cc:493] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.948132  4817 raft_consensus.cc:515] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.949227  4396 catalog_manager.cc:5697] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 0 to 1, leader changed from <none> to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:23.950448  4464 leader_election.cc:343] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.952109  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3698976fc7254c4f9fb4dc19fa0f430b" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:23.952371  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:23.954802  4576 raft_consensus.cc:2468] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:23.954983  4817 leader_election.cc:290] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.958280  4792 tablet_bootstrap.cc:654] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:23.960973  4464 leader_election.cc:343] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.955608  4539 leader_election.cc:343] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.962361  4465 leader_election.cc:304] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:23.963861  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3698976fc7254c4f9fb4dc19fa0f430b" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:23.964516  4817 raft_consensus.cc:2804] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.965112  4817 raft_consensus.cc:493] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.965559  4817 raft_consensus.cc:3060] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.964514  4650 raft_consensus.cc:2468] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
I20260709 13:11:23.974285  4574 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:23.974830  4399 catalog_manager.cc:5697] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.976449  4817 raft_consensus.cc:515] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.978084  4817 leader_election.cc:290] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:23.978778  4812 raft_consensus.cc:493] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.979272  4812 raft_consensus.cc:515] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.979542  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3698976fc7254c4f9fb4dc19fa0f430b" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:23.980248  4650 raft_consensus.cc:3060] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.981088  4575 raft_consensus.cc:2468] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:23.981848  4812 leader_election.cc:290] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:23.982316  4465 leader_election.cc:304] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:23.982613  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:23.977685  4649 raft_consensus.cc:2468] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
W20260709 13:11:23.984102  4613 leader_election.cc:343] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.984555  4539 leader_election.cc:304] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:23.984746  4815 raft_consensus.cc:2749] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.986311  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:23.987913  4802 raft_consensus.cc:2804] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:23.988026  4614 leader_election.cc:343] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.989010  4802 raft_consensus.cc:697] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:23.990404  4802 consensus_queue.cc:237] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.988960  4614 leader_election.cc:304] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:23.991839  4817 raft_consensus.cc:2804] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.991979  4815 raft_consensus.cc:2749] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.994899  4793 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:23.992414  4817 raft_consensus.cc:697] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:23.995427  4793 ts_tablet_manager.cc:1403] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.021s
I20260709 13:11:23.996001  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3698976fc7254c4f9fb4dc19fa0f430b" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:23.997021  4792 tablet_bootstrap.cc:492] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:24.001140  4792 ts_tablet_manager.cc:1403] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.075s	user 0.002s	sys 0.014s
I20260709 13:11:24.001109  4574 raft_consensus.cc:3060] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.002329  4794 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:24.002866  4794 ts_tablet_manager.cc:1403] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.013s
I20260709 13:11:24.004879  4792 raft_consensus.cc:359] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.005781  4792 raft_consensus.cc:385] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.006079  4792 raft_consensus.cc:740] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.006893  4792 consensus_queue.cc:260] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.009044  4794 raft_consensus.cc:359] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.009837  4794 raft_consensus.cc:385] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.010150  4794 raft_consensus.cc:740] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.011049  4794 consensus_queue.cc:260] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:23.999354  4650 raft_consensus.cc:2468] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:23.999898  4817 consensus_queue.cc:237] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.013422  4794 ts_tablet_manager.cc:1434] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:11:24.014540  4794 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:24.014423  4464 leader_election.cc:304] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.015280  4792 ts_tablet_manager.cc:1434] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:11:24.015309  4791 raft_consensus.cc:2804] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.016573  4792 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:23.998649  4793 raft_consensus.cc:359] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.018564  4793 raft_consensus.cc:385] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.021762  4793 raft_consensus.cc:740] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.022682  4793 consensus_queue.cc:260] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.026816  4793 ts_tablet_manager.cc:1434] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:11:24.028111  4793 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:24.029378  4792 tablet_bootstrap.cc:654] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.033980  4397 catalog_manager.cc:5697] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.036298  4793 tablet_bootstrap.cc:654] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.037665  4794 tablet_bootstrap.cc:654] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.042376  4802 raft_consensus.cc:493] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.043048  4802 raft_consensus.cc:515] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.046013  4802 leader_election.cc:290] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.046311  4396 catalog_manager.cc:5697] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.049438  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.049510  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
W20260709 13:11:24.051119  4539 leader_election.cc:343] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.051360  4817 raft_consensus.cc:493] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.051892  4539 leader_election.cc:343] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.052323  4539 leader_election.cc:304] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4; no voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:24.052052  4817 raft_consensus.cc:515] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.053256  4802 raft_consensus.cc:2749] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.054821  4817 leader_election.cc:290] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.055948  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:24.056689  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:24.056800  4650 raft_consensus.cc:2468] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 0.
W20260709 13:11:24.057977  4465 leader_election.cc:343] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.058580  4464 leader_election.cc:304] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:24.059348  4817 raft_consensus.cc:2804] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.059794  4817 raft_consensus.cc:493] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.060179  4817 raft_consensus.cc:3060] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.061452  4792 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:24.062067  4792 ts_tablet_manager.cc:1403] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.002s
I20260709 13:11:24.012953  4574 raft_consensus.cc:2468] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
I20260709 13:11:24.065554  4792 raft_consensus.cc:359] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.068465  4792 raft_consensus.cc:385] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.068970  4792 raft_consensus.cc:740] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.068470  4817 raft_consensus.cc:515] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.074779  4817 leader_election.cc:290] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.074918  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.075816  4650 raft_consensus.cc:3060] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.076895  4792 consensus_queue.cc:260] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.080775  4792 ts_tablet_manager.cc:1434] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:11:24.082370  4792 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:24.082863  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:24.083428  4650 raft_consensus.cc:2468] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 1.
W20260709 13:11:24.084282  4465 leader_election.cc:343] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.084934  4464 leader_election.cc:304] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:24.085608  4817 raft_consensus.cc:2804] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.086129  4817 raft_consensus.cc:697] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:24.086958  4817 consensus_queue.cc:237] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.098492  4792 tablet_bootstrap.cc:654] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.104602  4791 raft_consensus.cc:697] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:24.105945  4791 consensus_queue.cc:237] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.111907  4792 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:24.112676  4792 ts_tablet_manager.cc:1403] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.014s
I20260709 13:11:24.116516  4792 raft_consensus.cc:359] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.117290  4792 raft_consensus.cc:385] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.117570  4793 tablet_bootstrap.cc:492] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:24.117622  4792 raft_consensus.cc:740] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.118368  4793 ts_tablet_manager.cc:1403] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.011s
I20260709 13:11:24.118934  4792 consensus_queue.cc:260] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.121249  4792 ts_tablet_manager.cc:1434] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:24.121592  4793 raft_consensus.cc:359] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.122300  4792 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: Bootstrap starting.
I20260709 13:11:24.124842  4794 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:24.125495  4794 ts_tablet_manager.cc:1403] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.035s
I20260709 13:11:24.126575  4399 catalog_manager.cc:5697] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.129151  4792 tablet_bootstrap.cc:654] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.122254  4793 raft_consensus.cc:385] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.129686  4793 raft_consensus.cc:740] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.130589  4793 consensus_queue.cc:260] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.128783  4794 raft_consensus.cc:359] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.131721  4794 raft_consensus.cc:385] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.132109  4794 raft_consensus.cc:740] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.132886  4794 consensus_queue.cc:260] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.135653  4793 ts_tablet_manager.cc:1434] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:11:24.136852  4793 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:24.145342  4794 ts_tablet_manager.cc:1434] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:11:24.146147  4794 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: Bootstrap starting.
I20260709 13:11:24.149988  4802 raft_consensus.cc:493] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.150517  4802 raft_consensus.cc:515] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.151204  4397 catalog_manager.cc:5697] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.152405  4794 tablet_bootstrap.cc:654] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.152519  4802 leader_election.cc:290] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.153332  4793 tablet_bootstrap.cc:654] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.155076  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.155337  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:24.155776  4499 raft_consensus.cc:2468] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 0.
I20260709 13:11:24.157434  4539 leader_election.cc:304] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:24.158123  4802 raft_consensus.cc:2804] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:24.158221  4539 leader_election.cc:343] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.158630  4802 raft_consensus.cc:493] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.159031  4802 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.167642  4793 tablet_bootstrap.cc:492] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:24.168274  4793 ts_tablet_manager.cc:1403] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:11:24.169762  4802 raft_consensus.cc:515] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.171010  4792 tablet_bootstrap.cc:492] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: No bootstrap required, opened a new log
I20260709 13:11:24.172035  4792 ts_tablet_manager.cc:1403] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.010s
I20260709 13:11:24.172856  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.173527  4499 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.174134  4794 tablet_bootstrap.cc:492] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: No bootstrap required, opened a new log
I20260709 13:11:24.174660  4794 ts_tablet_manager.cc:1403] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.006s
I20260709 13:11:24.175366  4792 raft_consensus.cc:359] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.176122  4792 raft_consensus.cc:385] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.171171  4793 raft_consensus.cc:359] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.176419  4792 raft_consensus.cc:740] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.176803  4793 raft_consensus.cc:385] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.177218  4793 raft_consensus.cc:740] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.177405  4794 raft_consensus.cc:359] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.177345  4792 consensus_queue.cc:260] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.178352  4794 raft_consensus.cc:385] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.178048  4793 consensus_queue.cc:260] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.178714  4794 raft_consensus.cc:740] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.180840  4794 consensus_queue.cc:260] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.181310  4793 ts_tablet_manager.cc:1434] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:24.183105  4794 ts_tablet_manager.cc:1434] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:11:24.184860  4792 ts_tablet_manager.cc:1434] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:24.186937  4793 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: Bootstrap starting.
I20260709 13:11:24.187621  4499 raft_consensus.cc:2468] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:24.188313  4815 raft_consensus.cc:493] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.188949  4815 raft_consensus.cc:515] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.191071  4815 leader_election.cc:290] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.192658  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:24.193387  4574 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:24.194795  4614 leader_election.cc:304] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.195700  4815 raft_consensus.cc:2804] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.196091  4815 raft_consensus.cc:493] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.195919  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.196542  4815 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.196815  4500 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:24.197229  4793 tablet_bootstrap.cc:654] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.202623  4793 tablet_bootstrap.cc:492] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: No bootstrap required, opened a new log
I20260709 13:11:24.203044  4793 ts_tablet_manager.cc:1403] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:11:24.202819  4815 raft_consensus.cc:515] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.204633  4539 leader_election.cc:304] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:24.204699  4802 leader_election.cc:290] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.205410  4802 raft_consensus.cc:2804] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.205907  4802 raft_consensus.cc:697] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.206254  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.206231  4793 raft_consensus.cc:359] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.207011  4650 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.207127  4793 raft_consensus.cc:385] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.206841  4802 consensus_queue.cc:237] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.207573  4793 raft_consensus.cc:740] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.208339  4793 consensus_queue.cc:260] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.214473  4650 raft_consensus.cc:2468] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 1.
I20260709 13:11:24.216094  4793 ts_tablet_manager.cc:1434] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:11:24.220117  4779 raft_consensus.cc:493] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.220703  4779 raft_consensus.cc:515] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.221830  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.222729  4499 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.224687  4815 leader_election.cc:290] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.224792  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.222774  4779 leader_election.cc:290] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.226830  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:24.226953  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:24.227447  4575 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.227752  4574 raft_consensus.cc:2393] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate deeb07674eaa4feab81bc0ef25e9d011 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:24.231624  4499 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:24.231657  4614 leader_election.cc:304] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deeb07674eaa4feab81bc0ef25e9d011; no voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:24.233366  4613 leader_election.cc:304] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.234061  4812 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.234136  4779 raft_consensus.cc:2804] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.234690  4779 raft_consensus.cc:697] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.234606  4396 catalog_manager.cc:5697] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.235702  4779 consensus_queue.cc:237] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.236019  4575 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:24.244494  4812 raft_consensus.cc:2749] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.246744  4399 catalog_manager.cc:5697] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 0 to 1, leader changed from <none> to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.302260  4812 raft_consensus.cc:493] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.302785  4812 raft_consensus.cc:515] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.304525  4812 leader_election.cc:290] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.305573  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:24.305563  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.306280  4574 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:24.306483  4499 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 0.
I20260709 13:11:24.307329  4614 leader_election.cc:304] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.308212  4812 raft_consensus.cc:2804] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.308568  4812 raft_consensus.cc:493] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.308851  4812 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.313704  4812 raft_consensus.cc:515] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.315584  4812 leader_election.cc:290] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.316542  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.316617  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:24.317198  4499 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.317332  4574 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.317665  4802 raft_consensus.cc:493] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.318158  4802 raft_consensus.cc:515] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.320222  4802 leader_election.cc:290] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.324812  4499 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:24.325778  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" is_pre_election: true
I20260709 13:11:24.326057  4613 leader_election.cc:304] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.326987  4812 raft_consensus.cc:2804] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.327486  4812 raft_consensus.cc:697] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.327493  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4475da69d54814850dc409f20caf31" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:24.325805  4574 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 1.
I20260709 13:11:24.328509  4650 raft_consensus.cc:2393] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c59aff8a49f49d186871c198b8f78c4 in current term 1: Already voted for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in this term.
I20260709 13:11:24.328441  4812 consensus_queue.cc:237] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.329674  4539 leader_election.cc:304] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4; no voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:24.330443  4813 raft_consensus.cc:3060] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.338387  4813 raft_consensus.cc:2749] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.341194  4399 catalog_manager.cc:5697] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 0 to 1, leader changed from <none> to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.363057  4791 raft_consensus.cc:493] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.363709  4791 raft_consensus.cc:515] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.365504  4791 leader_election.cc:290] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.366381  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c59aff8a49f49d186871c198b8f78c4" is_pre_election: true
I20260709 13:11:24.366492  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011" is_pre_election: true
I20260709 13:11:24.367153  4650 raft_consensus.cc:2393] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa25b94a1ae64a47b4b3689b37ba28b6 in current term 1: Already voted for candidate 2c59aff8a49f49d186871c198b8f78c4 in this term.
I20260709 13:11:24.368001  4464 leader_election.cc:304] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:24.368696  4791 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.373924  4791 raft_consensus.cc:2749] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.377846  4813 consensus_queue.cc:1048] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.389214  4813 consensus_queue.cc:1048] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.394471  4812 consensus_queue.cc:1048] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.407897  4779 consensus_queue.cc:1048] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.441133  4813 consensus_queue.cc:1048] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.451287  4702 consensus_queue.cc:1048] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.503190  4817 consensus_queue.cc:1048] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.513690  4826 consensus_queue.cc:1048] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.557981  4574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
mode: GRACEFUL
new_leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
 from {username='slave'} at 127.0.0.1:37632
I20260709 13:11:24.558531  4574 raft_consensus.cc:606] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Received request to transfer leadership to TS aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:24.566884  4650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26338f92004141f58fff27847edb9ffd"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
mode: GRACEFUL
new_leader_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:56204
I20260709 13:11:24.567384  4650 raft_consensus.cc:606] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Received request to transfer leadership to TS 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:24.572578  4650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
mode: GRACEFUL
new_leader_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:56204
I20260709 13:11:24.573185  4650 raft_consensus.cc:606] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Received request to transfer leadership to TS 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:24.578166  4650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
mode: GRACEFUL
new_leader_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:56204
I20260709 13:11:24.578675  4650 raft_consensus.cc:606] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Received request to transfer leadership to TS 2c59aff8a49f49d186871c198b8f78c4
I20260709 13:11:24.583619  4574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:37632
I20260709 13:11:24.584203  4574 raft_consensus.cc:606] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:24.598403  4802 consensus_queue.cc:1048] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.604866  4702 raft_consensus.cc:993] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:24.604844  4832 consensus_queue.cc:1048] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.605517  4813 raft_consensus.cc:1081] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:24.607129  4650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56192
I20260709 13:11:24.607695  4650 raft_consensus.cc:493] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.608040  4650 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.611159  4702 consensus_queue.cc:1048] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.621352  4826 consensus_queue.cc:1048] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.620155  4650 raft_consensus.cc:515] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.630825  4649 raft_consensus.cc:1240] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Rejecting Update request from peer 2c59aff8a49f49d186871c198b8f78c4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:24.634259  4702 consensus_queue.cc:1059] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.635047  4802 raft_consensus.cc:3055] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.635787  4802 raft_consensus.cc:740] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.636047  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:24.636647  4650 leader_election.cc:290] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:24.636574  4802 consensus_queue.cc:260] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.634845  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba384fb8d94286b65b2f54d707e4ac" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.640920  4802 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.641150  4499 raft_consensus.cc:3060] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.645845  4779 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.656724  4812 raft_consensus.cc:993] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: : Instructing follower 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.657181  4812 raft_consensus.cc:1081] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Signalling peer 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.659654  4499 raft_consensus.cc:2468] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:24.660413  4575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:37630
I20260709 13:11:24.661024  4575 raft_consensus.cc:493] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.661407  4575 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.663825  4613 leader_election.cc:304] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.664623  4812 raft_consensus.cc:2804] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.665109  4812 raft_consensus.cc:697] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.665483  4779 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.665939  4812 consensus_queue.cc:237] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.667055  4574 raft_consensus.cc:2468] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:24.668454  4575 raft_consensus.cc:515] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.670678  4575 leader_election.cc:290] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.671756  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.672273  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.672871  4649 raft_consensus.cc:3055] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.673151  4649 raft_consensus.cc:740] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.673987  4649 consensus_queue.cc:260] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.675146  4649 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.680100  4826 consensus_queue.cc:1048] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.682524  4649 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:24.683786  4539 leader_election.cc:304] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: aa25b94a1ae64a47b4b3689b37ba28b6
I20260709 13:11:24.684949  4802 raft_consensus.cc:2804] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.685438  4802 raft_consensus.cc:697] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.686527  4802 consensus_queue.cc:237] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.696408  4397 catalog_manager.cc:5697] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 1 to 2, leader changed from 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.697986  4791 consensus_queue.cc:1048] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.698415  4399 catalog_manager.cc:5697] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 1 to 2, leader changed from deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195) to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.770978  4812 consensus_queue.cc:1048] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.777570  4815 raft_consensus.cc:993] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: : Instructing follower 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.778110  4779 raft_consensus.cc:1081] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Signalling peer 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.780154  4574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:37630
I20260709 13:11:24.784088  4574 raft_consensus.cc:493] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.784461  4574 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.786325  4812 consensus_queue.cc:1048] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.790714  4574 raft_consensus.cc:515] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.799154  4574 leader_election.cc:290] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.799700  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.800031  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f146cdeb2fb543d3adfb5a02f04bc048" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.800348  4499 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.800680  4650 raft_consensus.cc:3055] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.801026  4650 raft_consensus.cc:740] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.801651  4650 consensus_queue.cc:260] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.802546  4650 raft_consensus.cc:3060] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.806391  4499 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:24.806847  4650 raft_consensus.cc:2468] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:24.807838  4539 leader_election.cc:304] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, aa25b94a1ae64a47b4b3689b37ba28b6; no voters: 
I20260709 13:11:24.808568  4802 raft_consensus.cc:2804] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.809008  4802 raft_consensus.cc:697] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.809795  4802 consensus_queue.cc:237] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.813000  4815 raft_consensus.cc:993] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: : Instructing follower 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.813472  4815 raft_consensus.cc:1081] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Signalling peer 2c59aff8a49f49d186871c198b8f78c4 to start an election
I20260709 13:11:24.815600  4574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26338f92004141f58fff27847edb9ffd"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
 from {username='slave'} at 127.0.0.1:37630
I20260709 13:11:24.816130  4574 raft_consensus.cc:493] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.816480  4574 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.818413  4397 catalog_manager.cc:5697] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 1 to 2, leader changed from deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195) to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.821456  4574 raft_consensus.cc:515] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.823169  4574 leader_election.cc:290] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.824518  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.825057  4650 raft_consensus.cc:3055] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.825266  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26338f92004141f58fff27847edb9ffd" candidate_uuid: "2c59aff8a49f49d186871c198b8f78c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:24.825343  4650 raft_consensus.cc:740] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:24.826426  4499 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.826907  4650 consensus_queue.cc:260] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.828116  4650 raft_consensus.cc:3060] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.834533  4650 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:24.835575  4539 leader_election.cc:304] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.836408  4802 raft_consensus.cc:2804] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.837110  4802 raft_consensus.cc:697] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Leader. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.837863  4802 consensus_queue.cc:237] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.836333  4499 raft_consensus.cc:2468] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c59aff8a49f49d186871c198b8f78c4 in term 2.
I20260709 13:11:24.844069  4397 catalog_manager.cc:5697] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 reported cstate change: term changed from 1 to 2, leader changed from deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195) to 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "2c59aff8a49f49d186871c198b8f78c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.965982  4813 raft_consensus.cc:993] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: : Instructing follower aa25b94a1ae64a47b4b3689b37ba28b6 to start an election
I20260709 13:11:24.966441  4813 raft_consensus.cc:1081] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Signalling peer aa25b94a1ae64a47b4b3689b37ba28b6 to start an election
I20260709 13:11:24.967941  4499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
 from {username='slave'} at 127.0.0.1:36774
I20260709 13:11:24.968487  4499 raft_consensus.cc:493] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.968781  4499 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.974154  4499 raft_consensus.cc:515] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.975883  4499 leader_election.cc:290] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 2 election: Requested vote from peers 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401), deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195:44905)
I20260709 13:11:24.976583  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:24.976886  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6c7e4b31624b1fa56109710c8f3d2f" candidate_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
I20260709 13:11:24.977217  4574 raft_consensus.cc:3055] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.977432  4650 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.977547  4574 raft_consensus.cc:740] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:24.978320  4574 consensus_queue.cc:260] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.979468  4574 raft_consensus.cc:3060] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.983887  4650 raft_consensus.cc:2468] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 2.
I20260709 13:11:24.985291  4464 leader_election.cc:304] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:24.985822  4574 raft_consensus.cc:2468] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25b94a1ae64a47b4b3689b37ba28b6 in term 2.
I20260709 13:11:24.985983  4791 raft_consensus.cc:2804] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.986544  4791 raft_consensus.cc:697] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Becoming Leader. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:24.987372  4791 consensus_queue.cc:237] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:24.993716  4397 catalog_manager.cc:5697] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 reported cstate change: term changed from 1 to 2, leader changed from 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194) to aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.090004  4499 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.096321  4499 raft_consensus.cc:1275] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.097599  4813 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.105780  4650 raft_consensus.cc:1275] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.107704  4802 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.174621  4499 raft_consensus.cc:1275] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.175997  4812 consensus_queue.cc:1048] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:25.185681  4574 raft_consensus.cc:1275] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.189385  4815 consensus_queue.cc:1048] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.223449  4650 raft_consensus.cc:1275] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.224725  4802 consensus_queue.cc:1048] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.233386  4499 raft_consensus.cc:1275] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.234866  4802 consensus_queue.cc:1048] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.267127  4650 raft_consensus.cc:1275] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.268883  4802 consensus_queue.cc:1048] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.276678  4499 raft_consensus.cc:1275] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer 2c59aff8a49f49d186871c198b8f78c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.279325  4702 consensus_queue.cc:1048] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.443765  4574 raft_consensus.cc:1275] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer aa25b94a1ae64a47b4b3689b37ba28b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.445040  4826 consensus_queue.cc:1048] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.455444  4650 raft_consensus.cc:1275] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Refusing update from remote peer aa25b94a1ae64a47b4b3689b37ba28b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.456892  4826 consensus_queue.cc:1048] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.587218  4397 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42346:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:27.608314  4397 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42346:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:27.657980 25507 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:27.758013  4911 tablet.cc:1724] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.760650  4910 tablet.cc:1724] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.817615  4923 tablet.cc:1724] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:27.856395  4465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.194:46401, user_credentials={real_user=slave}} blocked reactor thread for 65905.4us
I20260709 13:11:27.899358  4928 tablet.cc:1724] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:27.903798  4527 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:0e4475da69d54814850dc409f20caf31)
W20260709 13:11:27.910892  4527 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0e4475da69d54814850dc409f20caf31)
W20260709 13:11:27.913389  4527 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0e4475da69d54814850dc409f20caf31)
W20260709 13:11:27.923007  4539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:44905, user_credentials={real_user=slave}} blocked reactor thread for 97276.6us
I20260709 13:11:27.884393  4937 tablet.cc:1724] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.928223  4935 tablet.cc:1724] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.944388  4910 tablet.cc:1724] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.968348  4911 tablet.cc:1724] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.970791  4940 tablet.cc:1724] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.976660  4923 tablet.cc:1724] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.980705  4937 tablet.cc:1724] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.985853  4910 tablet.cc:1724] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.987805  4939 tablet.cc:1724] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.007232  4938 tablet.cc:1724] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:27.954114  4931 tablet.cc:1724] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:28.057235  4539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:44905, user_credentials={real_user=slave}} blocked reactor thread for 105429us
I20260709 13:11:28.065256  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:36792
I20260709 13:11:28.072436  4499 raft_consensus.cc:606] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:28.094509  4928 tablet.cc:1724] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:28.118760  4539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.195:44905, user_credentials={real_user=slave}} blocked reactor thread for 59772.3us
I20260709 13:11:28.017634  4943 tablet.cc:1724] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.125782  4940 tablet.cc:1724] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.139035  4947 tablet.cc:1724] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.139434  4911 tablet.cc:1724] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.176940  4947 tablet.cc:1724] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.186589  4939 tablet.cc:1724] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.191777  4910 tablet.cc:1724] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.203392  4940 tablet.cc:1724] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.204344  4938 tablet.cc:1724] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.209431  4911 tablet.cc:1724] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.222885  4928 tablet.cc:1724] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:28.240720  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:37642
I20260709 13:11:28.241564  4576 raft_consensus.cc:606] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:28.255532 25507 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:11:28.257114 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:28.271508  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfb2699d69884158b791c456dcb30611"
dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:37642
I20260709 13:11:28.272183  4576 raft_consensus.cc:606] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:28.276712  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6"
dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
mode: GRACEFUL
new_leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:36792
I20260709 13:11:28.277235  4499 raft_consensus.cc:606] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Received request to transfer leadership to TS deeb07674eaa4feab81bc0ef25e9d011
I20260709 13:11:28.278558 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:28.279320 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.283980  4397 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: soft_deleted_table [id=303d3f2ab96f4dda919d92dc75f42632] alter complete (version 1)
I20260709 13:11:28.313337  4920 raft_consensus.cc:993] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.314081  4924 raft_consensus.cc:1081] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.316435  4647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56180
I20260709 13:11:28.316979  4647 raft_consensus.cc:493] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.317284  4647 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.323835  4647 raft_consensus.cc:515] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.325953  4647 leader_election.cc:290] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:28.327005  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:28.326921  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74108dde8fe4edfb617a654fdde96a2" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:28.327870  4576 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.327950  4499 raft_consensus.cc:3055] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.328384  4499 raft_consensus.cc:740] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:28.329145  4499 consensus_queue.cc:260] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.330332  4499 raft_consensus.cc:3060] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.334570  4576 raft_consensus.cc:2468] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:28.336133  4614 leader_election.cc:304] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:28.336366  4499 raft_consensus.cc:2468] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:28.337303  4930 raft_consensus.cc:2804] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.337740  4930 raft_consensus.cc:697] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:28.338624  4930 consensus_queue.cc:237] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.346709  4397 catalog_manager.cc:5697] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 1 to 2, leader changed from aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.534650  4902 raft_consensus.cc:993] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.535112  4924 raft_consensus.cc:1081] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.536594  4647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56180
I20260709 13:11:28.537021  4647 raft_consensus.cc:493] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.537266  4647 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.542665  4647 raft_consensus.cc:515] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:28.544269  4647 leader_election.cc:290] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 3 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:28.545172  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:28.545378  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd332d6fac0543c48f4e006472d1c1c6" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:28.545841  4499 raft_consensus.cc:3055] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.546046  4576 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.546165  4499 raft_consensus.cc:740] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa25b94a1ae64a47b4b3689b37ba28b6, State: Running, Role: LEADER
I20260709 13:11:28.547231  4499 consensus_queue.cc:260] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:28.548244  4499 raft_consensus.cc:3060] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.552536  4576 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 3.
I20260709 13:11:28.552831  4499 raft_consensus.cc:2468] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 3.
I20260709 13:11:28.553778  4614 leader_election.cc:304] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c59aff8a49f49d186871c198b8f78c4, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:28.554713  4930 raft_consensus.cc:2804] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.555239  4930 raft_consensus.cc:697] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 3 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:28.556106  4930 consensus_queue.cc:237] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } }
I20260709 13:11:28.564625  4397 catalog_manager.cc:5697] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 2 to 3, leader changed from aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.589190  4941 raft_consensus.cc:993] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.589778  4933 raft_consensus.cc:1081] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.591218  4647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56192
I20260709 13:11:28.591702  4647 raft_consensus.cc:493] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.591969  4647 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.597013  4647 raft_consensus.cc:515] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.598551  4647 leader_election.cc:290] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 3 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:28.599741  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:28.599824  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf4e73fe9a2440fa6eb02e9878535fd" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:28.600420  4576 raft_consensus.cc:3055] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.600574  4499 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.600723  4576 raft_consensus.cc:740] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:28.601706  4576 consensus_queue.cc:260] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.602713  4576 raft_consensus.cc:3060] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.606300  4499 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 3.
I20260709 13:11:28.607446  4613 leader_election.cc:304] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:28.608325  4930 raft_consensus.cc:2804] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.608361  4576 raft_consensus.cc:2468] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 3.
I20260709 13:11:28.608896  4930 raft_consensus.cc:697] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 3 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:28.610162  4930 consensus_queue.cc:237] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.617416  4397 catalog_manager.cc:5697] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 2 to 3, leader changed from 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.657434  4941 raft_consensus.cc:993] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: : Instructing follower deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.657917  4933 raft_consensus.cc:1081] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Signalling peer deeb07674eaa4feab81bc0ef25e9d011 to start an election
I20260709 13:11:28.659487  4647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfb2699d69884158b791c456dcb30611"
dest_uuid: "deeb07674eaa4feab81bc0ef25e9d011"
 from {username='slave'} at 127.0.0.1:56192
I20260709 13:11:28.660040  4647 raft_consensus.cc:493] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.660362  4647 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.665408  4647 raft_consensus.cc:515] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.667199  4647 leader_election.cc:290] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Requested vote from peers aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047), 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401)
I20260709 13:11:28.667858  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6"
I20260709 13:11:28.668542  4499 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.668445  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb2699d69884158b791c456dcb30611" candidate_uuid: "deeb07674eaa4feab81bc0ef25e9d011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c59aff8a49f49d186871c198b8f78c4"
I20260709 13:11:28.669152  4576 raft_consensus.cc:3055] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.669466  4576 raft_consensus.cc:740] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c59aff8a49f49d186871c198b8f78c4, State: Running, Role: LEADER
I20260709 13:11:28.670221  4576 consensus_queue.cc:260] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.671263  4576 raft_consensus.cc:3060] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.674021  4499 raft_consensus.cc:2468] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:28.675063  4613 leader_election.cc:304] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25b94a1ae64a47b4b3689b37ba28b6, deeb07674eaa4feab81bc0ef25e9d011; no voters: 
I20260709 13:11:28.675841  4930 raft_consensus.cc:2804] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.676239  4930 raft_consensus.cc:697] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Becoming Leader. State: Replica: deeb07674eaa4feab81bc0ef25e9d011, State: Running, Role: LEADER
I20260709 13:11:28.676882  4576 raft_consensus.cc:2468] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deeb07674eaa4feab81bc0ef25e9d011 in term 2.
I20260709 13:11:28.677261  4930 consensus_queue.cc:237] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } }
I20260709 13:11:28.684762  4397 catalog_manager.cc:5697] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 reported cstate change: term changed from 1 to 2, leader changed from 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194) to deeb07674eaa4feab81bc0ef25e9d011 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "deeb07674eaa4feab81bc0ef25e9d011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deeb07674eaa4feab81bc0ef25e9d011" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 44905 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.852075  4576 raft_consensus.cc:1275] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:28.853523  4930 consensus_queue.cc:1048] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:28.863277  4499 raft_consensus.cc:1275] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:28.865161  4930 consensus_queue.cc:1048] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.018370  4574 raft_consensus.cc:1275] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:29.019781  4871 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.030246  4499 raft_consensus.cc:1275] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:29.032156  4956 consensus_queue.cc:1048] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.070245  4574 raft_consensus.cc:1275] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.071487  4956 consensus_queue.cc:1048] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.082152  4499 raft_consensus.cc:1275] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.083611  4871 consensus_queue.cc:1048] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.102432  4574 raft_consensus.cc:1275] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.104537  4959 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c59aff8a49f49d186871c198b8f78c4" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.121074  4499 raft_consensus.cc:1275] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Refusing update from remote peer deeb07674eaa4feab81bc0ef25e9d011: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.122310  4959 consensus_queue.cc:1048] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25b94a1ae64a47b4b3689b37ba28b6" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.338886 25507 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:29.344904 25507 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:11:29.345321 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.351181 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:11:29.351570 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:30.379534 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
W20260709 13:11:30.397969  4613 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:11:30.404534  4613 consensus_peers.cc:597] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.409399 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:30.410210 25507 tablet_replica.cc:333] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.411324 25507 raft_consensus.cc:2243] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.411947 25507 raft_consensus.cc:2272] T f146cdeb2fb543d3adfb5a02f04bc048 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.414535 25507 tablet_replica.cc:333] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.415366 25507 raft_consensus.cc:2243] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.415985 25507 raft_consensus.cc:2272] T 26338f92004141f58fff27847edb9ffd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.418213 25507 tablet_replica.cc:333] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.418896 25507 raft_consensus.cc:2243] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.419308 25507 raft_consensus.cc:2272] T c74108dde8fe4edfb617a654fdde96a2 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.421483 25507 tablet_replica.cc:333] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.422065 25507 raft_consensus.cc:2243] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.422533 25507 raft_consensus.cc:2272] T be5e81a5e9de4be6a2e612f691f5c8c0 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.424809 25507 tablet_replica.cc:333] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.425366 25507 raft_consensus.cc:2243] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.425904 25507 raft_consensus.cc:2272] T eaf4e73fe9a2440fa6eb02e9878535fd P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.428508 25507 tablet_replica.cc:333] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.429433 25507 raft_consensus.cc:2243] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.430399 25507 raft_consensus.cc:2272] T 8a6c7e4b31624b1fa56109710c8f3d2f P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.431321  4539 consensus_peers.cc:597] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.433554 25507 tablet_replica.cc:333] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.434288 25507 raft_consensus.cc:2243] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.434774 25507 raft_consensus.cc:2272] T 9125fac1e8e74429bcc7d56bce6b5b85 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.437275 25507 tablet_replica.cc:333] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.437826 25507 raft_consensus.cc:2243] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.438585 25507 raft_consensus.cc:2272] T 3698976fc7254c4f9fb4dc19fa0f430b P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.440843 25507 tablet_replica.cc:333] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.441434 25507 raft_consensus.cc:2243] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.442061 25507 raft_consensus.cc:2272] T 2da8c55c5900467785b5ab97700c09fb P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.444249 25507 tablet_replica.cc:333] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.444806 25507 raft_consensus.cc:2243] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.445324 25507 raft_consensus.cc:2272] T e97386bdb1ac426d8c324814f935e19e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.447408 25507 tablet_replica.cc:333] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.448019 25507 raft_consensus.cc:2243] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.448516 25507 raft_consensus.cc:2272] T 96ba384fb8d94286b65b2f54d707e4ac P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.450642 25507 tablet_replica.cc:333] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.451179 25507 raft_consensus.cc:2243] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.451685 25507 raft_consensus.cc:2272] T 93243b50c3524508961e96966903ca9e P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.454152 25507 tablet_replica.cc:333] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.454712 25507 raft_consensus.cc:2243] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.455157 25507 raft_consensus.cc:2272] T cfb2699d69884158b791c456dcb30611 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.457253 25507 tablet_replica.cc:333] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.457811 25507 raft_consensus.cc:2243] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.458700 25507 raft_consensus.cc:2272] T 1672c47e5b3042cabad8daab8db96f29 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.460829 25507 tablet_replica.cc:333] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.461364 25507 raft_consensus.cc:2243] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.462124 25507 raft_consensus.cc:2272] T 4a4e215e42284a6db68e5480b4d1d411 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.464646 25507 tablet_replica.cc:333] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.465168 25507 raft_consensus.cc:2243] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.465601 25507 raft_consensus.cc:2272] T fd332d6fac0543c48f4e006472d1c1c6 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.468289 25507 tablet_replica.cc:333] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.468807 25507 raft_consensus.cc:2243] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.469627 25507 raft_consensus.cc:2272] T 0e4475da69d54814850dc409f20caf31 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.471958 25507 tablet_replica.cc:333] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6: stopping tablet replica
I20260709 13:11:30.472431 25507 raft_consensus.cc:2243] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.473415 25507 raft_consensus.cc:2272] T 9dfc8615b2dd4fb59ef55a2434a97099 P aa25b94a1ae64a47b4b3689b37ba28b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.515395 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
I20260709 13:11:30.552102 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
I20260709 13:11:30.583847 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:30.584766 25507 tablet_replica.cc:333] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
W20260709 13:11:30.585427  4539 consensus_peers.cc:597] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:42047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.585736 25507 raft_consensus.cc:2243] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.586691 25507 raft_consensus.cc:2272] T f146cdeb2fb543d3adfb5a02f04bc048 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.588814 25507 tablet_replica.cc:333] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.589407 25507 raft_consensus.cc:2243] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.589870 25507 raft_consensus.cc:2272] T c74108dde8fe4edfb617a654fdde96a2 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.591995 25507 tablet_replica.cc:333] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.592609 25507 raft_consensus.cc:2243] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.593417 25507 raft_consensus.cc:2272] T 26338f92004141f58fff27847edb9ffd P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.595531 25507 tablet_replica.cc:333] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.596148 25507 raft_consensus.cc:2243] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.596553 25507 raft_consensus.cc:2272] T eaf4e73fe9a2440fa6eb02e9878535fd P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.598397 25507 tablet_replica.cc:333] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.598969 25507 raft_consensus.cc:2243] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.599411 25507 raft_consensus.cc:2272] T 3698976fc7254c4f9fb4dc19fa0f430b P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.601346 25507 tablet_replica.cc:333] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.601943 25507 raft_consensus.cc:2243] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.602715 25507 raft_consensus.cc:2272] T 9125fac1e8e74429bcc7d56bce6b5b85 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.605320 25507 tablet_replica.cc:333] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.606076 25507 raft_consensus.cc:2243] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.606631 25507 raft_consensus.cc:2272] T 8a6c7e4b31624b1fa56109710c8f3d2f P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.607035  4614 consensus_peers.cc:597] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 -> Peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Couldn't send request to peer 2c59aff8a49f49d186871c198b8f78c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.608611 25507 tablet_replica.cc:333] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.609233 25507 raft_consensus.cc:2243] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.610045 25507 raft_consensus.cc:2272] T 2da8c55c5900467785b5ab97700c09fb P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.612197 25507 tablet_replica.cc:333] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.613026 25507 raft_consensus.cc:2243] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.613570 25507 raft_consensus.cc:2272] T be5e81a5e9de4be6a2e612f691f5c8c0 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.616331 25507 tablet_replica.cc:333] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
W20260709 13:11:30.616448  4614 consensus_peers.cc:597] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 -> Peer 2c59aff8a49f49d186871c198b8f78c4 (127.24.232.194:46401): Couldn't send request to peer 2c59aff8a49f49d186871c198b8f78c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.616959 25507 raft_consensus.cc:2243] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.617542 25507 raft_consensus.cc:2272] T 96ba384fb8d94286b65b2f54d707e4ac P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.619680 25507 tablet_replica.cc:333] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.620215 25507 raft_consensus.cc:2243] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.621052 25507 raft_consensus.cc:2272] T 93243b50c3524508961e96966903ca9e P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.623169 25507 tablet_replica.cc:333] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.623826 25507 raft_consensus.cc:2243] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.624564 25507 raft_consensus.cc:2272] T e97386bdb1ac426d8c324814f935e19e P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.627476 25507 tablet_replica.cc:333] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.628247 25507 raft_consensus.cc:2243] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.628634 25507 raft_consensus.cc:2272] T 4a4e215e42284a6db68e5480b4d1d411 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.630628 25507 tablet_replica.cc:333] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.631158 25507 raft_consensus.cc:2243] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.631549 25507 raft_consensus.cc:2272] T 1672c47e5b3042cabad8daab8db96f29 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.633795 25507 tablet_replica.cc:333] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.634217 25507 raft_consensus.cc:2243] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.634603 25507 raft_consensus.cc:2272] T 0e4475da69d54814850dc409f20caf31 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.637198 25507 tablet_replica.cc:333] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.637692 25507 raft_consensus.cc:2243] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.638100 25507 raft_consensus.cc:2272] T 9dfc8615b2dd4fb59ef55a2434a97099 P 2c59aff8a49f49d186871c198b8f78c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.640436 25507 tablet_replica.cc:333] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.641125 25507 raft_consensus.cc:2243] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.641638 25507 raft_consensus.cc:2272] T cfb2699d69884158b791c456dcb30611 P 2c59aff8a49f49d186871c198b8f78c4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.642098  4613 consensus_peers.cc:597] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:42047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.644012 25507 tablet_replica.cc:333] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4: stopping tablet replica
I20260709 13:11:30.644872 25507 raft_consensus.cc:2243] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.645319 25507 raft_consensus.cc:2272] T fd332d6fac0543c48f4e006472d1c1c6 P 2c59aff8a49f49d186871c198b8f78c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.680308 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
W20260709 13:11:30.681948  4613 consensus_peers.cc:597] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:42047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.715329  4613 consensus_peers.cc:597] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:42047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.718382 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
W20260709 13:11:30.749189  4613 consensus_peers.cc:597] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 -> Peer aa25b94a1ae64a47b4b3689b37ba28b6 (127.24.232.193:42047): Couldn't send request to peer aa25b94a1ae64a47b4b3689b37ba28b6. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:42047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.752732 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:30.753628 25507 tablet_replica.cc:333] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.754457 25507 raft_consensus.cc:2243] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.754988 25507 raft_consensus.cc:2272] T f146cdeb2fb543d3adfb5a02f04bc048 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.757179 25507 tablet_replica.cc:333] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.757771 25507 raft_consensus.cc:2243] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.758535 25507 raft_consensus.cc:2272] T c74108dde8fe4edfb617a654fdde96a2 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.760608 25507 tablet_replica.cc:333] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.761179 25507 raft_consensus.cc:2243] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.761632 25507 raft_consensus.cc:2272] T 26338f92004141f58fff27847edb9ffd P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.763723 25507 tablet_replica.cc:333] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.764248 25507 raft_consensus.cc:2243] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.765043 25507 raft_consensus.cc:2272] T be5e81a5e9de4be6a2e612f691f5c8c0 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.766995 25507 tablet_replica.cc:333] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.767557 25507 raft_consensus.cc:2243] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.768373 25507 raft_consensus.cc:2272] T eaf4e73fe9a2440fa6eb02e9878535fd P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.770498 25507 tablet_replica.cc:333] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.771080 25507 raft_consensus.cc:2243] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.771552 25507 raft_consensus.cc:2272] T 8a6c7e4b31624b1fa56109710c8f3d2f P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.773756 25507 tablet_replica.cc:333] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.774314 25507 raft_consensus.cc:2243] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.774853 25507 raft_consensus.cc:2272] T 3698976fc7254c4f9fb4dc19fa0f430b P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.776858 25507 tablet_replica.cc:333] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.777410 25507 raft_consensus.cc:2243] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.777864 25507 raft_consensus.cc:2272] T 9125fac1e8e74429bcc7d56bce6b5b85 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.779834 25507 tablet_replica.cc:333] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.780382 25507 raft_consensus.cc:2243] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.780810 25507 raft_consensus.cc:2272] T 2da8c55c5900467785b5ab97700c09fb P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.782800 25507 tablet_replica.cc:333] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.783373 25507 raft_consensus.cc:2243] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.784111 25507 raft_consensus.cc:2272] T cfb2699d69884158b791c456dcb30611 P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.786126 25507 tablet_replica.cc:333] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.786616 25507 raft_consensus.cc:2243] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.787343 25507 raft_consensus.cc:2272] T 96ba384fb8d94286b65b2f54d707e4ac P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.789364 25507 tablet_replica.cc:333] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.789822 25507 raft_consensus.cc:2243] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.790225 25507 raft_consensus.cc:2272] T e97386bdb1ac426d8c324814f935e19e P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.792135 25507 tablet_replica.cc:333] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.792603 25507 raft_consensus.cc:2243] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.793002 25507 raft_consensus.cc:2272] T 93243b50c3524508961e96966903ca9e P deeb07674eaa4feab81bc0ef25e9d011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.794826 25507 tablet_replica.cc:333] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.795260 25507 raft_consensus.cc:2243] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.795642 25507 raft_consensus.cc:2272] T 0e4475da69d54814850dc409f20caf31 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.797591 25507 tablet_replica.cc:333] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.798056 25507 raft_consensus.cc:2243] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.798436 25507 raft_consensus.cc:2272] T 9dfc8615b2dd4fb59ef55a2434a97099 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.800333 25507 tablet_replica.cc:333] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.800760 25507 raft_consensus.cc:2243] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.801127 25507 raft_consensus.cc:2272] T 1672c47e5b3042cabad8daab8db96f29 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.802983 25507 tablet_replica.cc:333] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.803386 25507 raft_consensus.cc:2243] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.803791 25507 raft_consensus.cc:2272] T 4a4e215e42284a6db68e5480b4d1d411 P deeb07674eaa4feab81bc0ef25e9d011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.805876 25507 tablet_replica.cc:333] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011: stopping tablet replica
I20260709 13:11:30.806267 25507 raft_consensus.cc:2243] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.806939 25507 raft_consensus.cc:2272] T fd332d6fac0543c48f4e006472d1c1c6 P deeb07674eaa4feab81bc0ef25e9d011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.847332 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:11:30.881897 25507 master.cc:562] Master@127.24.232.254:43935 shutting down...
I20260709 13:11:30.905016 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.905539 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.905824 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P fc7711766c1346e4b9f7e16caad0ebbc: stopping tablet replica
I20260709 13:11:30.926988 25507 master.cc:584] Master@127.24.232.254:43935 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12593 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:11:30.980367 25507 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.232.254:36391
I20260709 13:11:30.981498 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:30.987710  4969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:30.987718  4968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:30.988582  4971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:30.989331 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:30.990239 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:30.990427 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:30.990622 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602690990591 us; error 0 us; skew 500 ppm
I20260709 13:11:30.991163 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:30.994385 25507 webserver.cc:533] Webserver started at http://127.24.232.254:38143/ using document root <none> and password file <none>
I20260709 13:11:30.995127 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:30.995400 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:30.996456 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:30.998191 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/master-0-root/instance:
uuid: "6dc4f2e25670427187ab53a6648be46d"
format_stamp: "Formatted at 2026-07-09 13:11:30 on dist-test-slave-sdg5"
I20260709 13:11:31.003556 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:11:31.006897  4976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.007753 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:11:31.008064 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/master-0-root
uuid: "6dc4f2e25670427187ab53a6648be46d"
format_stamp: "Formatted at 2026-07-09 13:11:30 on dist-test-slave-sdg5"
I20260709 13:11:31.008354 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:31.037358 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:31.038620 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:31.078012 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.254:36391
I20260709 13:11:31.078132  5027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.254:36391 every 8 connection(s)
I20260709 13:11:31.082054  5028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.093295  5028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: Bootstrap starting.
I20260709 13:11:31.098402  5028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.102943  5028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: No bootstrap required, opened a new log
I20260709 13:11:31.105319  5028 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER }
I20260709 13:11:31.105712  5028 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.105974  5028 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dc4f2e25670427187ab53a6648be46d, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.106639  5028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER }
I20260709 13:11:31.107098  5028 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:31.107322  5028 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:31.107631  5028 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.112983  5028 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER }
I20260709 13:11:31.113554  5028 leader_election.cc:304] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dc4f2e25670427187ab53a6648be46d; no voters: 
I20260709 13:11:31.114723  5028 leader_election.cc:290] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:31.115167  5031 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.116628  5031 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 1 LEADER]: Becoming Leader. State: Replica: 6dc4f2e25670427187ab53a6648be46d, State: Running, Role: LEADER
I20260709 13:11:31.117328  5031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER }
I20260709 13:11:31.117715  5028 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:31.121953  5032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dc4f2e25670427187ab53a6648be46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER } }
I20260709 13:11:31.121973  5033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dc4f2e25670427187ab53a6648be46d. Latest consensus state: current_term: 1 leader_uuid: "6dc4f2e25670427187ab53a6648be46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc4f2e25670427187ab53a6648be46d" member_type: VOTER } }
I20260709 13:11:31.123049  5032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:31.123119  5033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:31.128675  5038 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:31.136509  5038 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:31.137576 25507 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:31.145618  5038 catalog_manager.cc:1383] Generated new cluster ID: 928e568b75bc4c719696cec1afd2c73b
I20260709 13:11:31.145960  5038 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:31.161137  5038 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:31.162483  5038 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:31.182958  5038 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: Generated new TSK 0
I20260709 13:11:31.183589  5038 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:31.204883 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:31.211428  5049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:31.212613  5050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:31.216486  5052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:31.219926 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:31.220932 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:31.221151 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:31.221330 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602691221295 us; error 0 us; skew 500 ppm
I20260709 13:11:31.221895 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:31.224318 25507 webserver.cc:533] Webserver started at http://127.24.232.193:44981/ using document root <none> and password file <none>
I20260709 13:11:31.224794 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:31.224993 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:31.225276 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:31.226352 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-0-root/instance:
uuid: "511db311300b46ff91ae296b93d61e08"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.231160 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:31.234710  5057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.235553 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:31.235940 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-0-root
uuid: "511db311300b46ff91ae296b93d61e08"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.236259 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:31.267627 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:31.268981 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:31.270516 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:31.272830 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:31.273053 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.273305 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:31.273497 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.313370 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.193:40169
I20260709 13:11:31.313484  5119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.193:40169 every 8 connection(s)
I20260709 13:11:31.318588 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:31.325752  5124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:31.330506  5125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:31.332206  5127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:31.332926  5120 heartbeater.cc:344] Connected to a master server at 127.24.232.254:36391
I20260709 13:11:31.333367 25507 server_base.cc:1061] running on GCE node
I20260709 13:11:31.333420  5120 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:31.334466  5120 heartbeater.cc:507] Master 127.24.232.254:36391 requested a full tablet report, sending...
I20260709 13:11:31.334486 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:31.334836 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:31.335006 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602691334991 us; error 0 us; skew 500 ppm
I20260709 13:11:31.335791 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:31.337060  4993 ts_manager.cc:194] Registered new tserver with Master: 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169)
I20260709 13:11:31.338637 25507 webserver.cc:533] Webserver started at http://127.24.232.194:45217/ using document root <none> and password file <none>
I20260709 13:11:31.339359 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:31.339576 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:31.339783  4993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52326
I20260709 13:11:31.339923 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:31.341493 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-1-root/instance:
uuid: "566965e90cf14709ae52abc0bf921424"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.346011 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:31.349329  5132 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.350054 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:31.350379 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-1-root
uuid: "566965e90cf14709ae52abc0bf921424"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.350628 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:31.370412 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:31.371629 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:31.373131 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:31.375443 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:31.375654 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.375941 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:31.376111 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.417754 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.194:38809
I20260709 13:11:31.417869  5194 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.194:38809 every 8 connection(s)
I20260709 13:11:31.422727 25507 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:31.429632  5198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:31.431600  5199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:31.433665 25507 server_base.cc:1061] running on GCE node
W20260709 13:11:31.433779  5201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:31.434311  5195 heartbeater.cc:344] Connected to a master server at 127.24.232.254:36391
I20260709 13:11:31.434805  5195 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:31.434962 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:31.435199 25507 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:31.435339 25507 hybrid_clock.cc:648] HybridClock initialized: now 1783602691435328 us; error 0 us; skew 500 ppm
I20260709 13:11:31.435751  5195 heartbeater.cc:507] Master 127.24.232.254:36391 requested a full tablet report, sending...
I20260709 13:11:31.435926 25507 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:31.438035  4993 ts_manager.cc:194] Registered new tserver with Master: 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:31.438740 25507 webserver.cc:533] Webserver started at http://127.24.232.195:34971/ using document root <none> and password file <none>
I20260709 13:11:31.439301 25507 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:31.439491 25507 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:31.439623  4993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52340
I20260709 13:11:31.439805 25507 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:31.441332 25507 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-2-root/instance:
uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.446074 25507 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:31.449390  5206 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.450208 25507 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:31.450562 25507 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-2-root
uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
format_stamp: "Formatted at 2026-07-09 13:11:31 on dist-test-slave-sdg5"
I20260709 13:11:31.450862 25507 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasktuxs7L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602376029226-25507-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:31.460177 25507 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:31.461395 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:31.462878 25507 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:31.465204 25507 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:31.465395 25507 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.465709 25507 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:31.465876 25507 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:31.505993 25507 rpc_server.cc:307] RPC server started. Bound to: 127.24.232.195:41019
I20260709 13:11:31.506183  5268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.232.195:41019 every 8 connection(s)
I20260709 13:11:31.520188  5269 heartbeater.cc:344] Connected to a master server at 127.24.232.254:36391
I20260709 13:11:31.520663  5269 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:31.521411  5269 heartbeater.cc:507] Master 127.24.232.254:36391 requested a full tablet report, sending...
I20260709 13:11:31.523437  4993 ts_manager.cc:194] Registered new tserver with Master: da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:31.523927 25507 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014658158s
I20260709 13:11:31.524863  4993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52348
I20260709 13:11:31.550097  4993 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52358:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:31.553143  4993 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:31.636765  5160 tablet_service.cc:1511] Processing CreateTablet for tablet 37edbfac9176427092b4997d580c6900 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:31.638315  5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37edbfac9176427092b4997d580c6900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.642376  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 37edbfac9176427092b4997d580c6900 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:31.643043  5082 tablet_service.cc:1511] Processing CreateTablet for tablet eef0aea3ef4344febed7ca613b962cd0 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:31.644533  5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef0aea3ef4344febed7ca613b962cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.645035  5159 tablet_service.cc:1511] Processing CreateTablet for tablet f011340985984ac28ee694cb6aa6ea6a (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:31.645475  5230 tablet_service.cc:1511] Processing CreateTablet for tablet effd2f3b6e8b4e3db29559c50ec602fa (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:31.646487  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f011340985984ac28ee694cb6aa6ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.647372  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37edbfac9176427092b4997d580c6900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.647706  5231 tablet_service.cc:1511] Processing CreateTablet for tablet eef0aea3ef4344febed7ca613b962cd0 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:31.648715  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd2f3b6e8b4e3db29559c50ec602fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.648852  5158 tablet_service.cc:1511] Processing CreateTablet for tablet 200031007bd5431ea5a07360df57cba2 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:31.650306  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200031007bd5431ea5a07360df57cba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.650056  5083 tablet_service.cc:1511] Processing CreateTablet for tablet 200031007bd5431ea5a07360df57cba2 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:31.651482  5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200031007bd5431ea5a07360df57cba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.652935  5157 tablet_service.cc:1511] Processing CreateTablet for tablet eef0aea3ef4344febed7ca613b962cd0 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:31.668560  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef0aea3ef4344febed7ca613b962cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.654181  5084 tablet_service.cc:1511] Processing CreateTablet for tablet f011340985984ac28ee694cb6aa6ea6a (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:31.654803  5156 tablet_service.cc:1511] Processing CreateTablet for tablet effd2f3b6e8b4e3db29559c50ec602fa (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:31.672953  5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f011340985984ac28ee694cb6aa6ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.673091  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd2f3b6e8b4e3db29559c50ec602fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.652947  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 200031007bd5431ea5a07360df57cba2 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:31.655948  5233 tablet_service.cc:1511] Processing CreateTablet for tablet f011340985984ac28ee694cb6aa6ea6a (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:31.657727  5085 tablet_service.cc:1511] Processing CreateTablet for tablet 37edbfac9176427092b4997d580c6900 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:31.676673  5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37edbfac9176427092b4997d580c6900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.664649  5081 tablet_service.cc:1511] Processing CreateTablet for tablet effd2f3b6e8b4e3db29559c50ec602fa (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:31.665723  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef0aea3ef4344febed7ca613b962cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.680948  5081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd2f3b6e8b4e3db29559c50ec602fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.684118  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200031007bd5431ea5a07360df57cba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.685163  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f011340985984ac28ee694cb6aa6ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.711474  5284 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:31.724383  5284 tablet_bootstrap.cc:654] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.741467  5080 tablet_service.cc:1511] Processing CreateTablet for tablet a974f47cf6aa44fca80b8820855303d3 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:31.741578  5158 tablet_service.cc:1511] Processing CreateTablet for tablet a974f47cf6aa44fca80b8820855303d3 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:31.743093  5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a974f47cf6aa44fca80b8820855303d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.743112  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a974f47cf6aa44fca80b8820855303d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.745704  5229 tablet_service.cc:1511] Processing CreateTablet for tablet a974f47cf6aa44fca80b8820855303d3 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:31.747116  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a974f47cf6aa44fca80b8820855303d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.748782  5079 tablet_service.cc:1511] Processing CreateTablet for tablet f1f84a92b37a4609acc81a8b219d45f6 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:31.750130  5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f84a92b37a4609acc81a8b219d45f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.754381  5285 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:31.754065  5157 tablet_service.cc:1511] Processing CreateTablet for tablet f1f84a92b37a4609acc81a8b219d45f6 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:31.755304  5228 tablet_service.cc:1511] Processing CreateTablet for tablet f1f84a92b37a4609acc81a8b219d45f6 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:31.755995  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f84a92b37a4609acc81a8b219d45f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.756657  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f84a92b37a4609acc81a8b219d45f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.784603  5082 tablet_service.cc:1511] Processing CreateTablet for tablet 471ac51a678049b8af829f731acae687 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:31.786037  5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ac51a678049b8af829f731acae687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.785969  5159 tablet_service.cc:1511] Processing CreateTablet for tablet 471ac51a678049b8af829f731acae687 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:31.787479  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ac51a678049b8af829f731acae687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.790393  5285 tablet_bootstrap.cc:654] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.791312  5083 tablet_service.cc:1511] Processing CreateTablet for tablet aa7be7e8c0d84af381b633f3b13295a7 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:31.792629  5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7be7e8c0d84af381b633f3b13295a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.794813  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 471ac51a678049b8af829f731acae687 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:31.796169  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471ac51a678049b8af829f731acae687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.813446  5284 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:31.814038  5284 ts_tablet_manager.cc:1403] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.016s
I20260709 13:11:31.817191  5284 raft_consensus.cc:359] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:31.818514  5284 raft_consensus.cc:385] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.819645  5284 raft_consensus.cc:740] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.825488  5287 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:31.828281  5156 tablet_service.cc:1511] Processing CreateTablet for tablet aa7be7e8c0d84af381b633f3b13295a7 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:31.829797  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7be7e8c0d84af381b633f3b13295a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.839514  5287 tablet_bootstrap.cc:654] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.833362  5284 consensus_queue.cc:260] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:31.851516  5285 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:31.852749  5285 ts_tablet_manager.cc:1403] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.023s
I20260709 13:11:31.854009  5284 ts_tablet_manager.cc:1434] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.006s
I20260709 13:11:31.854200  5195 heartbeater.cc:499] Master 127.24.232.254:36391 was elected leader, sending a full tablet report...
I20260709 13:11:31.855116  5284 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:31.856621  5285 raft_consensus.cc:359] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.857472  5285 raft_consensus.cc:385] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.857817  5285 raft_consensus.cc:740] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.858630  5285 consensus_queue.cc:260] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.854243  5230 tablet_service.cc:1511] Processing CreateTablet for tablet aa7be7e8c0d84af381b633f3b13295a7 (DEFAULT_TABLE table=test-workload [id=c009932d18c94ebeac375b373bdbd8e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:31.867157  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7be7e8c0d84af381b633f3b13295a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.882337  5285 ts_tablet_manager.cc:1434] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 13:11:31.883179  5120 heartbeater.cc:499] Master 127.24.232.254:36391 was elected leader, sending a full tablet report...
I20260709 13:11:31.883503  5285 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:31.888764  5287 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:31.889353  5287 ts_tablet_manager.cc:1403] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.004s
I20260709 13:11:31.889462  5285 tablet_bootstrap.cc:654] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.892531  5287 raft_consensus.cc:359] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.893294  5287 raft_consensus.cc:385] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.893589  5287 raft_consensus.cc:740] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.897500  5284 tablet_bootstrap.cc:654] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.901417  5285 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:31.902079  5285 ts_tablet_manager.cc:1403] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.013s
I20260709 13:11:31.901563  5287 consensus_queue.cc:260] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.905174  5285 raft_consensus.cc:359] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.905910  5285 raft_consensus.cc:385] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.906177  5285 raft_consensus.cc:740] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.907006  5285 consensus_queue.cc:260] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.909426  5285 ts_tablet_manager.cc:1434] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:11:31.910480  5285 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:31.911384  5269 heartbeater.cc:499] Master 127.24.232.254:36391 was elected leader, sending a full tablet report...
I20260709 13:11:31.912086  5284 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:31.912662  5284 ts_tablet_manager.cc:1403] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.007s
I20260709 13:11:31.915822  5284 raft_consensus.cc:359] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.916574  5284 raft_consensus.cc:385] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.916862  5284 raft_consensus.cc:740] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.917281  5285 tablet_bootstrap.cc:654] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.917284  5287 ts_tablet_manager.cc:1434] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.008s
I20260709 13:11:31.917610  5284 consensus_queue.cc:260] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.918596  5287 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:31.919971  5284 ts_tablet_manager.cc:1434] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:11:31.921114  5284 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:31.930263  5284 tablet_bootstrap.cc:654] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.931802  5287 tablet_bootstrap.cc:654] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.943476  5287 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:31.944123  5287 ts_tablet_manager.cc:1403] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.002s
I20260709 13:11:31.943490  5284 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:31.945503  5284 ts_tablet_manager.cc:1403] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:11:31.947276  5287 raft_consensus.cc:359] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.947654  5284 raft_consensus.cc:359] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.948575  5284 raft_consensus.cc:385] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.948213  5287 raft_consensus.cc:385] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.948958  5284 raft_consensus.cc:740] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.949074  5287 raft_consensus.cc:740] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.950201  5285 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:31.949973  5284 consensus_queue.cc:260] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.950873  5285 ts_tablet_manager.cc:1403] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.028s
I20260709 13:11:31.950215  5287 consensus_queue.cc:260] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.952296  5284 ts_tablet_manager.cc:1434] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:31.953253  5287 ts_tablet_manager.cc:1434] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:11:31.953500  5284 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:31.954316  5287 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:31.954284  5285 raft_consensus.cc:359] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.955214  5285 raft_consensus.cc:385] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.955528  5285 raft_consensus.cc:740] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.956431  5285 consensus_queue.cc:260] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.958878  5285 ts_tablet_manager.cc:1434] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:11:31.959928  5285 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:31.961036  5284 tablet_bootstrap.cc:654] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.967381  5287 tablet_bootstrap.cc:654] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.967548  5285 tablet_bootstrap.cc:654] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.980420  5285 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:31.980981  5285 ts_tablet_manager.cc:1403] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:11:31.981031  5284 tablet_bootstrap.cc:492] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:31.981191  5287 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:31.981604  5284 ts_tablet_manager.cc:1403] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.005s
I20260709 13:11:31.981837  5287 ts_tablet_manager.cc:1403] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 13:11:31.984418  5285 raft_consensus.cc:359] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.984691  5284 raft_consensus.cc:359] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.985303  5285 raft_consensus.cc:385] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.985450  5284 raft_consensus.cc:385] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.985132  5287 raft_consensus.cc:359] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:31.985951  5285 raft_consensus.cc:740] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.986002  5284 raft_consensus.cc:740] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.986307  5287 raft_consensus.cc:385] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.986773  5287 raft_consensus.cc:740] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.987028  5285 consensus_queue.cc:260] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.987241  5284 consensus_queue.cc:260] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.987635  5287 consensus_queue.cc:260] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:31.989658  5285 ts_tablet_manager.cc:1434] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:11:31.989951  5287 ts_tablet_manager.cc:1434] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:31.990751  5285 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:31.991076  5287 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:31.995157  5289 raft_consensus.cc:493] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.995743  5289 raft_consensus.cc:515] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:31.997804  5287 tablet_bootstrap.cc:654] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.997939  5285 tablet_bootstrap.cc:654] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.000782  5289 leader_election.cc:290] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.005334  5284 ts_tablet_manager.cc:1434] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:11:32.009274  5289 raft_consensus.cc:493] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.009895  5289 raft_consensus.cc:515] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.012660  5289 leader_election.cc:290] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.013756  5284 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:32.015712  5285 tablet_bootstrap.cc:492] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:32.016279  5285 ts_tablet_manager.cc:1403] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 13:11:32.019594  5285 raft_consensus.cc:359] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.020382  5285 raft_consensus.cc:385] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.020680  5285 raft_consensus.cc:740] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.021677  5284 tablet_bootstrap.cc:654] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.021418  5285 consensus_queue.cc:260] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.028632  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.029654  5095 raft_consensus.cc:2468] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.031102  5285 ts_tablet_manager.cc:1434] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:32.031350  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.032240  5094 raft_consensus.cc:2468] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.032320  5133 leader_election.cc:304] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.033260  5289 raft_consensus.cc:2804] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.033607  5289 raft_consensus.cc:493] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.033726  5133 leader_election.cc:304] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.034034  5289 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.034514  5284 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:32.035157  5284 ts_tablet_manager.cc:1403] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:11:32.033622  5285 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:32.039764  5284 raft_consensus.cc:359] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.040827  5284 raft_consensus.cc:385] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.041149  5284 raft_consensus.cc:740] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.044529  5289 raft_consensus.cc:515] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.047645  5289 leader_election.cc:290] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.048029  5284 consensus_queue.cc:260] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.048236  5285 tablet_bootstrap.cc:654] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.050585  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.049309  5306 raft_consensus.cc:2804] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.051242  5094 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.053537  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.053859  5306 raft_consensus.cc:493] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.054287  5306 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.055188  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.056597  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.058625  5294 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.051358  5284 ts_tablet_manager.cc:1434] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
W20260709 13:11:32.060211  5136 leader_election.cc:343] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:32.061302  5136 leader_election.cc:343] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.061646  5094 raft_consensus.cc:2468] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.062096  5285 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
W20260709 13:11:32.062165  5136 leader_election.cc:343] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.062618  5285 ts_tablet_manager.cc:1403] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.003s
I20260709 13:11:32.059130  5294 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.062656  5306 raft_consensus.cc:515] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.063341  5133 leader_election.cc:304] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.064328  5289 raft_consensus.cc:2804] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.065138  5306 leader_election.cc:290] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.065316  5294 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169)
I20260709 13:11:32.066004  5285 raft_consensus.cc:359] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.066799  5285 raft_consensus.cc:385] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.067075  5285 raft_consensus.cc:740] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.067888  5285 consensus_queue.cc:260] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.069983  5285 ts_tablet_manager.cc:1434] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:32.053570  5287 tablet_bootstrap.cc:492] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.071600  5287 ts_tablet_manager.cc:1403] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.022s
I20260709 13:11:32.071823  5284 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:32.074070  5294 raft_consensus.cc:493] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.074677  5294 raft_consensus.cc:515] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.077111  5294 leader_election.cc:290] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:32.078145  5306 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.078755  5306 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.079702  5287 raft_consensus.cc:359] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.080499  5287 raft_consensus.cc:385] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.080798  5287 raft_consensus.cc:740] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.080894  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.081051  5284 tablet_bootstrap.cc:654] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.081635  5287 consensus_queue.cc:260] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.082231  5289 raft_consensus.cc:697] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
W20260709 13:11:32.082365  5136 leader_election.cc:343] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.083292  5289 consensus_queue.cc:237] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.084641  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.085337  5242 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.087920  5136 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:32.088872  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.089881  5094 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.089974  5285 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:32.089568  5290 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.091802  5306 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019), 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169)
I20260709 13:11:32.091600  5290 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.098914  5285 tablet_bootstrap.cc:654] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.100137  5290 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.090090  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.101336  5095 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.089643  5308 raft_consensus.cc:2804] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.107563  5308 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.107956  5308 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.114813  5290 raft_consensus.cc:493] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.115417  5290 raft_consensus.cc:515] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.118538  5285 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:32.119293  5285 ts_tablet_manager.cc:1403] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.005s
I20260709 13:11:32.122830  5290 leader_election.cc:290] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.123633  5290 raft_consensus.cc:493] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.123319  5285 raft_consensus.cc:359] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.124402  5285 raft_consensus.cc:385] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.124315  5290 raft_consensus.cc:515] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.124918  5285 raft_consensus.cc:740] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.125979  5285 consensus_queue.cc:260] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.127151  5290 leader_election.cc:290] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
W20260709 13:11:32.129784  5041 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:32.131439  5285 ts_tablet_manager.cc:1434] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:32.152045  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.152827  5095 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:32.153044  5285 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:32.154608  5207 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:32.138665  5287 ts_tablet_manager.cc:1434] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:11:32.155591  5294 raft_consensus.cc:2804] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.145864  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.146852  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.156769  5287 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:32.157370  5294 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:32.159884  5210 leader_election.cc:343] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.161785  5294 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.162822  5306 raft_consensus.cc:493] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.163447  5306 raft_consensus.cc:515] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.143512  5094 raft_consensus.cc:2468] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.172041  5133 leader_election.cc:304] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.173774  5306 leader_election.cc:290] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.175076  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a974f47cf6aa44fca80b8820855303d3" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.175406  5289 raft_consensus.cc:2804] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.176307  5289 raft_consensus.cc:697] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:32.177114  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a974f47cf6aa44fca80b8820855303d3" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.177280  5289 consensus_queue.cc:237] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.177914  5094 raft_consensus.cc:2468] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.179214  5133 leader_election.cc:304] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.180223  5306 raft_consensus.cc:2804] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.180662  5306 raft_consensus.cc:493] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.181087  5306 raft_consensus.cc:3060] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:32.180883  5136 leader_election.cc:343] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.183307  5285 tablet_bootstrap.cc:654] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.184083  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.185925  5095 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:32.189035  5207 leader_election.cc:304] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.192219  5306 raft_consensus.cc:515] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.194763  5284 tablet_bootstrap.cc:492] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:32.195883  5284 ts_tablet_manager.cc:1403] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.124s	user 0.035s	sys 0.043s
I20260709 13:11:32.190742  5308 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.196847  5170 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.197952  5308 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019), 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169)
I20260709 13:11:32.195914  5287 tablet_bootstrap.cc:654] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:32.215981  5060 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.24.232.254:36391, user_credentials={real_user=slave}} blocked reactor thread for 52085.7us
I20260709 13:11:32.216501  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.217340  5095 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.218663  5284 raft_consensus.cc:359] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.227138  5306 leader_election.cc:290] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.227501  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a974f47cf6aa44fca80b8820855303d3" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.225248  5294 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.228032  5284 raft_consensus.cc:385] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.228627  5094 raft_consensus.cc:3060] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.232645  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.235349  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.236166  5243 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:32.238688  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.239387  5243 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:32.239840  5284 raft_consensus.cc:740] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.241904  5061 leader_election.cc:304] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:32.241180  5284 consensus_queue.cc:260] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.246935  5284 ts_tablet_manager.cc:1434] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 13:11:32.249049  5290 raft_consensus.cc:493] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.249795  5290 raft_consensus.cc:515] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.250571  5284 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:32.254925  5290 leader_election.cc:290] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.260874  5242 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 511db311300b46ff91ae296b93d61e08 in current term 1: Already voted for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in this term.
I20260709 13:11:32.262889  5319 raft_consensus.cc:2804] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.263193  5061 leader_election.cc:304] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:32.263550  5319 raft_consensus.cc:493] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.264122  5319 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.264353  5316 raft_consensus.cc:2804] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.264868  5316 raft_consensus.cc:493] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.265255  5316 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.267606  5290 raft_consensus.cc:2804] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.268085  5290 raft_consensus.cc:493] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.268455  5290 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.272675  5094 raft_consensus.cc:2468] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.272485  4992 catalog_manager.cc:5697] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.274039  5133 leader_election.cc:304] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.274950  5306 raft_consensus.cc:2804] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.275441  5306 raft_consensus.cc:697] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:32.276320  5306 consensus_queue.cc:237] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.277279  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.274260  5316 raft_consensus.cc:515] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.288066  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.289005  5170 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.289388  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.290206  5169 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 511db311300b46ff91ae296b93d61e08 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.292569  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.293371  5168 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:32.292572  5294 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169)
I20260709 13:11:32.294123  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.294798  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.295490  5169 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
W20260709 13:11:32.294814  5061 leader_election.cc:343] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.296977  5285 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:32.297909  5285 ts_tablet_manager.cc:1403] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.145s	user 0.035s	sys 0.028s
W20260709 13:11:32.262313  5207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.193:40169, user_credentials={real_user=slave}} blocked reactor thread for 73449.4us
I20260709 13:11:32.280678  5095 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.301100  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.301410  5316 leader_election.cc:290] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.301302  5285 raft_consensus.cc:359] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.301920  5242 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 566965e90cf14709ae52abc0bf921424 in current term 1: Already voted for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in this term.
I20260709 13:11:32.302111  5285 raft_consensus.cc:385] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.302455  5285 raft_consensus.cc:740] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.303275  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a974f47cf6aa44fca80b8820855303d3" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.303109  5285 consensus_queue.cc:260] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.293596  5319 raft_consensus.cc:515] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.304385  5133 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
W20260709 13:11:32.305377  5136 leader_election.cc:343] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.305696  5285 ts_tablet_manager.cc:1434] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:32.306938  5306 raft_consensus.cc:2804] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.307520  5306 raft_consensus.cc:697] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:32.307994  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.308748  5319 leader_election.cc:290] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:32.308422  5306 consensus_queue.cc:237] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:32.309434  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.308247  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.310266  5094 raft_consensus.cc:2393] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.311285  5170 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.315376  5285 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:32.312135  5095 raft_consensus.cc:2393] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 511db311300b46ff91ae296b93d61e08 in this term.
I20260709 13:11:32.317900  5284 tablet_bootstrap.cc:654] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.320312  5287 tablet_bootstrap.cc:492] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.320524  5207 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.320930  5287 ts_tablet_manager.cc:1403] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.164s	user 0.028s	sys 0.020s
I20260709 13:11:32.303309  5290 raft_consensus.cc:515] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.324345  5319 raft_consensus.cc:2749] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.325536  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.326574  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.328984  5170 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:32.339601  5285 tablet_bootstrap.cc:654] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.327057  5287 raft_consensus.cc:359] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.343034  5287 raft_consensus.cc:385] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.343466  5287 raft_consensus.cc:740] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.340622  5210 leader_election.cc:304] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 511db311300b46ff91ae296b93d61e08
I20260709 13:11:32.345258  5287 consensus_queue.cc:260] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.345927  5284 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:32.346840  5284 ts_tablet_manager.cc:1403] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.006s
I20260709 13:11:32.347940  5287 ts_tablet_manager.cc:1434] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 13:11:32.349046  5287 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:32.329639  5290 leader_election.cc:290] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.351485  5284 raft_consensus.cc:359] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.352626  5284 raft_consensus.cc:385] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.353190  5284 raft_consensus.cc:740] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.354192  5284 consensus_queue.cc:260] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.357721  5287 tablet_bootstrap.cc:654] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.358076  5284 ts_tablet_manager.cc:1434] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:11:32.359618  5284 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:32.368427  5284 tablet_bootstrap.cc:654] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.326582  5061 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 511db311300b46ff91ae296b93d61e08; no voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.374101  5290 raft_consensus.cc:2749] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:32.374269  5061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.232.194:38809, user_credentials={real_user=slave}} blocked reactor thread for 47794.1us
I20260709 13:11:32.327579  5242 raft_consensus.cc:2393] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 511db311300b46ff91ae296b93d61e08 in current term 1: Already voted for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in this term.
I20260709 13:11:32.381955  5284 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:32.382536  5284 ts_tablet_manager.cc:1403] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
W20260709 13:11:32.382848  5061 leader_election.cc:343] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.383641  5061 leader_election.cc:304] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 511db311300b46ff91ae296b93d61e08; no voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.383864  5319 raft_consensus.cc:2804] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.384680  5290 raft_consensus.cc:2749] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.384662  5319 raft_consensus.cc:697] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:32.385426  5284 raft_consensus.cc:359] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.386114  5284 raft_consensus.cc:385] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.386384  5284 raft_consensus.cc:740] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.386366  5319 consensus_queue.cc:237] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.387933  5284 consensus_queue.cc:260] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.390723  5284 ts_tablet_manager.cc:1434] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:32.392145  5284 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:32.400992  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.399971  4990 catalog_manager.cc:5697] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.401980  5170 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.406643  5284 tablet_bootstrap.cc:654] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.411000  5306 raft_consensus.cc:493] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.411760  5306 raft_consensus.cc:515] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.415726  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.418992  5284 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:32.419129  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
W20260709 13:11:32.419204  5133 leader_election.cc:343] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.419585  5284 ts_tablet_manager.cc:1403] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.009s
I20260709 13:11:32.420315  5306 leader_election.cc:290] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
W20260709 13:11:32.420547  5136 leader_election.cc:343] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.421032  5136 leader_election.cc:304] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 566965e90cf14709ae52abc0bf921424; no voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.421849  5306 raft_consensus.cc:2749] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.423983  5284 raft_consensus.cc:359] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.424966  5284 raft_consensus.cc:385] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.425288  5284 raft_consensus.cc:740] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.426614  5284 consensus_queue.cc:260] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.429395  5284 ts_tablet_manager.cc:1434] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:32.425184  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.431648  5242 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.436350  5290 raft_consensus.cc:493] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.436662  5061 leader_election.cc:304] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 511db311300b46ff91ae296b93d61e08; no voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.437124  5290 raft_consensus.cc:515] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.437860  5316 raft_consensus.cc:2749] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.438796  5170 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.440841  5061 leader_election.cc:304] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.441629  5290 leader_election.cc:290] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.443722  5316 raft_consensus.cc:2804] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.446892  5285 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:32.447419  5285 ts_tablet_manager.cc:1403] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.000s
I20260709 13:11:32.448062  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.449362  5170 raft_consensus.cc:2468] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:32.450076  5316 raft_consensus.cc:697] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:32.448697  5242 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.450736  5285 raft_consensus.cc:359] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.451510  5285 raft_consensus.cc:385] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.452056  5285 raft_consensus.cc:740] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.451408  5316 consensus_queue.cc:237] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.452764  5285 consensus_queue.cc:260] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.454419  5285 ts_tablet_manager.cc:1434] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:32.456988  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.457942  5287 tablet_bootstrap.cc:492] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.458684  5287 ts_tablet_manager.cc:1403] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.110s	user 0.034s	sys 0.045s
W20260709 13:11:32.459350  5061 leader_election.cc:343] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.460291  5061 leader_election.cc:304] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.461280  5333 raft_consensus.cc:2804] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.461709  5333 raft_consensus.cc:493] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.462087  5333 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.462584  5287 raft_consensus.cc:359] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.466285  5287 raft_consensus.cc:385] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.466725  5287 raft_consensus.cc:740] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.469347  5287 consensus_queue.cc:260] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.471221  5333 raft_consensus.cc:515] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.472848  5287 ts_tablet_manager.cc:1434] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:11:32.474370  5287 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:32.475301  5319 raft_consensus.cc:493] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.476081  5319 raft_consensus.cc:515] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.478214  5294 raft_consensus.cc:493] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.478943  5294 raft_consensus.cc:515] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.479431  5333 leader_election.cc:290] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.475412  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.481875  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.482436  5242 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.482775  5294 leader_election.cc:290] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:32.482331  5319 leader_election.cc:290] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:32.485397  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.483350  5170 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.488101  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.489717  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.490209  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.490743  5287 tablet_bootstrap.cc:654] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.494001  4993 catalog_manager.cc:5697] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.495522  5094 raft_consensus.cc:2393] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.495805  5095 raft_consensus.cc:2393] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:32.497078  5207 leader_election.cc:304] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.497040  4993 catalog_manager.cc:5697] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.498440  5207 leader_election.cc:304] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.498673  5242 raft_consensus.cc:2468] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.499287  5170 raft_consensus.cc:2468] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.499578  5319 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.498862  4993 catalog_manager.cc:5697] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.499969  5061 leader_election.cc:304] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:32.501164  5316 raft_consensus.cc:2804] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.501641  5316 raft_consensus.cc:697] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:32.502477  5316 consensus_queue.cc:237] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.507859  5294 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.511917  5319 raft_consensus.cc:2749] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.517247  5287 tablet_bootstrap.cc:492] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.517882  5287 ts_tablet_manager.cc:1403] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.013s
I20260709 13:11:32.520329  5294 raft_consensus.cc:2749] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.520991  5287 raft_consensus.cc:359] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.521813  5287 raft_consensus.cc:385] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.522121  5287 raft_consensus.cc:740] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.522529  5316 raft_consensus.cc:493] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.522943  5287 consensus_queue.cc:260] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.523285  5316 raft_consensus.cc:515] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.523310  4992 catalog_manager.cc:5697] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.526090  5287 ts_tablet_manager.cc:1434] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:11:32.527109  5287 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:32.528084  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:32.528810  5170 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:32.530129  5061 leader_election.cc:304] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.531143  5333 raft_consensus.cc:2804] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.531550  5333 raft_consensus.cc:493] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.531972  5333 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.536774  5287 tablet_bootstrap.cc:654] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.539809  5333 raft_consensus.cc:515] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.541585  5287 tablet_bootstrap.cc:492] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.542210  5306 raft_consensus.cc:493] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.542768  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:32.542706  5306 raft_consensus.cc:515] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.543416  5170 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.544114  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.544942  5306 leader_election.cc:290] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
W20260709 13:11:32.545373  5061 leader_election.cc:343] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.546110  5316 leader_election.cc:290] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.546866  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:32.547557  5095 raft_consensus.cc:2468] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:32.547902  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:32.547544  4992 catalog_manager.cc:5697] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.547044  5287 ts_tablet_manager.cc:1403] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:11:32.549130  5133 leader_election.cc:304] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
W20260709 13:11:32.550463  5136 leader_election.cc:343] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.551748  5170 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.552371  5306 raft_consensus.cc:2804] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.552780  5306 raft_consensus.cc:493] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.551827  5287 raft_consensus.cc:359] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.552942  5061 leader_election.cc:304] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.553126  5306 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.553318  5287 raft_consensus.cc:385] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.553835  5287 raft_consensus.cc:740] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.554629  5287 consensus_queue.cc:260] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.555250  5316 raft_consensus.cc:2804] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.556311  5316 raft_consensus.cc:697] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:32.557132  5316 consensus_queue.cc:237] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.559973  5287 ts_tablet_manager.cc:1434] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:32.561187  5287 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:32.561249  5306 raft_consensus.cc:515] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.564327  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.565088  5095 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.567782  5287 tablet_bootstrap.cc:654] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.564330  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.568485  5242 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.573834  4990 catalog_manager.cc:5697] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.580407  5287 tablet_bootstrap.cc:492] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:32.580978  5287 ts_tablet_manager.cc:1403] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.017s
I20260709 13:11:32.581391  5095 raft_consensus.cc:2468] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.582717  5133 leader_election.cc:304] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.583751  5289 raft_consensus.cc:2804] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.583775  5287 raft_consensus.cc:359] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.584321  5289 raft_consensus.cc:697] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:32.584596  5287 raft_consensus.cc:385] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.584367  5306 leader_election.cc:290] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.585016  5287 raft_consensus.cc:740] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.585546  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.585300  5289 consensus_queue.cc:237] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.585929  5287 consensus_queue.cc:260] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.586846  5243 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.588157  5287 ts_tablet_manager.cc:1434] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:32.564409  5333 leader_election.cc:290] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.592947  5242 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:32.594718  4990 catalog_manager.cc:5697] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.596486  5243 raft_consensus.cc:2468] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:32.612150  5289 consensus_queue.cc:1048] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.623533  5306 consensus_queue.cc:1048] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.689416  5306 consensus_queue.cc:1048] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.694805  5306 consensus_queue.cc:1048] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.702663  5306 consensus_queue.cc:1048] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.714895  5289 consensus_queue.cc:1048] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.727859  5289 consensus_queue.cc:1048] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.738361  5243 raft_consensus.cc:3060] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.749538  5306 consensus_queue.cc:1048] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.761938  5170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37edbfac9176427092b4997d580c6900"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:45264
I20260709 13:11:32.762487  5170 raft_consensus.cc:606] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:32.768190  5170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:45264
I20260709 13:11:32.768702  5170 raft_consensus.cc:606] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:32.773612  5170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "200031007bd5431ea5a07360df57cba2"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:45264
I20260709 13:11:32.774139  5170 raft_consensus.cc:606] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:32.778023  5294 consensus_queue.cc:1048] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.791842  5294 consensus_queue.cc:1048] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.797158  5243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
mode: GRACEFUL
new_leader_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:11:32.797803  5243 raft_consensus.cc:606] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Received request to transfer leadership to TS 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.804272  5357 raft_consensus.cc:993] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: : Instructing follower 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:32.804800  5294 raft_consensus.cc:1081] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Signalling peer 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:32.807621  5170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:45246
I20260709 13:11:32.808246  5170 raft_consensus.cc:493] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.808604  5170 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.815704  5170 raft_consensus.cc:515] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.818897  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:32.819095  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd2f3b6e8b4e3db29559c50ec602fa" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:32.819568  5095 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.819875  5243 raft_consensus.cc:3055] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.820283  5243 raft_consensus.cc:740] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:32.821038  5243 consensus_queue.cc:260] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.821969  5243 raft_consensus.cc:3060] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.825517  5170 leader_election.cc:290] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:32.826043  5095 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:32.826859  5094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
mode: GRACEFUL
new_leader_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:43190
I20260709 13:11:32.827541  5094 raft_consensus.cc:606] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Received request to transfer leadership to TS 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.827715  5243 raft_consensus.cc:2468] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:32.827970  5133 leader_election.cc:304] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:32.829044  5306 raft_consensus.cc:2804] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.829476  5306 raft_consensus.cc:697] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:32.830296  5306 consensus_queue.cc:237] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:32.836347  5094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "471ac51a678049b8af829f731acae687"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
mode: GRACEFUL
new_leader_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:43190
I20260709 13:11:32.836875  5094 raft_consensus.cc:606] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Received request to transfer leadership to TS 566965e90cf14709ae52abc0bf921424
I20260709 13:11:32.837344  4992 catalog_manager.cc:5697] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 1 to 2, leader changed from da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195) to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.842486  5170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:45264
I20260709 13:11:32.843125  5170 raft_consensus.cc:606] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Received request to transfer leadership to TS da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:32.877915  5333 consensus_queue.cc:1048] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.889137  5316 consensus_queue.cc:1048] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.982183  5316 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.993817  5363 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.001371  5316 raft_consensus.cc:993] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: : Instructing follower 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:33.001873  5363 raft_consensus.cc:1081] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Signalling peer 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:33.003448  5170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:45252
I20260709 13:11:33.004060  5170 raft_consensus.cc:493] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.004451  5170 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.009867  5170 raft_consensus.cc:515] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.011674  5170 leader_election.cc:290] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:33.012694  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:33.012892  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:33.013510  5094 raft_consensus.cc:3055] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.013605  5243 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.013926  5094 raft_consensus.cc:740] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:33.014851  5094 consensus_queue.cc:260] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.015913  5094 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.020637  5243 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:33.021844  5136 leader_election.cc:304] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:33.021906  5094 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:33.022753  5306 raft_consensus.cc:2804] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.023229  5306 raft_consensus.cc:697] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.024063  5306 consensus_queue.cc:237] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.031184  4990 catalog_manager.cc:5697] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 1 to 2, leader changed from 511db311300b46ff91ae296b93d61e08 (127.24.232.193) to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.054572  5363 consensus_queue.cc:1048] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.061416  5316 raft_consensus.cc:993] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: : Instructing follower 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:33.061985  5333 raft_consensus.cc:1081] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Signalling peer 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:33.066284  5170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "471ac51a678049b8af829f731acae687"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:45252
I20260709 13:11:33.066918  5170 raft_consensus.cc:493] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.067344  5170 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.069429  5333 consensus_queue.cc:1048] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.081593  5170 raft_consensus.cc:515] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.084575  5094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:33.085153  5094 raft_consensus.cc:3055] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.085500  5094 raft_consensus.cc:740] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:33.086424  5170 leader_election.cc:290] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:33.086266  5094 consensus_queue.cc:260] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.087174  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471ac51a678049b8af829f731acae687" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:33.087488  5094 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.087985  5243 raft_consensus.cc:3060] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.095265  5094 raft_consensus.cc:2468] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:33.095265  5243 raft_consensus.cc:2468] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:33.097019  5133 leader_election.cc:304] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:33.098109  5306 raft_consensus.cc:2804] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.098629  5306 raft_consensus.cc:697] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.099476  5306 consensus_queue.cc:237] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.106261  5306 consensus_queue.cc:1048] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.106954  4992 catalog_manager.cc:5697] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 1 to 2, leader changed from 511db311300b46ff91ae296b93d61e08 (127.24.232.193) to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.119831  5306 consensus_queue.cc:1048] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.138597  5308 raft_consensus.cc:993] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: : Instructing follower da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
I20260709 13:11:33.139179  5308 raft_consensus.cc:1081] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Signalling peer da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
I20260709 13:11:33.141158  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:50824
I20260709 13:11:33.141763  5242 raft_consensus.cc:493] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.142165  5242 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.154054  5289 raft_consensus.cc:993] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.154640  5289 raft_consensus.cc:1081] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.155023  5242 raft_consensus.cc:515] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.158401  5094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:11:33.159149  5094 raft_consensus.cc:493] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.159543  5094 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.159335  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:33.160162  5095 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.165057  5370 raft_consensus.cc:993] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.165674  5370 raft_consensus.cc:1081] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.167752  5242 leader_election.cc:290] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:33.167594  5093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "200031007bd5431ea5a07360df57cba2"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:11:33.169072  5093 raft_consensus.cc:493] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.169492  5093 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.170499  5095 raft_consensus.cc:2468] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 2.
I20260709 13:11:33.172093  5207 leader_election.cc:304] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:33.173049  5294 raft_consensus.cc:2804] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.173563  5294 raft_consensus.cc:697] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:33.174391  5294 consensus_queue.cc:237] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.167519  5094 raft_consensus.cc:515] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.169409  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7be7e8c0d84af381b633f3b13295a7" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:33.178013  5170 raft_consensus.cc:3055] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.178359  5170 raft_consensus.cc:740] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.179199  5170 consensus_queue.cc:260] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.180543  5170 raft_consensus.cc:3060] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.180684  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:33.181392  5169 raft_consensus.cc:3055] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.181689  5169 raft_consensus.cc:740] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.182529  5169 consensus_queue.cc:260] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.182940  4990 catalog_manager.cc:5697] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 1 to 2, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.183965  5169 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.184432  5094 leader_election.cc:290] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:33.186931  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f011340985984ac28ee694cb6aa6ea6a" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:33.187642  5242 raft_consensus.cc:3060] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.192371  5370 raft_consensus.cc:993] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.192962  5370 raft_consensus.cc:1081] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:33.195021  5095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37edbfac9176427092b4997d580c6900"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:11:33.195695  5095 raft_consensus.cc:493] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.196091  5095 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.202992  5170 raft_consensus.cc:2468] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 2.
I20260709 13:11:33.182509  5093 raft_consensus.cc:515] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.206595  5242 raft_consensus.cc:2468] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.207077  5169 raft_consensus.cc:2468] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.207962  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:33.207998  5061 leader_election.cc:304] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:33.208768  5093 leader_election.cc:290] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:33.208768  5170 raft_consensus.cc:3055] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.209447  5170 raft_consensus.cc:740] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.210083  5363 raft_consensus.cc:2804] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.210651  5363 raft_consensus.cc:697] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:33.210469  5170 consensus_queue.cc:260] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.211277  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200031007bd5431ea5a07360df57cba2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:33.211360  5095 raft_consensus.cc:515] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:33.211898  5170 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.211611  5363 consensus_queue.cc:237] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.212040  5242 raft_consensus.cc:3060] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.213897  5095 leader_election.cc:290] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:33.216607  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:33.217249  5243 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.218139  5244 raft_consensus.cc:1275] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.219995  5170 raft_consensus.cc:2468] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.223097  5242 raft_consensus.cc:2468] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.223160  5061 leader_election.cc:304] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:33.224149  5363 raft_consensus.cc:2804] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.224560  5363 raft_consensus.cc:697] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:33.224630  5371 consensus_queue.cc:1048] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.225459  5363 consensus_queue.cc:237] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:33.226432  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37edbfac9176427092b4997d580c6900" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:33.227104  5169 raft_consensus.cc:3055] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.227430  5169 raft_consensus.cc:740] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:33.228377  5169 consensus_queue.cc:260] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:33.229537  5169 raft_consensus.cc:3060] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.229465  4992 catalog_manager.cc:5697] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.235162  5243 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.235997  5244 raft_consensus.cc:1240] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Rejecting Update request from peer 566965e90cf14709ae52abc0bf921424 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:33.240090  5169 raft_consensus.cc:2468] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:33.242901  5095 raft_consensus.cc:1275] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.243389  5061 leader_election.cc:304] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:33.244310  5371 consensus_queue.cc:1048] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.244735  5316 raft_consensus.cc:2804] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.245311  5316 raft_consensus.cc:697] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:33.246171  5316 consensus_queue.cc:237] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } }
I20260709 13:11:33.258881  4990 catalog_manager.cc:5697] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.260076  4990 catalog_manager.cc:5697] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.474006  5095 raft_consensus.cc:1275] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.475405  5371 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.483351  5243 raft_consensus.cc:1275] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.484932  5369 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.520738  5095 raft_consensus.cc:1275] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.521950  5369 consensus_queue.cc:1048] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.529583  5243 raft_consensus.cc:1275] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.531149  5371 consensus_queue.cc:1048] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.565871  5095 raft_consensus.cc:1275] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.567164  5294 consensus_queue.cc:1048] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.575397  5169 raft_consensus.cc:1275] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.577071  5372 consensus_queue.cc:1048] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.609570  5243 raft_consensus.cc:1275] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.610924  5316 consensus_queue.cc:1048] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.618675  5169 raft_consensus.cc:1275] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.620508  5333 consensus_queue.cc:1048] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.687969  5244 raft_consensus.cc:1275] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.689317  5333 consensus_queue.cc:1048] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.697641  5169 raft_consensus.cc:1275] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.701206  5316 consensus_queue.cc:1048] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.787828  5169 raft_consensus.cc:1275] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.789180  5316 consensus_queue.cc:1048] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.798194  5244 raft_consensus.cc:1275] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.799839  5333 consensus_queue.cc:1048] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:35.878391  4990 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52374:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:35.880585  4990 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:35.927457  5080 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5992c99a0542dfbaf5759f09c43d01 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:35.928841  5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5992c99a0542dfbaf5759f09c43d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.928654  5156 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5992c99a0542dfbaf5759f09c43d01 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:35.929929  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5992c99a0542dfbaf5759f09c43d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.934042  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5992c99a0542dfbaf5759f09c43d01 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:35.935432  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5992c99a0542dfbaf5759f09c43d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.936847  5157 tablet_service.cc:1511] Processing CreateTablet for tablet 1deca76e45774eebaf854bd715f4ccba (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:35.938194  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1deca76e45774eebaf854bd715f4ccba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.939778  5079 tablet_service.cc:1511] Processing CreateTablet for tablet 1deca76e45774eebaf854bd715f4ccba (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:35.941104  5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1deca76e45774eebaf854bd715f4ccba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.941587  5228 tablet_service.cc:1511] Processing CreateTablet for tablet 1deca76e45774eebaf854bd715f4ccba (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:35.942914  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1deca76e45774eebaf854bd715f4ccba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.943796  5082 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5625841028470c82811ea178953de2 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:35.945086  5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5625841028470c82811ea178953de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.950075  5159 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5625841028470c82811ea178953de2 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:35.950987  5229 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5625841028470c82811ea178953de2 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:35.951534  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5625841028470c82811ea178953de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.952353  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5625841028470c82811ea178953de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.974406  5082 tablet_service.cc:1511] Processing CreateTablet for tablet a210d9e18dae4f2f92fabd9ed60803ea (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:35.975236  5158 tablet_service.cc:1511] Processing CreateTablet for tablet a210d9e18dae4f2f92fabd9ed60803ea (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:35.975835  5082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a210d9e18dae4f2f92fabd9ed60803ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.976593  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a210d9e18dae4f2f92fabd9ed60803ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.997059  5389 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:35.998870  5229 tablet_service.cc:1511] Processing CreateTablet for tablet a210d9e18dae4f2f92fabd9ed60803ea (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:36.000768  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a210d9e18dae4f2f92fabd9ed60803ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.999320  5079 tablet_service.cc:1511] Processing CreateTablet for tablet 361d8f1a80a14d53894fdc37b3a0cd30 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:36.001875  5079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d8f1a80a14d53894fdc37b3a0cd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.005146  5159 tablet_service.cc:1511] Processing CreateTablet for tablet 361d8f1a80a14d53894fdc37b3a0cd30 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:36.006628  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d8f1a80a14d53894fdc37b3a0cd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.007160  5080 tablet_service.cc:1511] Processing CreateTablet for tablet e157db3b0632460abfd927c04a2797b1 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:36.008620  5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e157db3b0632460abfd927c04a2797b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.013141  5390 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.006640  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 361d8f1a80a14d53894fdc37b3a0cd30 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:36.013293  5156 tablet_service.cc:1511] Processing CreateTablet for tablet e157db3b0632460abfd927c04a2797b1 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:36.014412  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361d8f1a80a14d53894fdc37b3a0cd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.014784  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e157db3b0632460abfd927c04a2797b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.021263  5083 tablet_service.cc:1511] Processing CreateTablet for tablet 47d2ffadc1b346c1a799752ae255cc21 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:36.022792  5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d2ffadc1b346c1a799752ae255cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.022689  5231 tablet_service.cc:1511] Processing CreateTablet for tablet e157db3b0632460abfd927c04a2797b1 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:36.024335  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e157db3b0632460abfd927c04a2797b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.032009  5158 tablet_service.cc:1511] Processing CreateTablet for tablet 47d2ffadc1b346c1a799752ae255cc21 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:36.033448  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d2ffadc1b346c1a799752ae255cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.053558  5391 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.059027  5389 tablet_bootstrap.cc:654] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.091495  5390 tablet_bootstrap.cc:654] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.097021  5083 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd038d86144855a5a5d94df643f440 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:36.101984  5389 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.100841  5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd038d86144855a5a5d94df643f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.104240  5158 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd038d86144855a5a5d94df643f440 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:36.105894  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd038d86144855a5a5d94df643f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.107497  5391 tablet_bootstrap.cc:654] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.110024  5389 ts_tablet_manager.cc:1403] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.005s
I20260709 13:11:36.099186  5229 tablet_service.cc:1511] Processing CreateTablet for tablet 47d2ffadc1b346c1a799752ae255cc21 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:36.113227  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d2ffadc1b346c1a799752ae255cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.121889  5391 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.122140  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd038d86144855a5a5d94df643f440 (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:36.123490  5080 tablet_service.cc:1511] Processing CreateTablet for tablet 9180ef341ac54f8ab26fbe97f063c71c (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:36.123934  5389 raft_consensus.cc:359] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.124766  5389 raft_consensus.cc:385] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.124989  5080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180ef341ac54f8ab26fbe97f063c71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.127530  5390 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.128089  5390 ts_tablet_manager.cc:1403] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.026s
I20260709 13:11:36.123553  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd038d86144855a5a5d94df643f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.125931  5156 tablet_service.cc:1511] Processing CreateTablet for tablet 9180ef341ac54f8ab26fbe97f063c71c (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:36.130861  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180ef341ac54f8ab26fbe97f063c71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.131166  5390 raft_consensus.cc:359] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.131960  5390 raft_consensus.cc:385] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.132285  5390 raft_consensus.cc:740] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.133028  5390 consensus_queue.cc:260] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.135270  5390 ts_tablet_manager.cc:1434] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:36.125074  5389 raft_consensus.cc:740] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.138229  5391 ts_tablet_manager.cc:1403] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.008s
I20260709 13:11:36.138665  5389 consensus_queue.cc:260] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.141083  5389 ts_tablet_manager.cc:1434] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 13:11:36.145488  5389 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.148856  5391 raft_consensus.cc:359] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.149781  5391 raft_consensus.cc:385] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.150116  5391 raft_consensus.cc:740] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.150940  5391 consensus_queue.cc:260] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.154838  5389 tablet_bootstrap.cc:654] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.166029  5391 ts_tablet_manager.cc:1434] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:11:36.167315  5391 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.168298  5390 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.169240  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 9180ef341ac54f8ab26fbe97f063c71c (DEFAULT_TABLE table=soft_deleted_table [id=ba7675738995427483f8f9886f393077]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:36.170765  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180ef341ac54f8ab26fbe97f063c71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.174504  5391 tablet_bootstrap.cc:654] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.174539  5390 tablet_bootstrap.cc:654] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.187438  5389 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.188346  5389 ts_tablet_manager.cc:1403] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.001s
I20260709 13:11:36.192939  5389 raft_consensus.cc:359] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.194214  5389 raft_consensus.cc:385] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.194702  5389 raft_consensus.cc:740] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.196051  5389 consensus_queue.cc:260] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.199162  5389 ts_tablet_manager.cc:1434] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:11:36.200994  5378 raft_consensus.cc:493] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.200242  5389 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.201598  5378 raft_consensus.cc:515] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.202086  5391 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.202679  5391 ts_tablet_manager.cc:1403] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.011s
I20260709 13:11:36.204748  5390 tablet_bootstrap.cc:492] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.205353  5390 ts_tablet_manager.cc:1403] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.018s
I20260709 13:11:36.205386  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.205680  5391 raft_consensus.cc:359] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.206483  5391 raft_consensus.cc:385] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.206820  5391 raft_consensus.cc:740] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.207598  5391 consensus_queue.cc:260] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.208653  5390 raft_consensus.cc:359] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.209434  5390 raft_consensus.cc:385] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.209823  5390 raft_consensus.cc:740] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.210201  5391 ts_tablet_manager.cc:1434] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:11:36.210645  5390 consensus_queue.cc:260] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.211272  5391 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
W20260709 13:11:36.210275  5136 leader_election.cc:343] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.205924  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.212867  5095 raft_consensus.cc:2468] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
W20260709 13:11:36.213234  5041 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:36.214387  5133 leader_election.cc:304] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:36.215348  5390 ts_tablet_manager.cc:1434] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:11:36.215410  5370 raft_consensus.cc:2804] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.216025  5370 raft_consensus.cc:493] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.216377  5370 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.216600  5390 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.220248  5391 tablet_bootstrap.cc:654] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.227053  5389 tablet_bootstrap.cc:654] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.234390  5390 tablet_bootstrap.cc:654] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.235764  5378 leader_election.cc:290] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.248634  5370 raft_consensus.cc:515] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.251623  5390 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.251948  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.252607  5390 ts_tablet_manager.cc:1403] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.014s
I20260709 13:11:36.252872  5095 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.254469  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.251977  5370 leader_election.cc:290] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.259198  5391 tablet_bootstrap.cc:492] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.259758  5391 ts_tablet_manager.cc:1403] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.018s
W20260709 13:11:36.260149  5136 leader_election.cc:343] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.261372  5389 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.261348  5095 raft_consensus.cc:2468] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:36.262118  5389 ts_tablet_manager.cc:1403] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.012s
I20260709 13:11:36.262867  5391 raft_consensus.cc:359] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.263039  5133 leader_election.cc:304] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:36.263160  5390 raft_consensus.cc:359] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.263734  5391 raft_consensus.cc:385] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.264078  5390 raft_consensus.cc:385] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.264202  5391 raft_consensus.cc:740] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.264462  5390 raft_consensus.cc:740] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.264631  5370 raft_consensus.cc:2804] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.265081  5391 consensus_queue.cc:260] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.265446  5389 raft_consensus.cc:359] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.265538  5390 consensus_queue.cc:260] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.266309  5389 raft_consensus.cc:385] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.266695  5389 raft_consensus.cc:740] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.267604  5391 ts_tablet_manager.cc:1434] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:36.267520  5389 consensus_queue.cc:260] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.268091  5390 ts_tablet_manager.cc:1434] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:36.269169  5391 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.269181  5390 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.266006  5370 raft_consensus.cc:697] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:36.276190  5370 consensus_queue.cc:237] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.276706  5390 tablet_bootstrap.cc:654] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.276773  5389 ts_tablet_manager.cc:1434] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:36.282433  5391 tablet_bootstrap.cc:654] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.283052  5389 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.288887  5372 raft_consensus.cc:493] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.289470  5372 raft_consensus.cc:515] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.289659  4990 catalog_manager.cc:5697] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.290984  5389 tablet_bootstrap.cc:654] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.291697  5372 leader_election.cc:290] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.294169  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.294246  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.294912  5095 raft_consensus.cc:2468] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:36.296442  5207 leader_election.cc:304] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.297246  5372 raft_consensus.cc:2804] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.297600  5372 raft_consensus.cc:493] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.297906  5372 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:36.301451  5210 leader_election.cc:343] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.288509  5390 tablet_bootstrap.cc:492] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.304361  5390 ts_tablet_manager.cc:1403] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.001s
I20260709 13:11:36.307317  5390 raft_consensus.cc:359] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.310660  5390 raft_consensus.cc:385] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.310999  5390 raft_consensus.cc:740] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.311829  5390 consensus_queue.cc:260] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.312302  5391 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.312500  5389 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.312938  5391 ts_tablet_manager.cc:1403] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.019s
I20260709 13:11:36.313146  5389 ts_tablet_manager.cc:1403] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.004s
I20260709 13:11:36.314278  5390 ts_tablet_manager.cc:1434] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:11:36.309834  5372 raft_consensus.cc:515] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.316155  5390 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.316159  5391 raft_consensus.cc:359] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.317072  5391 raft_consensus.cc:385] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.316912  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.317396  5391 raft_consensus.cc:740] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.317566  5095 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.318210  5391 consensus_queue.cc:260] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.320739  5389 raft_consensus.cc:359] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.321501  5389 raft_consensus.cc:385] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.321791  5389 raft_consensus.cc:740] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.322535  5389 consensus_queue.cc:260] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.338508  5390 tablet_bootstrap.cc:654] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.339597  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.340612  5169 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.343051  5389 ts_tablet_manager.cc:1434] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.011s
I20260709 13:11:36.345161  5389 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.351539  5389 tablet_bootstrap.cc:654] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.354823  5372 leader_election.cc:290] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.360064  5169 raft_consensus.cc:2468] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.361995  5210 leader_election.cc:304] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.362824  5389 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.364698  5389 ts_tablet_manager.cc:1403] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:11:36.365074  5372 raft_consensus.cc:2804] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.365908  5372 raft_consensus.cc:697] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:36.367053  5372 consensus_queue.cc:237] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.367806  5389 raft_consensus.cc:359] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.368503  5389 raft_consensus.cc:385] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.368768  5389 raft_consensus.cc:740] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.375250  5389 consensus_queue.cc:260] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.375735  5095 raft_consensus.cc:2468] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.381016  5391 ts_tablet_manager.cc:1434] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.068s	user 0.017s	sys 0.037s
I20260709 13:11:36.381886  5389 ts_tablet_manager.cc:1434] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 13:11:36.383160  5390 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.383399  5389 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.384253  5390 ts_tablet_manager.cc:1403] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.011s
I20260709 13:11:36.387359  5390 raft_consensus.cc:359] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.387992  5392 raft_consensus.cc:493] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.388116  5390 raft_consensus.cc:385] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.388573  5390 raft_consensus.cc:740] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.383699  5391 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.388604  5392 raft_consensus.cc:515] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.389400  5390 consensus_queue.cc:260] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.390991  5392 leader_election.cc:290] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.392151  5390 ts_tablet_manager.cc:1434] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:36.393239  5390 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.393139  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5625841028470c82811ea178953de2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.393923  5243 raft_consensus.cc:2468] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.396322  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5625841028470c82811ea178953de2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.397042  5169 raft_consensus.cc:2468] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.398663  5391 tablet_bootstrap.cc:654] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.400193  5390 tablet_bootstrap.cc:654] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.401485  5061 leader_election.cc:304] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.403012  5389 tablet_bootstrap.cc:654] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.402242  4993 catalog_manager.cc:5697] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.407570  5392 raft_consensus.cc:2804] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.409641  5392 raft_consensus.cc:493] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.410379  5392 raft_consensus.cc:3060] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.428040  5390 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.427623  5392 raft_consensus.cc:515] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.428704  5390 ts_tablet_manager.cc:1403] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.007s
I20260709 13:11:36.428740  5389 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.429557  5389 ts_tablet_manager.cc:1403] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.007s
I20260709 13:11:36.431105  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5625841028470c82811ea178953de2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.431859  5169 raft_consensus.cc:3060] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.433079  5389 raft_consensus.cc:359] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.433874  5389 raft_consensus.cc:385] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.434176  5389 raft_consensus.cc:740] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.432699  5390 raft_consensus.cc:359] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.434981  5389 consensus_queue.cc:260] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.435658  5390 raft_consensus.cc:385] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.437616  5391 tablet_bootstrap.cc:492] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.437801  5390 raft_consensus.cc:740] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.438549  5391 ts_tablet_manager.cc:1403] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.006s
I20260709 13:11:36.438834  5390 consensus_queue.cc:260] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.441038  5390 ts_tablet_manager.cc:1434] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:11:36.442039  5390 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.441861  5391 raft_consensus.cc:359] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.442781  5391 raft_consensus.cc:385] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.443199  5391 raft_consensus.cc:740] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.444206  5391 consensus_queue.cc:260] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.446925  5169 raft_consensus.cc:2468] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.447214  5389 ts_tablet_manager.cc:1434] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:11:36.451741  5390 tablet_bootstrap.cc:654] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.452113  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5625841028470c82811ea178953de2" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.452829  5243 raft_consensus.cc:3060] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.452983  5389 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.447374  5391 ts_tablet_manager.cc:1434] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:11:36.456265  5391 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.460902  5389 tablet_bootstrap.cc:654] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.462612  5391 tablet_bootstrap.cc:654] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.470026  5243 raft_consensus.cc:2468] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.448109  5392 leader_election.cc:290] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.472000  5061 leader_election.cc:304] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.474174  5363 raft_consensus.cc:2804] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.475162  5390 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.475740  5390 ts_tablet_manager.cc:1403] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:11:36.475776  5391 tablet_bootstrap.cc:492] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.476599  5391 ts_tablet_manager.cc:1403] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:11:36.479516  5390 raft_consensus.cc:359] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.480436  5390 raft_consensus.cc:385] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.480791  5390 raft_consensus.cc:740] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.480854  5391 raft_consensus.cc:359] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.482002  5391 raft_consensus.cc:385] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.481727  5390 consensus_queue.cc:260] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.482391  5391 raft_consensus.cc:740] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.483587  5389 tablet_bootstrap.cc:492] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.483444  5391 consensus_queue.cc:260] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.484170  5389 ts_tablet_manager.cc:1403] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:11:36.484383  5390 ts_tablet_manager.cc:1434] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:36.487504  5389 raft_consensus.cc:359] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.488385  5389 raft_consensus.cc:385] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.488729  5389 raft_consensus.cc:740] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.489171  5390 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.489632  5389 consensus_queue.cc:260] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.492230  5389 ts_tablet_manager.cc:1434] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:36.493294  5389 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.493718  5391 ts_tablet_manager.cc:1434] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:36.495004  5391 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.495915  5390 tablet_bootstrap.cc:654] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.504618  5391 tablet_bootstrap.cc:654] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.505606  5389 tablet_bootstrap.cc:654] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.507762  5363 raft_consensus.cc:697] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:36.508401  5390 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.508956  5390 ts_tablet_manager.cc:1403] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:11:36.509092  5363 consensus_queue.cc:237] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.510289  5416 raft_consensus.cc:493] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.510828  5416 raft_consensus.cc:515] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.512133  5390 raft_consensus.cc:359] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.512660  5390 raft_consensus.cc:385] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.512918  5390 raft_consensus.cc:740] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.513566  5390 consensus_queue.cc:260] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.513969  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.514595  5169 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.514981  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.515647  5390 ts_tablet_manager.cc:1434] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:36.515700  5243 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.516614  5390 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: Bootstrap starting.
I20260709 13:11:36.517465  5061 leader_election.cc:304] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.519002  5416 leader_election.cc:290] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.522321  5390 tablet_bootstrap.cc:654] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.519292  5392 raft_consensus.cc:2804] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.525384  5392 raft_consensus.cc:493] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.525856  5392 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.526623  5391 tablet_bootstrap.cc:492] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.527232  5391 ts_tablet_manager.cc:1403] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.002s
I20260709 13:11:36.527889  4990 catalog_manager.cc:5697] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.542608  5392 raft_consensus.cc:515] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.545548  5392 leader_election.cc:290] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.530324  5391 raft_consensus.cc:359] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.551748  5391 raft_consensus.cc:385] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.552325  5391 raft_consensus.cc:740] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.553144  5391 consensus_queue.cc:260] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.555560  5372 raft_consensus.cc:493] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.556054  5372 raft_consensus.cc:515] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.556464  5390 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: No bootstrap required, opened a new log
I20260709 13:11:36.557011  5390 ts_tablet_manager.cc:1403] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.019s
I20260709 13:11:36.557955  5372 leader_election.cc:290] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.558676  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.559381  5095 raft_consensus.cc:2468] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:36.559604  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.560055  5391 ts_tablet_manager.cc:1434] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:11:36.562781  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.563400  5168 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.560352  5169 raft_consensus.cc:2468] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:36.559604  5390 raft_consensus.cc:359] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.560954  5207 leader_election.cc:304] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.568380  5390 raft_consensus.cc:385] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.568445  5372 raft_consensus.cc:2804] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.568766  5390 raft_consensus.cc:740] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.568922  5372 raft_consensus.cc:493] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.569319  5372 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.569542  5390 consensus_queue.cc:260] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.570170  5168 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.571856  5390 ts_tablet_manager.cc:1434] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:11:36.573444  5061 leader_election.cc:304] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.574288  5392 raft_consensus.cc:2804] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.575021  5392 raft_consensus.cc:697] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:36.575944  5392 consensus_queue.cc:237] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.577549  5389 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.578037  5389 ts_tablet_manager.cc:1403] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.004s
I20260709 13:11:36.578421  5406 raft_consensus.cc:493] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.578998  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.578970  5406 raft_consensus.cc:515] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.579814  5243 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.581296  5406 leader_election.cc:290] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.582867  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.583505  5095 raft_consensus.cc:2393] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in current term 1: Already voted for candidate 566965e90cf14709ae52abc0bf921424 in this term.
I20260709 13:11:36.581082  5389 raft_consensus.cc:359] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.584597  5389 raft_consensus.cc:385] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.584868  5389 raft_consensus.cc:740] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.585501  5389 consensus_queue.cc:260] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.587386  5389 ts_tablet_manager.cc:1434] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:11:36.588024  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.589685  5391 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.589700  5210 leader_election.cc:304] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424
I20260709 13:11:36.591058  5406 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.591885  5389 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Bootstrap starting.
I20260709 13:11:36.596606  5372 raft_consensus.cc:515] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.598476  5389 tablet_bootstrap.cc:654] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.611512  5372 leader_election.cc:290] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.612287  5391 tablet_bootstrap.cc:654] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.612325  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.613152  5095 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.607466  5406 raft_consensus.cc:2749] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.607331  4993 catalog_manager.cc:5697] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.612588  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.604314  5243 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.615563  5168 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.619740  5095 raft_consensus.cc:2468] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.621142  5207 leader_election.cc:304] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.621691  5391 tablet_bootstrap.cc:492] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.622010  5406 raft_consensus.cc:2804] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.622174  5391 ts_tablet_manager.cc:1403] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.005s
I20260709 13:11:36.622551  5406 raft_consensus.cc:697] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:36.623418  5406 consensus_queue.cc:237] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.625149  5391 raft_consensus.cc:359] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.625856  5391 raft_consensus.cc:385] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.626188  5168 raft_consensus.cc:2468] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.626107  5391 raft_consensus.cc:740] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.628389  5389 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: No bootstrap required, opened a new log
I20260709 13:11:36.628911  5389 ts_tablet_manager.cc:1403] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:11:36.628554  5391 consensus_queue.cc:260] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.631747  5391 ts_tablet_manager.cc:1434] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:11:36.631986  5389 raft_consensus.cc:359] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.632707  5389 raft_consensus.cc:385] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.632972  5389 raft_consensus.cc:740] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.633147  5391 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: Bootstrap starting.
I20260709 13:11:36.633755  5389 consensus_queue.cc:260] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.636293  5389 ts_tablet_manager.cc:1434] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:36.639151  5391 tablet_bootstrap.cc:654] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.646234  4991 catalog_manager.cc:5697] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.648291  5391 tablet_bootstrap.cc:492] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: No bootstrap required, opened a new log
I20260709 13:11:36.648948  5391 ts_tablet_manager.cc:1403] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:11:36.652163  5391 raft_consensus.cc:359] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.652989  5391 raft_consensus.cc:385] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.653280  5391 raft_consensus.cc:740] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.653990  5391 consensus_queue.cc:260] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.656040  5391 ts_tablet_manager.cc:1434] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:36.710886  5370 raft_consensus.cc:493] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.711474  5370 raft_consensus.cc:515] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.713222  5370 leader_election.cc:290] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.714154  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd038d86144855a5a5d94df643f440" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.714362  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd038d86144855a5a5d94df643f440" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.714813  5095 raft_consensus.cc:2468] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:36.714996  5243 raft_consensus.cc:2468] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:36.716001  5133 leader_election.cc:304] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.716890  5370 raft_consensus.cc:2804] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.717242  5370 raft_consensus.cc:493] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.717595  5370 raft_consensus.cc:3060] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.719461  5378 consensus_queue.cc:1048] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.724673  5370 raft_consensus.cc:515] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.727634  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd038d86144855a5a5d94df643f440" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.728334  5095 raft_consensus.cc:3060] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.729346  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd038d86144855a5a5d94df643f440" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.730202  5243 raft_consensus.cc:3060] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.735344  5095 raft_consensus.cc:2468] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:36.736603  5133 leader_election.cc:304] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.737636  5378 raft_consensus.cc:2804] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.737780  5392 raft_consensus.cc:493] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.738297  5392 raft_consensus.cc:515] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.740970  5392 leader_election.cc:290] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.741528  5370 leader_election.cc:290] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.743791  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.752950  5168 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.744691  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.753677  5243 raft_consensus.cc:2468] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:36.754091  5061 leader_election.cc:304] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.754287  5244 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 0.
I20260709 13:11:36.745221  5378 raft_consensus.cc:697] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:36.755028  5392 raft_consensus.cc:2804] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.755416  5392 raft_consensus.cc:493] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.755780  5392 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.755698  5378 consensus_queue.cc:237] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.761829  5370 raft_consensus.cc:493] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.762303  5370 raft_consensus.cc:515] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.767405  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e157db3b0632460abfd927c04a2797b1" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.767545  5392 raft_consensus.cc:515] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.768076  5095 raft_consensus.cc:2468] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:36.769127  5133 leader_election.cc:304] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.770052  5378 raft_consensus.cc:2804] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.770417  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.771021  5168 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.771255  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.771840  5244 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.772037  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e157db3b0632460abfd927c04a2797b1" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" is_pre_election: true
I20260709 13:11:36.772840  5243 raft_consensus.cc:2468] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 0.
I20260709 13:11:36.774189  5370 leader_election.cc:290] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.770431  5378 raft_consensus.cc:493] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.768836  4991 catalog_manager.cc:5697] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.776377  5378 raft_consensus.cc:3060] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.779685  5431 consensus_queue.cc:1048] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.775821  5392 leader_election.cc:290] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.781179  5406 raft_consensus.cc:493] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.781699  5406 raft_consensus.cc:515] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.784018  5406 leader_election.cc:290] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.785436  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180ef341ac54f8ab26fbe97f063c71c" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08" is_pre_election: true
I20260709 13:11:36.779320  5244 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.786108  5095 raft_consensus.cc:2468] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:36.787099  5061 leader_election.cc:304] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.788158  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180ef341ac54f8ab26fbe97f063c71c" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424" is_pre_election: true
I20260709 13:11:36.788823  5169 raft_consensus.cc:2468] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 0.
I20260709 13:11:36.788961  5363 raft_consensus.cc:2804] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.789510  5363 raft_consensus.cc:697] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:36.790326  5363 consensus_queue.cc:237] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.792069  5168 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 1.
I20260709 13:11:36.796097  5210 leader_election.cc:304] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.796957  5406 raft_consensus.cc:2804] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.797358  5406 raft_consensus.cc:493] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.797670  5406 raft_consensus.cc:3060] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.796633  5378 raft_consensus.cc:515] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.806986  5095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e157db3b0632460abfd927c04a2797b1" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.807552  5095 raft_consensus.cc:3060] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.810048  5406 raft_consensus.cc:515] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.812861  5378 leader_election.cc:290] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:36.813230  4990 catalog_manager.cc:5697] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 1 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.814006  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e157db3b0632460abfd927c04a2797b1" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:36.814743  5244 raft_consensus.cc:3060] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.816303  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180ef341ac54f8ab26fbe97f063c71c" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:36.816942  5093 raft_consensus.cc:3060] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.820227  5095 raft_consensus.cc:2468] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:36.814767  5406 leader_election.cc:290] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:36.821847  5244 raft_consensus.cc:2468] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 1.
I20260709 13:11:36.822435  5133 leader_election.cc:304] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:36.823330  5378 raft_consensus.cc:2804] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.824489  5378 raft_consensus.cc:697] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:36.825821  5378 consensus_queue.cc:237] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.828778  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180ef341ac54f8ab26fbe97f063c71c" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:36.829645  5168 raft_consensus.cc:3060] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.831775  5093 raft_consensus.cc:2468] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.832897  5207 leader_election.cc:304] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:36.833734  5406 raft_consensus.cc:2804] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.834206  5406 raft_consensus.cc:697] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:36.835021  5406 consensus_queue.cc:237] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:36.837852  5372 consensus_queue.cc:1048] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:36.838789  5168 raft_consensus.cc:2468] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 1.
I20260709 13:11:36.840687  4993 catalog_manager.cc:5697] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 1 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.850445  4990 catalog_manager.cc:5697] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 1 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.865790  5406 consensus_queue.cc:1048] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.008539  5363 consensus_queue.cc:1048] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.022284  5363 consensus_queue.cc:1048] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.063755  5421 consensus_queue.cc:1048] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.076009  5363 consensus_queue.cc:1048] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.085683  5168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:45264
I20260709 13:11:37.086217  5168 raft_consensus.cc:606] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:37.091746  5243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:11:37.092319  5243 raft_consensus.cc:606] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:37.100241  5243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
mode: GRACEFUL
new_leader_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:11:37.100739  5243 raft_consensus.cc:606] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Received request to transfer leadership to TS 511db311300b46ff91ae296b93d61e08
I20260709 13:11:37.105732  5093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
mode: GRACEFUL
new_leader_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:43190
I20260709 13:11:37.106415  5093 raft_consensus.cc:606] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Received request to transfer leadership to TS 566965e90cf14709ae52abc0bf921424
I20260709 13:11:37.114033  5093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
mode: GRACEFUL
new_leader_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:43190
I20260709 13:11:37.114516  5093 raft_consensus.cc:606] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Received request to transfer leadership to TS 566965e90cf14709ae52abc0bf921424
I20260709 13:11:37.168407  5406 consensus_queue.cc:1048] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.174486  5440 raft_consensus.cc:993] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.175027  5441 raft_consensus.cc:1081] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.177942  5095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43176
I20260709 13:11:37.178475  5095 raft_consensus.cc:493] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.178819  5095 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.182366  5429 consensus_queue.cc:1048] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.182915  5441 consensus_queue.cc:1048] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.186875  5095 raft_consensus.cc:515] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.189900  5095 leader_election.cc:290] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:37.190567  5169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:37.190614  5093 raft_consensus.cc:1240] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Rejecting Update request from peer da09a5ae8b4c4a62bb8ac9d0f69206a2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:37.193017  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a210d9e18dae4f2f92fabd9ed60803ea" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:37.193707  5243 raft_consensus.cc:3055] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.194065  5243 raft_consensus.cc:740] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:37.194875  5243 consensus_queue.cc:260] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.195647  5440 consensus_queue.cc:1059] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.204366  5429 consensus_queue.cc:1048] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.208722  5243 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.225814  5243 raft_consensus.cc:2468] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:37.226884  5061 leader_election.cc:304] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 566965e90cf14709ae52abc0bf921424
I20260709 13:11:37.227739  5363 raft_consensus.cc:2804] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.228236  5363 raft_consensus.cc:697] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:37.229074  5363 consensus_queue.cc:237] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.236292  4991 catalog_manager.cc:5697] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.243106  5429 consensus_queue.cc:1048] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.253445  5378 consensus_queue.cc:1048] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.270877  5441 consensus_queue.cc:1048] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.281672  5441 consensus_queue.cc:1048] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.286741  5406 raft_consensus.cc:993] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.287210  5406 raft_consensus.cc:1081] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.289150  5093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43176
I20260709 13:11:37.289665  5093 raft_consensus.cc:493] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.289963  5093 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.296747  5093 raft_consensus.cc:515] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.298899  5093 leader_election.cc:290] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:37.300339  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:37.300408  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1deca76e45774eebaf854bd715f4ccba" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:37.301010  5168 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.301327  5243 raft_consensus.cc:3055] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.301626  5243 raft_consensus.cc:740] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:37.302356  5243 consensus_queue.cc:260] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.303468  5243 raft_consensus.cc:3060] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.307850  5168 raft_consensus.cc:2468] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:37.309074  5061 leader_election.cc:304] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, 566965e90cf14709ae52abc0bf921424; no voters: 
I20260709 13:11:37.309839  5363 raft_consensus.cc:2804] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.310343  5363 raft_consensus.cc:697] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:37.311151  5363 consensus_queue.cc:237] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.316290  5378 raft_consensus.cc:993] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: : Instructing follower 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.316151  5243 raft_consensus.cc:2468] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:37.316946  5378 raft_consensus.cc:1081] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Signalling peer 511db311300b46ff91ae296b93d61e08 to start an election
I20260709 13:11:37.318554  5093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:11:37.319001  5093 raft_consensus.cc:493] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.319285  5093 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.319291  4991 catalog_manager.cc:5697] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.324482  5093 raft_consensus.cc:515] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.326496  5093 leader_election.cc:290] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Requested vote from peers 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:37.327454  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:37.328083  5243 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.328006  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5992c99a0542dfbaf5759f09c43d01" candidate_uuid: "511db311300b46ff91ae296b93d61e08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:37.328739  5168 raft_consensus.cc:3055] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.329058  5168 raft_consensus.cc:740] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:37.329669  5168 consensus_queue.cc:260] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.330603  5168 raft_consensus.cc:3060] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.332933  5243 raft_consensus.cc:2468] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:37.334045  5061 leader_election.cc:304] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:37.334745  5363 raft_consensus.cc:2804] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.335125  5363 raft_consensus.cc:697] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Becoming Leader. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:37.335868  5168 raft_consensus.cc:2468] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511db311300b46ff91ae296b93d61e08 in term 2.
I20260709 13:11:37.335903  5363 consensus_queue.cc:237] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.342398  4991 catalog_manager.cc:5697] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 reported cstate change: term changed from 1 to 2, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to 511db311300b46ff91ae296b93d61e08 (127.24.232.193). New cstate: current_term: 2 leader_uuid: "511db311300b46ff91ae296b93d61e08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.378929  5363 consensus_queue.cc:1048] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.390435  5392 consensus_queue.cc:1048] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.399060  5363 raft_consensus.cc:993] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: : Instructing follower 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:37.399531  5392 raft_consensus.cc:1081] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Signalling peer 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:37.401140  5168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:45252
I20260709 13:11:37.401710  5168 raft_consensus.cc:493] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.402066  5168 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.407174  5168 raft_consensus.cc:515] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.409199  5168 leader_election.cc:290] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:37.409518  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:37.410193  5093 raft_consensus.cc:3055] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.410527  5093 raft_consensus.cc:740] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:37.410614  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d2ffadc1b346c1a799752ae255cc21" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:37.411128  5243 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.411325  5093 consensus_queue.cc:260] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.412689  5093 raft_consensus.cc:3060] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.417560  5243 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:37.418581  5136 leader_election.cc:304] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:37.419377  5429 raft_consensus.cc:2804] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.419865  5429 raft_consensus.cc:697] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:37.420360  5093 raft_consensus.cc:2468] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:37.420615  5429 consensus_queue.cc:237] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.426851  4991 catalog_manager.cc:5697] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 1 to 2, leader changed from 511db311300b46ff91ae296b93d61e08 (127.24.232.193) to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.530929  5363 raft_consensus.cc:993] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: : Instructing follower 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:37.531368  5392 raft_consensus.cc:1081] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Signalling peer 566965e90cf14709ae52abc0bf921424 to start an election
I20260709 13:11:37.532733  5168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
 from {username='slave'} at 127.0.0.1:45252
I20260709 13:11:37.533201  5168 raft_consensus.cc:493] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.533468  5168 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.538192  5168 raft_consensus.cc:515] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.539820  5168 leader_election.cc:290] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195:41019)
I20260709 13:11:37.540537  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:37.540884  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361d8f1a80a14d53894fdc37b3a0cd30" candidate_uuid: "566965e90cf14709ae52abc0bf921424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
I20260709 13:11:37.541121  5093 raft_consensus.cc:3055] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.541468  5243 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.541515  5093 raft_consensus.cc:740] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:37.542305  5093 consensus_queue.cc:260] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.543449  5093 raft_consensus.cc:3060] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.545998  5243 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:37.546993  5136 leader_election.cc:304] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:37.547835  5429 raft_consensus.cc:2804] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.548233  5429 raft_consensus.cc:697] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Leader. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:37.548919  5093 raft_consensus.cc:2468] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 566965e90cf14709ae52abc0bf921424 in term 2.
I20260709 13:11:37.548988  5429 consensus_queue.cc:237] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:37.556164  4991 catalog_manager.cc:5697] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 reported cstate change: term changed from 1 to 2, leader changed from 511db311300b46ff91ae296b93d61e08 (127.24.232.193) to 566965e90cf14709ae52abc0bf921424 (127.24.232.194). New cstate: current_term: 2 leader_uuid: "566965e90cf14709ae52abc0bf921424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.685613  5168 raft_consensus.cc:3060] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.686985  5243 raft_consensus.cc:1275] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.696745  5392 consensus_queue.cc:1048] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.702437  5168 raft_consensus.cc:1275] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.704164  5363 consensus_queue.cc:1048] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.792181  5243 raft_consensus.cc:1275] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.793515  5458 consensus_queue.cc:1048] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.801136  5168 raft_consensus.cc:1275] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.803131  5363 consensus_queue.cc:1048] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.823864  5243 raft_consensus.cc:1275] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.825044  5363 consensus_queue.cc:1048] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.833422  5168 raft_consensus.cc:1275] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer 511db311300b46ff91ae296b93d61e08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.835747  5421 consensus_queue.cc:1048] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.891888  5243 raft_consensus.cc:1275] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.893023  5429 consensus_queue.cc:1048] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.904436  5093 raft_consensus.cc:1275] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.906170  5429 consensus_queue.cc:1048] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.961241  5243 raft_consensus.cc:1275] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.962415  5429 consensus_queue.cc:1048] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.970216  5093 raft_consensus.cc:1275] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer 566965e90cf14709ae52abc0bf921424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.972021  5378 consensus_queue.cc:1048] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:40.123140  4991 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52374:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:40.146265  4991 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52374:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:40.255990 25507 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:40.504470  5515 tablet.cc:1724] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.542433  5520 tablet.cc:1724] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:40.558887  5492 log.cc:927] Time spent T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Append to log took a long time: real 0.169s	user 0.000s	sys 0.006s
I20260709 13:11:40.588246  5519 tablet.cc:1724] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.591755  5093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0"
dest_uuid: "511db311300b46ff91ae296b93d61e08"
mode: GRACEFUL
new_leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:11:40.592695  5093 raft_consensus.cc:606] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Received request to transfer leadership to TS da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:40.602283  5482 raft_consensus.cc:993] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: : Instructing follower da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
I20260709 13:11:40.602815  5482 raft_consensus.cc:1081] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Signalling peer da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
W20260709 13:11:40.605027  5512 log.cc:927] Time spent T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:11:40.605382  5240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:50826
I20260709 13:11:40.606073  5240 raft_consensus.cc:493] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:40.606508  5240 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.622453  5524 tablet.cc:1724] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:40.620474  5133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.232.193:40169, user_credentials={real_user=slave}} blocked reactor thread for 122592us
W20260709 13:11:40.638670  5521 log.cc:927] Time spent T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:11:40.638725  5528 tablet.cc:1724] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.684898  5526 tablet.cc:1724] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.685855  5240 raft_consensus.cc:515] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:40.695283  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:40.696087  5167 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.686722  5527 tablet.cc:1724] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.701859  5092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef0aea3ef4344febed7ca613b962cd0" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:40.707423  5092 raft_consensus.cc:3055] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:40.707809  5092 raft_consensus.cc:740] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 511db311300b46ff91ae296b93d61e08, State: Running, Role: LEADER
I20260709 13:11:40.708763  5092 consensus_queue.cc:260] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:40.686826  5531 tablet.cc:1724] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.700953  5520 tablet.cc:1724] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:40.740645  5522 log.cc:927] Time spent T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:40.679320  5535 tablet.cc:1724] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.750936  5092 raft_consensus.cc:3060] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.711879  5240 leader_election.cc:290] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 2 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:40.769965  5519 tablet.cc:1724] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.787683  5534 tablet.cc:1724] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.793025  5539 tablet.cc:1724] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.798528  5167 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 2.
I20260709 13:11:40.803288  5528 tablet.cc:1724] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.812497  5536 tablet.cc:1724] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.826885  5170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6"
dest_uuid: "566965e90cf14709ae52abc0bf921424"
mode: GRACEFUL
new_leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:54434
I20260709 13:11:40.827644  5170 raft_consensus.cc:606] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Received request to transfer leadership to TS da09a5ae8b4c4a62bb8ac9d0f69206a2
I20260709 13:11:40.829859 25507 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:40.830595 25507 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:40.829635  5524 tablet.cc:1724] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.832841  5519 tablet.cc:1724] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.834852  5527 tablet.cc:1724] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.843922  5515 tablet.cc:1724] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.844472  5210 leader_election.cc:304] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 566965e90cf14709ae52abc0bf921424, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:40.845739  5525 raft_consensus.cc:2804] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:40.846256  5525 raft_consensus.cc:697] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:40.847361  5525 consensus_queue.cc:237] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:40.848239  5092 raft_consensus.cc:2468] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 2.
I20260709 13:11:40.836715  5536 tablet.cc:1724] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.862866  5520 tablet.cc:1724] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.873782  5526 tablet.cc:1724] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.882436  5539 tablet.cc:1724] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.883955  4991 catalog_manager.cc:5697] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 1 to 2, leader changed from 511db311300b46ff91ae296b93d61e08 (127.24.232.193) to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 2 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:40.900321  5531 tablet.cc:1724] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.907466  5536 tablet.cc:1724] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.912228  5515 tablet.cc:1724] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.896261  5534 tablet.cc:1724] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:40.946404  4993 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: soft_deleted_table [id=ba7675738995427483f8f9886f393077] alter complete (version 1)
I20260709 13:11:41.068431  5498 raft_consensus.cc:993] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: : Instructing follower da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
I20260709 13:11:41.068974  5466 raft_consensus.cc:1081] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Signalling peer da09a5ae8b4c4a62bb8ac9d0f69206a2 to start an election
I20260709 13:11:41.070492  5240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6"
dest_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2"
 from {username='slave'} at 127.0.0.1:50824
I20260709 13:11:41.070971  5240 raft_consensus.cc:493] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.071264  5240 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.077333  5240 raft_consensus.cc:515] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:41.079190  5240 leader_election.cc:290] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 3 election: Requested vote from peers 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169), 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809)
I20260709 13:11:41.079936  5091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "511db311300b46ff91ae296b93d61e08"
I20260709 13:11:41.080287  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f84a92b37a4609acc81a8b219d45f6" candidate_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "566965e90cf14709ae52abc0bf921424"
I20260709 13:11:41.080461  5091 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.080935  5167 raft_consensus.cc:3055] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:41.081250  5167 raft_consensus.cc:740] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 566965e90cf14709ae52abc0bf921424, State: Running, Role: LEADER
I20260709 13:11:41.081938  5167 consensus_queue.cc:260] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:41.083232  5167 raft_consensus.cc:3060] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.089767  5091 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 3.
I20260709 13:11:41.091179  5207 leader_election.cc:304] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511db311300b46ff91ae296b93d61e08, da09a5ae8b4c4a62bb8ac9d0f69206a2; no voters: 
I20260709 13:11:41.092096  5525 raft_consensus.cc:2804] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:41.092612  5525 raft_consensus.cc:697] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 3 LEADER]: Becoming Leader. State: Replica: da09a5ae8b4c4a62bb8ac9d0f69206a2, State: Running, Role: LEADER
I20260709 13:11:41.092280  5167 raft_consensus.cc:2468] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da09a5ae8b4c4a62bb8ac9d0f69206a2 in term 3.
I20260709 13:11:41.093739  5525 consensus_queue.cc:237] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } }
I20260709 13:11:41.101576  4990 catalog_manager.cc:5697] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 reported cstate change: term changed from 2 to 3, leader changed from 566965e90cf14709ae52abc0bf921424 (127.24.232.194) to da09a5ae8b4c4a62bb8ac9d0f69206a2 (127.24.232.195). New cstate: current_term: 3 leader_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da09a5ae8b4c4a62bb8ac9d0f69206a2" member_type: VOTER last_known_addr { host: "127.24.232.195" port: 41019 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.288921  5091 raft_consensus.cc:1275] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:41.290165  5525 consensus_queue.cc:1048] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:41.300578  5167 raft_consensus.cc:1275] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:41.304127  5459 consensus_queue.cc:1048] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:41.617880  5091 raft_consensus.cc:1275] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 3 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:41.619774  5459 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511db311300b46ff91ae296b93d61e08" member_type: VOTER last_known_addr { host: "127.24.232.193" port: 40169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:41.630759  5167 raft_consensus.cc:1275] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 3 FOLLOWER]: Refusing update from remote peer da09a5ae8b4c4a62bb8ac9d0f69206a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:41.632050  5549 consensus_queue.cc:1048] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566965e90cf14709ae52abc0bf921424" member_type: VOTER last_known_addr { host: "127.24.232.194" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:41.887096 25507 tablet_server.cc:179] TabletServer@127.24.232.193:0 shutting down...
I20260709 13:11:41.921912 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:41.922983 25507 tablet_replica.cc:333] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.924211 25507 raft_consensus.cc:2243] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.924768 25507 raft_consensus.cc:2272] T 9180ef341ac54f8ab26fbe97f063c71c P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.926901 25507 tablet_replica.cc:333] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.927541 25507 raft_consensus.cc:2243] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.928063 25507 raft_consensus.cc:2272] T 9cfd038d86144855a5a5d94df643f440 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.930737 25507 tablet_replica.cc:333] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.931610 25507 raft_consensus.cc:2243] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.932093 25507 raft_consensus.cc:2272] T e157db3b0632460abfd927c04a2797b1 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.934098 25507 tablet_replica.cc:333] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.934693 25507 raft_consensus.cc:2243] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.935148 25507 raft_consensus.cc:2272] T 47d2ffadc1b346c1a799752ae255cc21 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.937270 25507 tablet_replica.cc:333] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.937887 25507 raft_consensus.cc:2243] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.938736 25507 raft_consensus.cc:2272] T a210d9e18dae4f2f92fabd9ed60803ea P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.940871 25507 tablet_replica.cc:333] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.941431 25507 raft_consensus.cc:2243] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.941910 25507 raft_consensus.cc:2272] T 471ac51a678049b8af829f731acae687 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.944053 25507 tablet_replica.cc:333] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.944686 25507 raft_consensus.cc:2243] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.945140 25507 raft_consensus.cc:2272] T 361d8f1a80a14d53894fdc37b3a0cd30 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.947187 25507 tablet_replica.cc:333] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.947793 25507 raft_consensus.cc:2243] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.948570 25507 raft_consensus.cc:2272] T 1d5992c99a0542dfbaf5759f09c43d01 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.950614 25507 tablet_replica.cc:333] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.951303 25507 raft_consensus.cc:2243] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.951819 25507 raft_consensus.cc:2272] T a974f47cf6aa44fca80b8820855303d3 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.954445 25507 tablet_replica.cc:333] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.955029 25507 raft_consensus.cc:2243] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.955514 25507 raft_consensus.cc:2272] T aa7be7e8c0d84af381b633f3b13295a7 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.957855 25507 tablet_replica.cc:333] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.958639 25507 raft_consensus.cc:2243] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.959415 25507 raft_consensus.cc:2272] T 8c5625841028470c82811ea178953de2 P 511db311300b46ff91ae296b93d61e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.961616 25507 tablet_replica.cc:333] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.962193 25507 raft_consensus.cc:2243] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.962677 25507 raft_consensus.cc:2272] T effd2f3b6e8b4e3db29559c50ec602fa P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.964937 25507 tablet_replica.cc:333] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.965467 25507 raft_consensus.cc:2243] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.965860 25507 raft_consensus.cc:2272] T eef0aea3ef4344febed7ca613b962cd0 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.968374 25507 tablet_replica.cc:333] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.968932 25507 raft_consensus.cc:2243] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.969749 25507 raft_consensus.cc:2272] T f011340985984ac28ee694cb6aa6ea6a P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.971909 25507 tablet_replica.cc:333] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.972445 25507 raft_consensus.cc:2243] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.972891 25507 raft_consensus.cc:2272] T f1f84a92b37a4609acc81a8b219d45f6 P 511db311300b46ff91ae296b93d61e08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.975183 25507 tablet_replica.cc:333] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.975780 25507 raft_consensus.cc:2243] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.976533 25507 raft_consensus.cc:2272] T 1deca76e45774eebaf854bd715f4ccba P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.978518 25507 tablet_replica.cc:333] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.979149 25507 raft_consensus.cc:2243] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.979967 25507 raft_consensus.cc:2272] T 37edbfac9176427092b4997d580c6900 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.981861 25507 tablet_replica.cc:333] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08: stopping tablet replica
I20260709 13:11:41.982318 25507 raft_consensus.cc:2243] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.983197 25507 raft_consensus.cc:2272] T 200031007bd5431ea5a07360df57cba2 P 511db311300b46ff91ae296b93d61e08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.023386 25507 tablet_server.cc:196] TabletServer@127.24.232.193:0 shutdown complete.
I20260709 13:11:42.059916 25507 tablet_server.cc:179] TabletServer@127.24.232.194:0 shutting down...
I20260709 13:11:42.087730 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:42.088466 25507 tablet_replica.cc:333] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.089329 25507 raft_consensus.cc:2243] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.089844 25507 raft_consensus.cc:2272] T 9180ef341ac54f8ab26fbe97f063c71c P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.092036 25507 tablet_replica.cc:333] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.092618 25507 raft_consensus.cc:2243] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.093415 25507 raft_consensus.cc:2272] T 9cfd038d86144855a5a5d94df643f440 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.095508 25507 tablet_replica.cc:333] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.096138 25507 raft_consensus.cc:2243] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.096935 25507 raft_consensus.cc:2272] T 47d2ffadc1b346c1a799752ae255cc21 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.098953 25507 tablet_replica.cc:333] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.099531 25507 raft_consensus.cc:2243] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.100346 25507 raft_consensus.cc:2272] T e157db3b0632460abfd927c04a2797b1 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.102396 25507 tablet_replica.cc:333] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.102947 25507 raft_consensus.cc:2243] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.103400 25507 raft_consensus.cc:2272] T a210d9e18dae4f2f92fabd9ed60803ea P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.105496 25507 tablet_replica.cc:333] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.106189 25507 raft_consensus.cc:2243] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.106652 25507 raft_consensus.cc:2272] T aa7be7e8c0d84af381b633f3b13295a7 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.108915 25507 tablet_replica.cc:333] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.109543 25507 raft_consensus.cc:2243] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.110512 25507 raft_consensus.cc:2272] T 471ac51a678049b8af829f731acae687 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.112720 25507 tablet_replica.cc:333] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.113241 25507 raft_consensus.cc:2243] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.113670 25507 raft_consensus.cc:2272] T 8c5625841028470c82811ea178953de2 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.115543 25507 tablet_replica.cc:333] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.116174 25507 raft_consensus.cc:2243] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.116528 25507 raft_consensus.cc:2272] T eef0aea3ef4344febed7ca613b962cd0 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.120225 25507 tablet_replica.cc:333] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.120862 25507 raft_consensus.cc:2243] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:42.120910  5133 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.232.193:40169: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260709 13:11:42.121744 25507 raft_consensus.cc:2272] T effd2f3b6e8b4e3db29559c50ec602fa P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.124200 25507 tablet_replica.cc:333] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.125072 25507 raft_consensus.cc:2243] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.125893 25507 raft_consensus.cc:2272] T 361d8f1a80a14d53894fdc37b3a0cd30 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.128018 25507 tablet_replica.cc:333] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.128576 25507 raft_consensus.cc:2243] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.129072 25507 raft_consensus.cc:2272] T 1d5992c99a0542dfbaf5759f09c43d01 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.131060 25507 tablet_replica.cc:333] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.131547 25507 raft_consensus.cc:2243] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.132362 25507 raft_consensus.cc:2272] T a974f47cf6aa44fca80b8820855303d3 P 566965e90cf14709ae52abc0bf921424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.134384 25507 tablet_replica.cc:333] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.134862 25507 raft_consensus.cc:2243] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.135288 25507 raft_consensus.cc:2272] T f011340985984ac28ee694cb6aa6ea6a P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.137358 25507 tablet_replica.cc:333] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.137882 25507 raft_consensus.cc:2243] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.138339 25507 raft_consensus.cc:2272] T 200031007bd5431ea5a07360df57cba2 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.140602 25507 tablet_replica.cc:333] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.141137 25507 raft_consensus.cc:2243] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.141551 25507 raft_consensus.cc:2272] T f1f84a92b37a4609acc81a8b219d45f6 P 566965e90cf14709ae52abc0bf921424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.144582 25507 tablet_replica.cc:333] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.145707 25507 raft_consensus.cc:2243] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.146169 25507 raft_consensus.cc:2272] T 1deca76e45774eebaf854bd715f4ccba P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:42.147382  5210 consensus_peers.cc:597] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 -> Peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Couldn't send request to peer 566965e90cf14709ae52abc0bf921424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.148615 25507 tablet_replica.cc:333] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424: stopping tablet replica
I20260709 13:11:42.149137 25507 raft_consensus.cc:2243] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.149545 25507 raft_consensus.cc:2272] T 37edbfac9176427092b4997d580c6900 P 566965e90cf14709ae52abc0bf921424 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:42.160799  5207 consensus_peers.cc:597] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 -> Peer 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169): Couldn't send request to peer 511db311300b46ff91ae296b93d61e08. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:40169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.182910 25507 tablet_server.cc:196] TabletServer@127.24.232.194:0 shutdown complete.
W20260709 13:11:42.197736  5210 consensus_peers.cc:597] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 -> Peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Couldn't send request to peer 566965e90cf14709ae52abc0bf921424. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:38809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.209990  5210 consensus_peers.cc:597] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 -> Peer 566965e90cf14709ae52abc0bf921424 (127.24.232.194:38809): Couldn't send request to peer 566965e90cf14709ae52abc0bf921424. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.194:38809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.221666 25507 tablet_server.cc:179] TabletServer@127.24.232.195:0 shutting down...
W20260709 13:11:42.247315  5207 consensus_peers.cc:597] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 -> Peer 511db311300b46ff91ae296b93d61e08 (127.24.232.193:40169): Couldn't send request to peer 511db311300b46ff91ae296b93d61e08. Status: Network error: Client connection negotiation failed: client connection to 127.24.232.193:40169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.249745 25507 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:42.250605 25507 tablet_replica.cc:333] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.251627 25507 raft_consensus.cc:2243] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.252509 25507 raft_consensus.cc:2272] T 9180ef341ac54f8ab26fbe97f063c71c P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.254539 25507 tablet_replica.cc:333] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.255026 25507 raft_consensus.cc:2243] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.255410 25507 raft_consensus.cc:2272] T 9cfd038d86144855a5a5d94df643f440 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.257316 25507 tablet_replica.cc:333] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.257795 25507 raft_consensus.cc:2243] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.258164 25507 raft_consensus.cc:2272] T 47d2ffadc1b346c1a799752ae255cc21 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.259984 25507 tablet_replica.cc:333] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.260479 25507 raft_consensus.cc:2243] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.260865 25507 raft_consensus.cc:2272] T a210d9e18dae4f2f92fabd9ed60803ea P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.262609 25507 tablet_replica.cc:333] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.263077 25507 raft_consensus.cc:2243] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.263437 25507 raft_consensus.cc:2272] T e157db3b0632460abfd927c04a2797b1 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.265328 25507 tablet_replica.cc:333] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.265802 25507 raft_consensus.cc:2243] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.266170 25507 raft_consensus.cc:2272] T 361d8f1a80a14d53894fdc37b3a0cd30 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.267959 25507 tablet_replica.cc:333] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.268465 25507 raft_consensus.cc:2243] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.268817 25507 raft_consensus.cc:2272] T 1d5992c99a0542dfbaf5759f09c43d01 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.270589 25507 tablet_replica.cc:333] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.271018 25507 raft_consensus.cc:2243] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.271773 25507 raft_consensus.cc:2272] T aa7be7e8c0d84af381b633f3b13295a7 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.273677 25507 tablet_replica.cc:333] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.274178 25507 raft_consensus.cc:2243] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.274521 25507 raft_consensus.cc:2272] T a974f47cf6aa44fca80b8820855303d3 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.276536 25507 tablet_replica.cc:333] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.277005 25507 raft_consensus.cc:2243] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.277366 25507 raft_consensus.cc:2272] T 471ac51a678049b8af829f731acae687 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.279263 25507 tablet_replica.cc:333] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.279767 25507 raft_consensus.cc:2243] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.280167 25507 raft_consensus.cc:2272] T effd2f3b6e8b4e3db29559c50ec602fa P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.282054 25507 tablet_replica.cc:333] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.282528 25507 raft_consensus.cc:2243] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.283208 25507 raft_consensus.cc:2272] T eef0aea3ef4344febed7ca613b962cd0 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.285411 25507 tablet_replica.cc:333] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.285874 25507 raft_consensus.cc:2243] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.286254 25507 raft_consensus.cc:2272] T f011340985984ac28ee694cb6aa6ea6a P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.288115 25507 tablet_replica.cc:333] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.288540 25507 raft_consensus.cc:2243] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.288919 25507 raft_consensus.cc:2272] T 200031007bd5431ea5a07360df57cba2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.290802 25507 tablet_replica.cc:333] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.291237 25507 raft_consensus.cc:2243] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.291594 25507 raft_consensus.cc:2272] T 37edbfac9176427092b4997d580c6900 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.294158 25507 tablet_replica.cc:333] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.294894 25507 raft_consensus.cc:2243] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.295495 25507 raft_consensus.cc:2272] T 1deca76e45774eebaf854bd715f4ccba P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.298194 25507 tablet_replica.cc:333] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.298805 25507 raft_consensus.cc:2243] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.299907 25507 raft_consensus.cc:2272] T f1f84a92b37a4609acc81a8b219d45f6 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.302838 25507 tablet_replica.cc:333] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2: stopping tablet replica
I20260709 13:11:42.303514 25507 raft_consensus.cc:2243] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.304095 25507 raft_consensus.cc:2272] T 8c5625841028470c82811ea178953de2 P da09a5ae8b4c4a62bb8ac9d0f69206a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.349424 25507 tablet_server.cc:196] TabletServer@127.24.232.195:0 shutdown complete.
I20260709 13:11:42.381752 25507 master.cc:562] Master@127.24.232.254:36391 shutting down...
W20260709 13:11:42.405946  5041 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:11:42.406980 25507 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.407511 25507 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.407871 25507 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6dc4f2e25670427187ab53a6648be46d: stopping tablet replica
I20260709 13:11:42.428352 25507 master.cc:584] Master@127.24.232.254:36391 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11499 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24093 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (326283 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:11:42.483744 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 401 messages since previous log ~14 seconds ago
I20260709 13:11:42.483999 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 401 messages since previous log ~14 seconds ago
I20260709 13:11:42.484184 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 395 messages since previous log ~14 seconds ago
I20260709 13:11:42.484390 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:11:42.484572 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:11:42.484795 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~111 seconds ago
I20260709 13:11:42.484987 25507 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~239 seconds ago
I20260709 13:11:42.485232 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:11:42.485533 25507 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 119 messages since previous log ~31 seconds ago
